If it was classified or he didn’t have the right to take it, punish him accordingly. He’s not above the law.
That said, it’s hard to imagine what he did take and that he walked out with anything too important, but we’ll see. The approach to search wasn’t well thought through and if he doesn’t have anything “important” it will look like they are trying to get him on a foot fault.