Assuming you are in the US.
I recall going on a field trip to see the tower many years ago, long before 9/11 and the TSA. I suspect it would be very difficult these days. You are correct that the FAA would be who to ask, probably at your local airport.