@BruteNerd as @mike said, I work in InfoSec. Like you I pivoted (kind of) a few years back. I was an IT generalist too, then moved in to networking and security around 8 years ago. I've since moved away from networking and now work solely in security.
Is there a particular part of security you'd like to go in to? Also, no, you're not too old.