No, it wouldn't be a huge problem. Should be fine. Connections at HKG are quite efficient, and if there's a slight delay such that your connection becomes really tight, then usually there'll be someone at the arrivals gate to usher you through transit security

. Worst thing is, though, you'll miss out on checking out HKG (or lounges if you're eligible)