Sounds like you have too many credit cards for you purpose (4 if I counted correctly). Since you don't fly often, the annual fee on those cards isn't worth it. I would recommend getting rid of most of the credit cards and try to focus on one account. You said that you wanted access to lounges, and I assume you mean airport lounges, but if you have the HH Surpass and spend 40K a year you get Diamond which can have it's benefits especially overseas.

I have all my stake in my HHonors Amex. I don't fly often, so an airline card wouldn't be of any value. With the free HH card, I put all of my spending on it and receive some rice returns. I'm not the road warrior most people here are, but I do like good deals and you'll find plenty on here.