Too big to handle or too big as in too easy to get too big for airlines/rental cars?

I'm also going to be handling a toddler. Heck, I suspect, I'll be handling at least two pieces of luggage and a 1 yr old. I'm just shelling out for bigger cars at the moment.