TSA will let you bring up to 100ml, which is ~3.4 oz. Agree it's rare to be asked to take the 3-1-1 baggie out of your bag (though not doing so gives them an instant "bag check!" excuse if they so desire). It's also rare they notice liquids up to about 4 oz or so that happen to be in the 3-1-1 bag.

Remember, too, that liquids over 100ml can be brought if they're medically necessary.