I went to Europe for 16 days last month with only a normal sized backpack and my (relatively light) rollaboard, and returned only with that much.
99% of the time, I never have any checked luggage. Life is so much happier that way!

It certainly takes a lot of discipline, but gets easier once one develops a routine.