+1 -- as far as I can tell, you can even check strollers, carseats, etc for free if there is no child anywhere near you or your reservation. They're simply classified as special "exempt" items when it comes to baggage charges.

You can also gate-check the carseat as well (this is especially useful if you have a carseat-universal carrier combination instead of a standard stroller).