I see passengers often carrying those little yappers in shoulder bags meant to carry cats. I've never been bothered by them on the plane, but it'd be heck to have to endure the thing barking when I am trying to sleep.
If your tiny dog tends to make a lot of noise, please be courteous to your fellow passengers and check Fluffy in!