I do this all the time, either between stays or before/after a stay. Never had a problem.

I always tip a little on both ends, as it's a different person. (Usually, I ask the bellhop to come to the room, as that is easier than dealing with it in the lobby.)