My guess is, you're more likely to find bug feces rather than live bugs. I think finding something like that is certainly grounds for at least a room change. However, I also think that many hotels will try to blow off or counter against such complaint. They may not be swayed unless there's live bug (or at least a dead bug), even though online resources say that bug feces are evidences of infestation.