Depends on how important a good nights sleep is to you. No guarantee your next room is going to be better still.

Had a similar situation this week - first room dingy, no windows seriously no windows, so moved to a different room. Band played in the bar directly under my new room so I checked out and moved across the street. Yes I paid for two rooms but I needed to get some sleep.

Good luck