I've not stayed at the Caravelle but I've visited the hotel a couple times - experience was fine in the outlets I visited.

I have stayed at the Majestic a couple times - both times on the river side. The street running between the hotel and the river can be really noisy but I don't remember that being a problem when the windows were closed.
I enjoyed the quirky historic aspect of the property and liked being on the river. The rooms were nice, comfortable and functional but nothing mind blowing - a bit staid but not bad.