Frankly, I would say that if you are new to the program and if you think there is another chain that can fit your expectations and matching the locations you want to stay, go ahead. You're only silver, it's now or never. Don't wait to reach gold, you'll be disappointed and you seem to already be.
For the money you spend, you can definitely find another chain and get quickly a status. Hilton is currently offering a fast track.
Accor's CS is reknown to be a running gag. I have lived it from the inside and now from a customer point of view.