Neither area is that bad, Bayswater might be better than Earl's Court. Tube/bus transport is good and with a travel card cheap(ish).

Have a look around the South Kensington/Glocester Road as well, closer but some of the short stay apartments/hotels can be a distance from the tube station. South Kensington is a very easy journey from Victoria station.