Check
http://www.southernrailway.com/ there are tons of regular trains between Gatwick and Victoria, no need really to take the Express, the price difference is huge, and on the website you can get trains from £2 one way (however if you want these super-cheap ones you would have to decide on a specific train and are unflexible in taking one at another time!)