Amtrak between San Diego and Los Angeles (Union Station) is a beautiful ride along the coast in Orange County and south.

There is very inexpensive public transportation between LAX and the train station. However, it is a local bus that goes through East L.A., Watts, etc. and takes about 1:50.

You can find the routes on the internet.