There usually isn't food at Yasaka Jinja, but there is a Lawson right across the street from it.

For going to Kyoto, Kitahama is in a really good spot - the Keihan line is there, which is convenient for a lot of the sights, and it is easy to change to the Hankyu line going to Kyoto (not so much for going to Kobe though). Umeda is close (less than 10 minutes on the train) as well. If you like walking, it might be worth it to simply walk to Umeda (15 minute walk to the close areas, 30 minutes or so to Hankyu Umeda station, for example)

There is one supermarket right near the station and another about a 5 or 10 minute walk away. There are tons of restaurants, but it is primarily a business district (it'll be much busier in the day than at night and on the weekend).