Definitely Selçuk. It's a real town (with a train station!) and a few sights as well as being close to Ephesus and the Virgin Mary's house. Also it's a good starting point for Sirince.
Good family hotels, decent local food and the opportunity to be seen as a person rather than a source of income ... which is totally what I felt in Kusadasi.
SELCUK every time.