That yucky old coffee flavor permeates coffee makers. I am also a tea (only) drinker and it's sometimes a challenge to just get unflavored hot water out of a coffee maker. If possible, I just take the filter basket out altogether and put the cup/pot underneath the water jet, although with some coffee makers you have to watch out that you're not spraying boiling water all over the place by doing that. The most aggravating instances are when you just get a Keurig. No solution for that.