Based on your criteria, I'd 100% recommend Luang Prabang, Laos. It should be low season right now, so low season rates (and accommodation there is very good value), beautiful suurrounding scenery and nature, town is lovely to walk or cycle around.
Great food and drink!
You can fly Singapore to Luang Prabang via Vientiane or Bangkok.