Follow-up on banks--
HSBC has a major building at the end of Sathorn near where it turns into Wireless at Lumpini Park. Don't know what the branch looks like there.
UOB has outlets in a number of major SkyTrain stations, including Nana and a mini-branch at Chid Lom. Those may be fairly convenient for a lot of tourists.