There is a bus you can catch at the Ubon main bus terminal. It runs twice daily and costs 200 baht. It takes about 3 hours or so to get to Pakse. They stop at Chong Mek border crossing and you can get your visa on arrival there. You can pay in US$ or Thai Baht but it is usually cheaper in $. I hope this helps.