It's not difficult to take the bus, since buses depart from Gongbei right at the border. Over the years, lots of foreigners have taken the bus without problem, since it was the main transport between Guangzhou and Zhuhai until the train opened.
Compared with taking a taxi anywhere, it's downright easy.