This is a really bad idea. Johor Baru, at least the area around the border crossing, is a dump. And getting to and from the border and dealing with crossing formalities can be exasperating: depending on time of day there can be enormous waits for the public buses in crowded fetid conditions.
You do not want to do this.