I would echo train over car whenever possible, and don't get the pass, it will be too expensive.
I actually think Brussels makes a good base for seeing Ghent and Bruges, or alternately stay in Ghent. But I think I'd consider renting a car for Luxembourg, and staying one night there before driving back. As others have said, it's a nice drive, and you may want to make stops and take your time along the way.