I would do exactly as you suggest... go for the earlier flight on the way out (as you haven't got anything to lose if you miss it), but allow yourself the extra safety margin on the way back.

I have flown Brussels Airlines and found them to be perfectly OK.