I've stayed at both and would choose a club room at the Banyan Tree over a deluxe room at the Four Seasons. The Four Seasons has seen better days and the lower category rooms are badly in need of a revamp.
The F&B at the Four Seasons are better though - particularly the Italian restaurant Biscotti.