Most of the 5* hotels will sell you a day pass to their gym, particularly if you only use it during off-peak hours. So it depends exactly where you are staying in Kowloon - just go to the most convenient 5* hotel and ask.