Pool at the Hyatt costs 2200 for hotel guests. For the longest time if you were a Hyatt point member of any tier the fee is waived. It used to be written on the official Japanese website but the wording is no longer there.
At the few top tier hotels I stayed at in Tokyo (Peninsula, Prince Gallery) , pool access is free. Many foreign guests did not wear swim caps.