It was the "temple" bit that is confusing. It's not thought of as such, although there are temple halls within the nearby monasteries.
The other main large-scale Buddha attraction in HK is the
Ten thousand Buddha monastery in Shatin.
For the taxi, if the meter showed $291 without the addition of any toll charges then $300 was a decent price because the meter fare would have had an additional $50 in tunnel tolls. The MTR would have got you to Tung Chung for $28 (or $24.3 on an Octopus card).