It all depends on the issuer of the bill, etc. If they have a physical payment point, it could be possible. I don't think utilities have such customer service points anymore, but who knows - check your provider. Elisa/telia/etc might work. But if they accept payments, you can just use the Visa, no need for Curve. Some countries differentiate between credit and debit cards, that's where Curve might come handy, but in Finland a Visa is a Visa.

PS - I just checked ATM withdrawals, although no extra fees, but also no Avios earning. The Visa app shows for each transaction if it's Avios earning or not.