Well, Im actually Norwegian, and yes, I have tasted whale meat several times. I guess it used to be real inexpensive back in the days, while it is EXPENSIVE today... Anyways. Doesnt taste really good, I would describe it as liver...
EDIT: And its not that common. Probably as common as liver, which isnt common in the US nor Norway.