Oh this old chestnut. Speaking personally I am a huge fan of the window seat, I like to see myself moving when flying, I love to see the scenery go by - I find it very relaxing.
When the cabin crew dim the lights after service I will typically take that as a cue to close my blind. That seems fair.
One exception was on an early morning MIA-LAX once. Beautiful views over the Arizona desert. Evil looks from other passengers but dammit I've not flown over that part of the US before and I wanted to see this stuff!
What really flusters me is when CC ask me to close my blind during meal service because it's annoying another passenger. I've chosen a window seat for a reason, I want to look out! But I don't want to be a **** to another passenger. Not found a nice way out of that one.