I've always believed that during daytime (or when most of the plane is awake on longhauls), the window passenger should have control over the shade. However, if its nighttime (eg when cabin lights are off), then the shades should be down. I think most people probably agree with this.