I've seen this happen. Often a diplomatic FA can negotiate to some success. There really isn't much that can be done. I had a decent night's sleep ruined by a seat mate who insisted on opening his window shade as the sun came up over the Atlantic. That taught me the value of eyeshades.