I don't ever have a problem with people doing this. So long as the seat is paid for, what does it matter which person sits in it. Now when people are of the last to board and see an empty F seat, and try to sneak into it...that's a whole different story!!!
Bottom line, you should have no problem with this.