You are going to be spending all weekend with them, a couple of hours apart on the plane is no big deal. I have encountered this situation quite a few times, and take the upgrade and try to get an additional upgrade for someone else if possible. If not, I see them when we land!
Now if it was your wife you were leaving in the back, I would rethink the situation!