If the flight was quiet and your party had a spare seat next to them, I don't see how this would be a problem. Or, if the flight was busy, you could perhaps swap seats with someone sat next to your party so they have your seat in J.

Obviously this would all have to be agreed with the crew onboard and not just done on a whim.