In my experience, boarding together in PREM is safe. My wife and I routinely do it when only one gets the upgrade. However, I always make a point of stopping at the podium and clearing it with the GA. None has ever indicated that there would be a problem.