For me this happens more when I am upgraded and my companions are not. In this case should they be allowed to board with first class?
No. Why should they be? If you can bear to sit without them for the whole flight, you can deal with boarding separately from them too.