Happens every so often because staff forget that there are Y pax in the elevators

As you saw lower deck boarding requires a card to allow exit (if you haven't taken the economy programmed lifts down at A) but no problem boarding on the upper deck then taking the front or rear stairs down to Y.