I have experienced this as well on a few occasions. The last time it happened, two passengers stopped in the J section and packed their luggage and jackets in the overhead bins and then maid their way to the back of the bus. The FA rolled her eyes when they went to the Y section because we both thought that they were sitting in J. Since there was lots of room in J (only 3 of us) she didn’t say anything to them.