You do iunless you're in one of the seats where you can squeeze in and out without doing so.

64AK and 62AK on the UD don't require you to hop over. It depends on whether it's a high or low-J as to which seats have the non-hop need downstairs.

On a 3-class 777, 4AK are non-hop as are 11AK (though these are adjacent to WT+ bassinets so not preferred seats).