Well this is a relief, I had already started thinking I was behaviorally challenged because I was never quite sure what I was doing with the IFE. Eventually I put it down to the fact that I normally don't use it.
I think the problem is that the handset is rather slow to react. Initially I thought that if you swipe right you would end up in the sub-menus, but this is clearly not the case. The good news is that on the A 350 the IFE has touchscreen capabilities, which makes the IFE easier to use. But on the Dreamliner it's pretty much trial and error.