My wife and I tend to separate (she's a US citizen, I'm British) unless directed otherwise. At some airports we've been told to ignore the labels and go whereever we want and others we've been told clearly to make sure we go to the right ones. I prefer to play itself as we've both had attention from immigration at times and it's easier to avoid it.