We've never had a problem leaving and coming back in again. Some lounges don't have bathrooms, and if you're using Airline A's lounge they don't post the status of Airline B's flights. So, there are many reasons to enter and exit. You might want to let them know if you'll be out for an hour or so to get a meal.