Don't talk to anybody, let them come and speak with you. Politely but firmly say "no," but I'm happy to speak with the Manager if she wants to come up and do so. Then say goodbye and hang up.

There are all kinds of explanations for this, some of them above. But, rather than speculating, let the Manager explain why it is necessary and how she will make it all right.

Remember, that once you move, you are simply whining.