I don't think there's really any hope of avoiding this. Strange how they just hang up when my wife answers, though. (She's a native speaker, I know a couple of dozen words and my accent is so bad that it's about 50:50 whether I'll be understood.)