Which language you are speaking doesn't matter; just speak at a polite volume given the circumstances.
Probably the most frustrating experience for me with people speaking foreign languages is when they start a "private" conversation at loud volume during a public conversation in the local language. That's simply rude. Have your private conversation quietly, the same as you would if you and everyone else were speaking the same language.