I've had such concerns about the new RFID passports. I read somewhere that a carrier or holder lined with the right material (aluminum?) could prevent casual reading of the RFID chip. Perhaps nfc has some insight.
It wouldn't address times when you have to remove a passport from its holder, but it would prevent someone reading it from one's pocket, purse or backpack.