Technically the passport only serves as proof of your identity. As a US citizen, you shall not be prevented from entering the US. The USCIS people may give you flack about it and make you wait while they verify your identity, but they can't stop you.