No one wil punt you anywhere, so you're pretty safe on that front.
If you're originating at IAD, you can take the Aerotrain after security to B and then a people mover to D. If you're on an arriving flight, you can transfer between any other terminal and B without going through security again.