Schengen and EU are NOT the same thing.
OP is married to a citizen of an EU country, therefore he has the same freedom of movement as his wife EXCEPT in Poland where he needs permission to live there.
However your wife will have to apply for an EEA Family Permit in order to be granted those rights
http://www.ukvisas.gov.uk/en/howtoap...snationals#Q10