I've always worn slipons with comfortable rubber soles when flying, and these are quite easy to remove. No holes in my socks or if there are they're nobodys business than mine.

Given the number of backpacker / bum types in most airports you'd look positively well dressed if a hole in your socks was the only issue you had ..