I wear twin sets or a top and sweater all the time and have never been asked to remove my sweater. However, I am often selected for extra screening. I always thought it was because my laptop was so small. (An SEA security person told me several years ago that it didn't look like a real laptop)