I'm sure it would raise a few doubts in my mind, but then I look at what I know about the safety record and maintenance of the airline. If I saw cabin or flight crew looking a bit concerned about the state of the aircraft then obviously I'd be thinking more about it.
Paint is cosmetic and does flake off from time to time. Metal is structural and if that flakes off then you see why the flight crew earn the bigger bucks.