The sign will not disappear as people will start smoking again. There's always someone in a large group of people saying "I can smoke. There's no sign saying otherwise".
On newer airplanes the sign has been replaced by a sticker, which seems reasonable given that the "no smoking" sign usually isn't switched off.