They have already started to get rid of them (much to the chagrin of PETA). Mayor Bloomberg was even quoted saying "There is not a lot of cost involved in rounding up a couple thousand geese and letting them go to sleep with nice dreams."
However, the DNA analysis of the geese that brought down the USAir jet was that the geese were Canadian Migratory, and not the local variety.