Rigid buildings will snap and collapse. You want them moving with the wind (obviously to a certain point). If that's scary, you should see the deflection in a large ocean going ship - those things bend all over the place.