I did 5 days in MAD without knowing any Spanish. With the exception of a few Uber drivers, I got along just fine. Madrid is a beautiful city with much to do. Heck, I could spend a whole spring/fall day in Parque de El Retiro.
One of my fondest travel memories ever was stumbling on the royal palace my first day in town (after a long TATL flight) at "golden hour" (you know, that hour hollywood is always trying to film in during the morning/evenings when the light is the most magical) where the plaza was fairly empty except for some musicians and kids running around with dogs, while a warm gentle breeze blew.