Not at all. Variables related to "when it's raining) that affect your enjoyment more than rain falling would are sun/clouds, winds, and temps.

So, if it's just some rain but it's not windy or cold, your enjoyment will be pretty much defined by sunlight. If it's windy and colder, then it won't really matter if the rain is falling or not.