Thanks for all the input. I decided to go to Malacca this time as it was on the way to Singapore. Penang would have set us back around a day due to travel times. I'll be sure to hit up Penang the next time I'm in Malaysia.
Overall, I didn't think Malacca was that bad. Not much exciting stuff to do, but there were plenty of historic sites to see.