I had a similar layover last month. Definitely worth going into the city.
I had a great day exploring the old town, national museum, merdeka square and also had time to enjoy two great meals before heading back to the airport.