I will second the boat suggestion. I was there in the winter, but the boat was still fun. Good local music and drink!

Also, try the little shops on Knez Mihajlova, down from Kalemegdan.

One of the things I enjoyed most about Belgrade were the quaint bars and coffeshops; a good area for exploring (maybe it was Skadarlija?)!