You need a permit to go to the andaman islands but you get one when you land. I am not sure what the implication of going there with a travel visa is though with its new one-entry rule.
There is not much to do at port blair. I suggest taking the ferry out to the havelock island island. We stayed at the barefoot resort right by beach #7.