I think the JSA area is one of the key highlights of a trip to the DMZ. Without, I'd agree with mikesaidyes, it just doesn't feel worth the time. Also a trip to the DMZ tends to be an all-day activity. You could knock out at least 3 different cultural places and/or activities in Seoul during that time. Plus lots of good food to choose from.