Correct. The US Government does not have right to restrict you from traveling outside the US. I also believe that the Treasury fine is considered a civil penalty, not a fine per se.

All a bunch of legal maneuvering to stop Americans from going to Cuba when they the government has no Constitutional authority to outright prohibit you.