You can come up with a scare scenario for any situation. How often do the trains break down, derail etc.? Very rarely. As long as making your flight is not an absolute must happen situation ( and we could construct scenarios where your incoming flight is delayed 4 hours and you miss it anyways ) , then I don't see any problem with spending an hour downtown.