Yes, you don't need a reservation for that short trip. Just take an available seat (there are small displays above the seats, if they don't show anything, then the seat is not reserved, if they show anything like Frankfurt - ..., it's reserved from Frankfurt on, so you can still sit on it to Central station).