JAL mentions those that have used a travel agent need to contact them first (as in the travel agent).
This is normal for 3rd party bookings.
What I cannot find an answer for is if any internal ticket bought with Jal.co.jp is refundable now (even if bought after the fact). There is no “applicable period” as for international tickets.