As usual, we're on the honor system.
Simply remove any incriminating labels regarding lithium and you should be good to go. This is especially true for a carried-on battery that exceeds 2g Li+. However, you'd probably have to look pretty hard to find such a battery.