Seriously doubt you'd have any issues with this. People re-allocate all the time after getting new cards on these forums.
After I got my CSR, I dropped all my other cards down to either 5 or 10k, put about 20k of what I reduced onto the CSR, and let the rest "go".
Oddly, my re-allocation DID put me over the 35k other people mentioned but I don't remember needing to be transferred or it even taking more than a few seconds per drop/reallocation. I can't remember if I was at 34k or 36k before the re-allocation though, so maybe I was already over.