Unless you have some big immediate plans, I'd feel a bit uncomfortable having that many miles/points around. As has been pointed out, hotel points can be worth a lot less than airline points.

Personally, I try to keep about 500k in airline points on hand. Hotel points really depend on what chain we're talking about. 500k SPG are worth considerably more than 500k Radisson.