Mong Kok street market is a good place to get cheap trinkets. I I can breeze through and get that kind of cheap stuff for half a dozen family memeber in less than half an hour.
You can find it by getting off at Mong Kok MTR station, and heading a few blocks east - it stretches several blocks north/south parallel to Nathan Road, so you can't miss it.