You won't see any penguins moving around at St Kilda pier until right at sunset or after. This is when they start to return from the ocean.
However, anytime during the day you can walk along the rocks and usually see a penguin or two sleeping in their burrows. These guys have taken the day off 'work', to rest, molt, or look after eggs/chicks.