Strange for a 320. A CRJ I would have understood. Even the E 90 and E 70 service at or around meal time includes a cheese plate with fruit or a cold plate of some sort.
Could it have been due to choppy air? They often will cut back or cancel service if there is turbulence.