The FA was right and you were wrong. If it's not company policy, it damn well should be. FAs are agents of the company, and when they deliver anything that belongs in F to anyone in Y, other pax see that and assume favoritism. You can deliver a food item from F to someone in Y without any untoward implication.

Sounds like you finally ran into a FA with a good head on his shoulders.