According to Skyteam rules, lounge access is only given for departure flights. However, it is a benefit for FB PE (& GE?) members that they can use the KLM lounge at AMS as arrival lounge as well.

I believe the reason they will not let you in in other situations, as they cannot bill the partner airline for access (as you should not have had access).

Gajan