Nonetheless, even if the engine didn't fall off...if the panel came open during flight that would probably also be bad.

I think I would have calmly and privately reported this to the FA. I'm sure the captain would want to know as only they have the expertise to decide the question of whether it matters or not.