FAs should probably not allow non-F passengers crowd the aisle waiting for the lavatory, but other than that, Delta's policy (apparently, because I couldn't find it written anywhere) states that pax "should" use the lavatory in their cabin. It does not prohibit use of the lavatory in other cabins.