We live in a citrus-growing area and have, at times, had it taken away from us at departure airport (out of carry on bags) due to agriculture/pest concerns. Have also had avocados removed by TSA, probably same issues.
Another time took a whole suitcase full of oranges to Eastern Europe, no questions, no problems, was checked luggage. YMMV.