Recently, several of our members have brought up the issue of personal information (in particular, e-mail addresses) being used by "unauthorized" third parties for marketing purposes (or harrassment).
I believe these concerns are justified. I've also discovered material from FlyerTalk cached in external search engines, which abusers can "mine" with impunity.
I would appreciate it if you would augment webflyer's robots.txt to include the following additional restrictions:
Code:
Disallow: /forum/
Disallow: /forumcgi/
The "honest" search engine operators will respect this. It's not a perfect solution, merely a step in the right direction.
Thanks!
--EPS