2
If anonymous is blocked, that should include the SE bots. Has anyone else seen anything that disputes this? I don't know how a bot could get through if it doesn't have a password. I have heard that you can have private forums spidered if you let Google know the password but I do not personally know anyone who has done this. Otherwise, it should be safe. Hopefully, someone here will confirm this.
Quote:
JamesSAEP wrote:
If I have a restricted forum or block that is not allowed access by Anonymous, will the we crawlers be able to see the information?
I want to have a forum that is completely blocked from google, yahoo, msn, and all the search engines.
[size=x-small]Working sites:
XOOPS 2.0.16 PHP 5.2.2, MySQL 5.0.24a-standard-log, Apache/2.0.54 (Unix)
XOOPS 2.2.4, PHP 4.3.10, MySQL 3.23.58, Apache/1.3.33 (Unix)[/size]
