1
JamesSAEP
msnbot Meta Crawler locks up site
  • 2005/9/9 22:41

  • JamesSAEP

  • Just can't stay away

  • Posts: 732

  • Since: 2005/2/28


Every so often my sites would not come up:
"Error [Xoops]: Unable to connect to database in file class/database/databasefactory.php line 34"
and I couldn't figure out why. I've installed the module myReferer and it shows a Meta Crawler called msnbot (+http//search.msn.com/msnbot.htm) that seems to be crawling the site at the times it's not responding.

1. Is anyone else having this problem? If so, what did you do about it?

2. I assume the msnbot is indexing the site - this is a good thing?

3. Should I block it in the robot.txt file?

Thanks.

Login

Who's Online

111 user(s) are online (63 user(s) are browsing Support Forums)


Members: 0


Guests: 111


more...

Donat-O-Meter

Stats
Goal: $100.00
Due Date: Jun 30
Gross Amount: $0.00
Net Balance: $0.00
Left to go: $100.00
Make donations with PayPal!

Latest GitHub Commits