Spiders is a robot manager tool, that imports a list of all crawler and scanner robots on the web. It allows you to use XOOPS Permissiveness to control the data that robots list online your site. It will also log the robot in using a post loader and display when the robot is online on you 'Whos Online'.
Do you want your robots like GoogleBot, Yahoo Slurp! and others to log in and identify on your xoops installation? Then spiders is for you!!! The robot text file used is taken from an online resource of Robot data and stores it in your database. Remember to adjust your mainfile.php to include the post loader after the common file is loaded. Robot Manager (Spiders) is a good way to control what your site displays in search engines.
Watch this video to understand more about spiders!
New Features
Pre PHP 5.2 Compatibility
Search Functions Included
Some of the Features
Clean Robots-all.txt with over 200 bots
Try Exceptions added to API Calls for seemless entry
If you haven't set permission throughout your XOOPS Site for Robots then it is a simple case of uninstalling and re-installing then importing the current robots-all.txt. However if you have set permissions then I suggest you follow the steps as so. a) import robots-all.txt b) change 'Protected Keywords from Useragents' in Robot Managers (spiders) preferences to contain at least these keywords without the carriage return ::
