Modules: Spiders 1.06
Posted by: wishcraftOn 2009/6/27 20:50:00 6927 readsSpiders is a robot manager tool, that imports a list of all crawler and scanner robots on the web. It allows you to use XOOPS Permissioning to control the data that robots list online your site. It will also log the robot in using a post loader and display when the robot is online on you 'Whos Online'.
The robot text file used is taken from an online resource of Robot data and stores it in your database. Remember to adjust your mainfile.php to include the post loader after the common file is loaded.
Robot Manager (Spiders) is a good way to control what your site displays in search engines.
Spider is only written for XOOPS 2.3 and later.
Download: xoops2.3_spiders_1.06.zip (92Kb)
Mirror: Sky Driver Spiders Folder
Changes
* Safe User Agent Introduced
* 1000% Faster Post Loader
* User Group Imports Registered User Permissions
Shouts
Trabis - Thanks for the permission suggestion (Now implemented)..