Spiders 2.66 - Final Release [Module Testing Area]

1

Spiders 2.66 - Final Release

2011/3/4 13:21
wishcraft
Module Developer
Posts: 3711
Since: 2007/5/18

Spiders 2.66
With Anti-Spider Trawling Xortify Banning

Spiders is a robot manager tool, that imports a list of all crawler and scanner robots on the web. It allows you to use XOOPS Permissiveness to control the data that robots list online your site. It will also log the robot in using a post loader and display when the robot is online on you 'Whos Online'.

Do you want your robots like GoogleBot, Yahoo Slurp! and others to log in and identify on your xoops installation? Then spiders is for you!!! The robot text file used is taken from an online resource of Robot data and stores it in your database. Remember to adjust your mainfile.php to include the post loader after the common file is loaded. Robot Manager (Spiders) is a good way to control what your site displays in search engines.

New Features

Polls API in SOAP
Polls API in cURL
Polls API in JSON
Modification & Live Area
Easy Xortify Signup
Improved Preloads
SEO Advantage Sharer
Upgrade Path Maintained
SEO URL Rewrites
User Interface

Bugs Fixed

wGET Polling
CURL Polling
Xortify Preferences URI
No option of what protocol to use

Spider is only written for XOOPS 2.3 and later.

Download: xoops2.5_spiders_2.66.zip (101Kb)
Mirror: Live Skydriver
Demo: http://xoops.demo.chronolabs.coop/

www.ohloh.net/accounts/226400

Follow, Like & Read:-

twitter.com/RegaltyFamily
github.com/Chronolabs-Cooperative
facebook.com/DrAntonyRoberts

2

Re: Spiders 2.66 - Final Release

2011/3/6 19:19
Nick_James
Friend of XOOPS
Posts: 359
Since: 2006/10/14

"Remember to adjust your mainfile.php to include the post loader after the common file is loaded. "

How do we do this?

3

Re: Spiders 2.66 - Final Release

2011/3/21 18:08
timgno
Module Developer
Posts: 1504
Since: 2007/6/21

I had to uninstall it because of an error 408, did not allow me to view the entire site on Opera Browser, with a sudden drop in visits.

Quote:

[21-Mar-2011 17:59:01] PHP Fatal error: Call to undefined function spiders_obj2array () in /home/modules/spiders/class/curl.php on line 82

http://www.txmodxoops.org

4

Re: Spiders 2.66 - Final Release

2011/3/22 16:56
wishcraft
Module Developer
Posts: 3711
Since: 2007/5/18

Quote:

by Nick_James on 2011/3/7 5:19:15

"Remember to adjust your mainfile.php to include the post loader after the common file is loaded. "

How do we do this?

You only have to do this with XOOPS 2.3 and earlier.

www.ohloh.net/accounts/226400

Follow, Like & Read:-

twitter.com/RegaltyFamily
github.com/Chronolabs-Cooperative
facebook.com/DrAntonyRoberts

5

Re: Spiders 2.66 - Final Release

2011/3/22 17:20
wishcraft
Module Developer
Posts: 3711
Since: 2007/5/18

Quote:

I had to uninstall it because of an error 408, did not allow me to view the entire site on Opera Browser, with a sudden drop in visits.

I can't seem to reproduce that error on xoops 2.4 or 2.5 what version of xoops are you running tim? Most of those visits are bots that is probably why.

www.ohloh.net/accounts/226400

Follow, Like & Read:-

twitter.com/RegaltyFamily
github.com/Chronolabs-Cooperative
facebook.com/DrAntonyRoberts

6

Re: Spiders 2.66 - Final Release

2011/3/22 21:51
timgno
Module Developer
Posts: 1504
Since: 2007/6/21

Average visits were the first of about 100 a day, when I installed the module spiders, fell 5 3 and also to zero, I could not understand why, until I opened the site with Opera, which gave me error 408, I viewed error_log file in the root and I found the above error. Now he is back as before after uninstalling

http://www.txmodxoops.org

7

Re: Spiders 2.66 - Final Release

2011/3/23 3:13
wishcraft
Module Developer
Posts: 3711
Since: 2007/5/18

yeah spiders is a tricky one, i am not sure if i have all the reserved words yet covered in the preferences. I will have to download opera and try it out I guess.. Did you think about either turning off the cloud response by clickin on the SEO function or possibly changing protocols to something like SOAP?

www.ohloh.net/accounts/226400

Follow, Like & Read:-

twitter.com/RegaltyFamily
github.com/Chronolabs-Cooperative
facebook.com/DrAntonyRoberts

Stats
Goal:	$100.00
Due Date:	May 31
Gross Amount:	$0.00
Net Balance:	$0.00
Left to go:	$100.00

Spiders 2.66 - Final Release

Re: Spiders 2.66 - Final Release

Re: Spiders 2.66 - Final Release

Re: Spiders 2.66 - Final Release

Re: Spiders 2.66 - Final Release

Re: Spiders 2.66 - Final Release

Re: Spiders 2.66 - Final Release

Login

Search

Recent Posts

Re: Rebuilding and Updating a 20 years old Xoops Website from 2.0.18? to 2.5.11

Rebuilding and Updating a 20 years old Xoops Website from 2.0.18? to 2.5.11

Re: NewBB v 5.1.0 b 6

Re: NewBB v 5.1.0 b 6

NewBB v 5.1.0 b 6

Re: XOOPS 2.5.11 search user is not working

Re: oledrion

Re: oledrion

Re: oledrion

Re: oledrion

Who's Online

Donat-O-Meter

Latest GitHub Commits

{{ record.sha.slice(0, 7) }} - {{ record.commit.message | truncate }}