1
mercury500
GSiteCrawler - Anybody Have A Nice Filter List for Xoops?
  • 2007/7/1 19:20

  • mercury500

  • Just popping in

  • Posts: 19

  • Since: 2005/2/11


I've started crawling with this tool and it's gonna take awhile because it's getting lots of unnecessary pages.

I've blocked the obvious, like print.php and rss.php URL's, but does anybody use this and have a comprehensive filter list for XOOPS based sites?

If you don't know, this is a nice sitemap creator. So, I suppose any filter list for any other sitemap creators would work too.

Thanks.

2
script_fu
Re: GSiteCrawler - Anybody Have A Nice Filter List for Xoops?

I've never used this before but it does look interesting. Here is a little bump because maybe someone will come along that has.

Login

Who's Online

288 user(s) are online (200 user(s) are browsing Support Forums)


Members: 0


Guests: 288


more...

Donat-O-Meter

Stats
Goal: $100.00
Due Date: Nov 30
Gross Amount: $0.00
Net Balance: $0.00
Left to go: $100.00
Make donations with PayPal!

Latest GitHub Commits