SmartFAQ is developed by The SmartFactory (, a division of InBox Solutions (

How do you fine tune robots txt?
  Requested by WarDick and Answered by FusionKid on 2006/3/29 16:48:58     6789  reads 
There is an excellent Wikipedia entry here, with links to several articles and websites that specifically discuss robots.txt and how to fine tune its configuration.

The comments are owned by the author. We aren't responsible for their content.



Lost Password? Register now!

Who's Online

62 user(s) are online (1 user(s) are browsing XOOPS FAQ)

Members: 0

Guests: 62



Goal: $100.00
Due Date: Jan 31
Gross Amount: $0.00
Net Balance: $0.00
Left to go: $100.00
Make donations with PayPal!

Did you know ?

You can automatically send a welcome PM (Private Message) to your new members

Random question

Ho do I make 'Add to favorites' or 'bookmark' and 'Make this your home page' script?