XOOPS 
Forum
Forum Index General Forums Community Support Modules Support Themes Support Development International Support Module Hack Reviews Theme Designer Talk
  1. Board index / 
  2. XOOPS Community Support forums / 
  3. Beginner's Corner 
  4.  / Please check this robots.txt file...
Register
1
Cavan
Please check this robots.txt file...

  • 2004/12/20 6:29

  • Cavan

  • Friend of XOOPS

  • Posts: 218

  • Since: 2004/11/28


The robots.txt in my root directory looks like this:

User-agent: *
Disallow: /cgi-bin/
Disallow: /tmp/
Disallow: /cache/
Disallow: /class/
Disallow: /images/
Disallow: /include/
Disallow: /install/
Disallow: /kernel/
Disallow: /language/
Disallow: /modules/ <---see below
Disallow: /templates_c/
Disallow: /themes/
Disallow: /uploads/


Will googlebots (etc) stay out of the modules directory if this is disallowed here?

Login

Register now!  |  Lost Password?

Search

Advanced Search

Recent Posts

Who's Online

346 user(s) are online (301 user(s) are browsing Support Forums)

Members: 0

Guests: 346

more...

Donat-O-Meter

Stats
Goal: $100.00
Due Date: Nov 30
Gross Amount: $0.00
Net Balance: $0.00
Left to go: $100.00
Make donations with PayPal!

Latest GitHub Commits