XOOPS 
Forum
Forum Index General Forums Community Support Modules Support Themes Support Development International Support Module Hack Reviews Theme Designer Talk
  1. Board index / 
  2. XOOPS Community Support forums / 
  3. XOOPS general usage questions 
  4.  / Best bot set up?
Register
1
lllkailll
Best bot set up?

  • 2006/7/14 0:18

  • lllkailll

  • Just popping in

  • Posts: 25

  • Since: 2006/6/21


What is the best setup for bots ,crawlers and spiders to search my XOOPS site. By index or no index?
2
tcnet
Re: Best bot set up?

  • 2006/7/14 3:03

  • tcnet

  • Friend of XOOPS

  • Posts: 297

  • Since: 2006/5/12


You will want to use Index,Follow to have the bot index the text and follow the links on each page.

No Index will prevent the site from being listed on the search engine's index. Here a good link about the robots meta tag: http://www.searchtools.com/robots/robots-meta.html

You will also want to check that you have a robot.txt file in your home directory. The robot.txt that is installed with XOOPS works for most situations. Here's a good link for robot.txt info: http://www.searchtools.com/robots/robots-txt.html
3
lllkailll
Re: Best bot set up?

  • 2006/7/16 11:20

  • lllkailll

  • Just popping in

  • Posts: 25

  • Since: 2006/6/21


okay thanks for the info.

Login

Register now!  |  Lost Password?

Search

Advanced Search

Recent Posts

Who's Online

222 user(s) are online (162 user(s) are browsing Support Forums)

Members: 0

Guests: 222

more...

Donat-O-Meter

Stats
Goal: $100.00
Due Date: Nov 30
Gross Amount: $0.00
Net Balance: $0.00
Left to go: $100.00
Make donations with PayPal!

Latest GitHub Commits