9
Robots.txt is a very important file. It tells the good robots how to behave on your site.
Google, Yahoo, etc. use robots to crawl the web to index the information so that people can find it.
By setting your robots.txt file, you can tell those robots what to look at and index so they don't waste your bandwidth.
Nicholas James
President - LaDads
www.ladads.info