3
Ahh, google has spidered the XML feed from your news module. Somthing seems to be kinda screwy with it as well. If you view the source, you'll see that the page is, in fact and XML file.
What you may want to do is add rel="nofollow" to the News module's template where it links to the RSS/XML feed. This will prevent search engines from following the link, and thus placing your News feed at the top of their search results.
For now, though, I don't think there's much that can be done until your site is crawled again.
Just goes to show, Google loves fresh content.
@Mith,
Quote:
hmmmm - can the robots.txt tell bots not to crawl individual files? Or just directories?
If it can, you could edit the robots.txt in the XOOPS root.
To the best of my knowledge, no. Google will honor disallowing file exentions (*.cgi), but not individual files.
Hope this helps.
James
Insanity can be defined as "doing the same thing over and over and expecting different results."
Stupidity is not a crime. Therefore, you are free to go.
