Saturday,

I did not notice this before. Today as I was looking into my Google Adsense account I noticed this... actually never read that far before :)
---------------------
To maximize your potential with AdSense, it is important that your site content is accessible to our content crawler. Certain mechanisms on your site may limit the amount of content we can crawl and use to generate ads:

Robots

If you have a robots.txt file, remove the file or add the following two lines to the top of the file:

User-agent: Mediapartners-Google*
Disallow:

This change will allow our bot to crawl the content of your site, so that we may provide you with the most relevant Google ads.
 ---------------------

Regards
rocket98

I think the basic XOOPS robot.txt is ok. The first line is

User-Agent: *

That means every one is welcomed including the google. The disallow statement has the files that google crawler should not look into such as the cgi-bin and other XOOPS system files. I believe this web site is crawled every night and the admin did not change the robot.txt

Hi Jackwan,

That's probably true but this info looked specific to Mediapartners-Google web bot.

the way I read it these particular bots seek alternate info to portray better topical ads. If Google suggests it be used that way it must be for some good reason. Oh well I'll give it a try for a few weeks and see how the ads appear. Right now I get the same 4 ads on every page no matter what the page content suggests... maybe this will change it.

Regards
Rocket98

hi rocket98,

did you get good results?

Best Regards,

Is there a way to hide one specific page in the robot.txt file?

I have a spammer that keeps registering an acct on my site to get a link back to his.

I'd like to just hide the one generated members page so that he could keep the acct but would not get the benefit of a link from my site.

thanks