I'm trying to get Google AdSense set up for my site. They recommend either deleting robots.txt, or adding this to the top of the robots.txt file:
User-agent: Mediapartners-Google*
Disallow:
Here's what my robots.txt looks like now:
User-agent: *
Disallow: /cgi-bin/
Disallow: /tmp/
Disallow: /cache/
Disallow: /class/
Disallow: /images/
Disallow: /include/
Disallow: /install/
Disallow: /kernel/
Disallow: /language/
Disallow: /templates_c/
Disallow: /themes/
Disallow: /uploads/
How should I handle this? What is actually going on with the robots and such? Sorry I am so ignorant -- I'm learning!