1
gojoe_gojoe
Robots crawling print pages....help

I have robots like Google crawling my print pages that are in my articles under my zmagazine module. Any ideas on how to keep them off the print.php page? I notice many pages that are crawled by Google are in their database. I did a search on Google for this problem and I got a lot of print pages that were indexed. Any idea would be helpful.

2
builderb
Re: Robots crawling print pages....help
  • 2005/3/13 7:54

  • builderb

  • Not too shy to talk

  • Posts: 137

  • Since: 2003/8/4 2


2 items should help this:

1. Place this code at the bottom of your print.php page

$xoopsTpl->assign('xoops_meta_robots', 'noindex, nofollow');

2. in the robots.txt file in your root directory add this line:

Disallow: /modules/zmagazine/print.php

this should help keep the robots from spidering that page.

-b

3
gojoe_gojoe
Re: Robots crawling print pages....help

Thanks builderb. I wanted more of an .htaccess script for directing the googlebot like a spider trap, but Google should obey the noindex...not a normal thing for me..Usually I want Google crawling everything

4
ljmyers
Re: Robots crawling print pages....help
  • 2006/3/10 17:16

  • ljmyers

  • Just popping in

  • Posts: 44

  • Since: 2006/1/4 2


I have several modules I'm using in my XOOPS site and wish for it to be crawled by the search engines but do not want any of the search engines to crawl specifically the content module only. Can I use the following and add it to the robot.txt file to prevent the content module (only) from being crawled and indexed?

Disallow: /modules/content/

Thanks up front . . .
Smiles,
Lana
MyOnlineMagazine .net
L.J. Myers Company (My first website)

Login

Who's Online

205 user(s) are online (129 user(s) are browsing Support Forums)


Members: 0


Guests: 205


more...

Donat-O-Meter

Stats
Goal: $100.00
Due Date: Apr 30
Gross Amount: $0.00
Net Balance: $0.00
Left to go: $100.00
Make donations with PayPal!

Latest GitHub Commits