1
Cozzie
How is Google doing it?
  • 2008/3/17 3:26

  • Cozzie

  • Not too shy to talk

  • Posts: 133

  • Since: 2007/7/13


Hello

I've just installed isearch and I have noticed that Google is using my site's search block while crawling the site (using keywords that it has found in the site's body).

The thing is, I have the search block turned off for everyone except Admin, so I just can't figure out how the Google spider is uing the search feature when it is not accessible to users (you may wonder why I'm using isearch if users can't search the site - there is a reason, honestly!).

Can anyone figure how Google is doing this?

Thanks!

2
Runeher
Re: How is Google doing it?
  • 2008/3/17 3:45

  • Runeher

  • Module Developer

  • Posts: 825

  • Since: 2008/1/24


That is probably because you have invited googlebot into your site several times.. In protector, in preferences and possible through a robots.txt file...

Rune

3
Cozzie
Re: How is Google doing it?
  • 2008/3/20 2:46

  • Cozzie

  • Not too shy to talk

  • Posts: 133

  • Since: 2007/7/13


Hi Rune, thanks a lot

So I guess its nothing to be worried about right?

But it still confuses me, its shows that Google is visiting the site everyday (and doing a few searches) - but I thought that Google would only visit a site once every 3 months or so. Plus, even though i have invited Google in, how is it seeing blocks that should be only viewable by people logged in as Admin?

Thanks again

4
xiaodao
Re: How is Google doing it?
  • 2008/3/20 4:39

  • xiaodao

  • Just popping in

  • Posts: 9

  • Since: 2007/11/14


put ti just

Login

Who's Online

359 user(s) are online (202 user(s) are browsing Support Forums)


Members: 0


Guests: 359


more...

Donat-O-Meter

Stats
Goal: $100.00
Due Date: Nov 30
Gross Amount: $0.00
Net Balance: $0.00
Left to go: $100.00
Make donations with PayPal!

Latest GitHub Commits