XOOPS 
Forum
Forum Index General Forums Community Support Modules Support Themes Support Development International Support Module Hack Reviews Theme Designer Talk
  1. Board index / 
  2. XOOPS Community Support forums / 
  3. XOOPS general usage questions 
  4.  / How do I - Stop search engine crawlers & login sharing
Register
1
pmhoran
How do I - Stop search engine crawlers & login sharing

  • 2005/7/14 15:49

  • pmhoran

  • Not too shy to talk

  • Posts: 115

  • Since: 2003/2/21


Hi ....

I have set up a new site that membership is by Invitation Only.

I have edited the robots.txt to block all search engine crawlers ... not only using the "Disallow: /" but I went through and did the same for all directories. And I specificied "User Agent" using the wildcard "*". But according to the site reports ... the site has been crawled twice. I have left the meta keywords & description blank ... and the meta robots "no index, no follow".

I also set up Members myself ... they cannot register themselves. And visitors that happen onto the site get the message that membership is by invitation only.

I am concerned though, that members might share their login & password with friends. Is there a way I can monitor and maybe "know definitely" when more than one person is using a specific login & password?

Thanks for any and all input.
Peter
2
LazyBadger
Re: How do I - Stop search engine crawlers & login sharing

Some spiders can ignore robots.txt settings. You can enable gzip'ing of content (read tip about it on XOOPS Tips)- it will send more crawlers away.
Regaring monitoring shared login - I'm afraid it's impossible for 100%... you can ask (maybe) each member for it's used IP, use smth. like UserVisit module for monitoring not allowed IP and ban these IP, but... it doesn't work at all for members with dinamic IP
Quis custodiet ipsos custodes?

Webmaster of
XOOPS2.RU
XOOPS Modules Proving Ground
XOOPS Themes Exhibition
3
pmhoran
Re: How do I - Stop search engine crawlers & login sharing

  • 2005/7/15 4:13

  • pmhoran

  • Not too shy to talk

  • Posts: 115

  • Since: 2003/2/21


Thanks for the input LazyBadger ....

But ... I have been hunting for "XOOPS Tips" and maybe I am an idiot but I can't find it. Can you provide me with a link to it>?

I will check out the UserVisit module. Small membership so hopefully it will tell me if the same person is logged in at the same time from 2 different IP's (????)

Thanks
Peter
4
Chappy
Re: How do I - Stop search engine crawlers & login sharing

  • 2005/7/15 5:07

  • Chappy

  • Friend of XOOPS

  • Posts: 456

  • Since: 2002/12/14


Hope someone other than LazyBadger can help?

Here's the link: http://xoops-tips.com/

A very nice site, BTW!
MMM...It tastes like chicken! ...
5
pmhoran
Re: How do I - Stop search engine crawlers & login sharing

  • 2005/7/15 9:55

  • pmhoran

  • Not too shy to talk

  • Posts: 115

  • Since: 2003/2/21


Hi Chappy ...

Yup ... I am an idiot. I thought XOOPS Tips was on XOOPS.org. Didn't even think it might be a different site. Thanks for the link.

And YES ... if anyone has any further suggestions or input ... I would be very appreciative if you shared them

Not sure who the "very nice site" was directed at ... but if it was me & my FM & Personal Site ... THANKS. But I owe it all to XOOPS, libervis.com (for the theme) and a talented friend for the logo Oh and GIJOE at http://www.peak.ne.jp/xoops/ for some of his modules. I just stuck in some words

Take care
Peter
6
pmhoran
Re: How do I - Stop search engine crawlers & login sharing

  • 2005/7/22 10:18

  • pmhoran

  • Not too shy to talk

  • Posts: 115

  • Since: 2003/2/21


Thanks again Lazybadger & Chappy ...

I followed the suggestion I found at
http://xoops-tips.com/news-article.storyid-85.htm
and used "zlib_compression" commands in the .htaccess file instead of gzip.

Seems to have done the job with the spiders & crawlers ... at least no more have shown up.

The UserStats helps solve the "2 people using the same login problem" ... sort of. At least I can now tell if 2 people are using the same login at the same time

But ... I am still hoping someone might have another idea on how I might somehow restrict someone's login info being used only by the person I assign it to.

Thanks much
Peter
7
LazyBadger
Re: How do I - Stop search engine crawlers & login sharing

Just one additional level of defence, not 100%
If:
- your server is Apache
- you have rights to modify httpd.conf (or ask do it for you)
- you can create and maintain own private Certificate Authority

(I doesn't say "all will be easy")

you can implement certificate-based client authentication, see details (for example) here. Just to note - it doesn't prevent your users from exporting own certificate and transferring to another person, but... not every ordinary user will be able to do it

BTW - I had own CA and can issue certs for your users
Quis custodiet ipsos custodes?

Webmaster of
XOOPS2.RU
XOOPS Modules Proving Ground
XOOPS Themes Exhibition

Login

Register now!  |  Lost Password?

Search

Advanced Search

Recent Posts

Who's Online

257 user(s) are online (53 user(s) are browsing Support Forums)

Members: 0

Guests: 257

more...

Donat-O-Meter

Stats
Goal: $100.00
Due Date: Nov 30
Gross Amount: $0.00
Net Balance: $0.00
Left to go: $100.00
Make donations with PayPal!

Latest GitHub Commits