xoops forums

Forum Index


Board index » All Posts (wishcraft)




wishcraft

Module Developer
Posted on: 2008/1/1 10:25
wishcraft
wishcraft (Show more)
Module Developer
Posts: 3711
Since: 2007/5/18
#1331

Bot Sitemap vs Person Sitemap

Ok I noticed that some people have a HTML Clicky sitemap confused for a robot sitemap.. if you check www.sitemap.org it will give the specifications for this ISO Standardised document used by search engines.

I think that sitemap module is for a drill down for people to use, the sitemap I am talking about here it for googlebot and yahoo crawler etc, they read this file so they know what index they need to check next and keep records off it.. You may have noticed in google web master tools a function to add a sitemap or in yahoo siteexplorer.

These where invented to reduce crawl times, and do add to your SEO Score btw. You will notice sites with them get a higher ranking than sites without one.

There are alot of tools to build these as XML files for a static content site, but as XOOPS is a portal you will have to have a dynamic php file that set the header to an XML type.

Later Yall!!
Resized Image
www.ohloh.net/accounts/226400

Follow, Like & Read:-

twitter.com/SimonXaies
github.com/Chronolabs-Cooperative
facebook.com/SimonSXaies


wishcraft

Module Developer
Posted on: 2008/1/1 3:30
wishcraft
wishcraft (Show more)
Module Developer
Posts: 3711
Since: 2007/5/18
#1332

backend.php is good but what about a sitemap.php?

There is one feature that was recently added to search engines, that is a sitemap..

When you are implementing a sitemap they are an XML Document that tells search engine, when and where to scan/crawl on your site.

So far for all my site I have had to build a stand alone sitemap that is in php that does the site's content etc. It would be good if there was a controlling class in the module systems for this..

There are a couple of things you have to do to get a sitemap working properly..

First it has to have only existing URL's in it; you can see the full sitemap this is taken from at http://www.bee-unlimited.co.uk/sitemap.php

for example a section of this is like:

<urlset> <loc>http://www.bee-unlimited.co.uk/modules/content/?id=1</loc>
  
<lastmod>2008-01-01</lastmod>
  <
changefreq>monthly</changefreq>
  <
priority>1</priority>
  </
url>
<
url>
   <
loc>http://www.bee-unlimited.co.uk/modules/content/?id=2</loc>
   
<lastmod>2008-01-01</lastmod>
   <
changefreq>monthly</changefreq>
   <
priority>1</priority>
</
url>
</
urlset>


Loc: URL for crawling
lastmod: The last modification time
changefreq: Daily, Monthly, Yearly, Never - This is the frequency of change
Priority: 1 - 0.1 (1 being the highest).

For sitemap convention check www.sitemap.org, you will also have to change your robots.txt to add in the sitemap for search engines like MSN & Live which only automatically check for them

User-agent: *
Disallow: /cgi-bin/
Disallow: /tmp/
Disallow: /cache/
Disallow: /class/
Disallow: /images/
Disallow: /include/
Disallow: /install/
Disallow: /kernel/
Disallow: /language/
Disallow: /templates_c/
Disallow: /themes/
Disallow: /uploads/
Sitemap: /sitemap.php


Amicability most modules do not have a all this data, ie the content module, which has no date of creation.

The other change you may have to make is to common.php what I have done is made a database with robots crawler hostnames that allows for crawlers to access section anonymously but not the regular user.

This is a simple few lines of code around 20

and example bot checking tool would be:

function friendlybot(){
        global 
$xoopsDB;
        
$hostname gethostbyaddr($_SERVER['REMOTE_ADDR']);
        
$sql "SELECT bottype FROM ".$xoopsDB->prefix("bot");
        
$ret $xoopsDB->query($sql);
        
$state=false;
        while (
$row $xoopsDB->fetchArray($ret)){
            if (
strpos(" ".$hostname,$row['bottype'])>0){
                
$state=true;
            }
        }
        return 
$state;
    }


Where the change in common.php would be start at lines 336 and would be changed to something like this allowing for crawlers to crawl a page but the security still to be implemented.

if ($xoopsUser) {
            if (!
$moduleperm_handler->checkRight('module_read'$xoopsModule->getVar('mid'), $xoopsUser->getGroups())) {
                if (!
friendlybot()){
                    
redirect_header(XOOPS_URL."/user.php",1,_NOPERM);
                    exit();
                }
            }
            
$xoopsUserIsAdmin $xoopsUser->isAdmin($xoopsModule->getVar('mid'));
        } else {
            if (!
$moduleperm_handler->checkRight('module_read'$xoopsModule->getVar('mid'), XOOPS_GROUP_ANONYMOUS)) {
                if (!
friendlybot()){
                    
redirect_header(XOOPS_URL."/user.php",1,_NOPERM);
                    exit();
                }
            }
        }


Your bottype varchar (128) field would contain things like:

archive.org      
ask
.com          
crawl
.yahoo.net  
cs
.tamu.edu      
cuill
.com        
entireweb
.com    
googlebot
.com    
inktomisearch
.com
looksmart
.com    
msnbot
.msn.com   
picsearch
.com    
search
.live.com  
snarked
.org      
yahoo
.com        
blinklist
.com    
icio
.us          
digg
.com         
furl
.net         
simpy
.com        
spurl
.net        
img
.com          
facebook
.com


We need something like a globalism solution for site maps as it will ensure our websites are indexed correctly and quickly, I have index appear in google in a couple of hours with a sitemap rather than several days since i implemented this.

Sitemap.php looks like this at www.bee-unlimited.co.uk but you would have to customise this for most environment until some form of standardisation occurs in the XOOPS library.

<?php require("mainfile.php");

header('Content-type: text/xml');
$query[0] = "SELECT storyid from _beeu_content";
$query[1] = "SELECT storyid from _beeu_singleclip";
$query[2] = "SELECT storyid from _beeu_vjmixes";
$query[3] = "SELECT lid,cid,date from _beeu_myalbum_photos where status>0 order by date desc limit 5000";
$query[4] = "SELECT storyid,created from _beeu_stories order by created desc limit 5000";

global 
$xoopsDB;

$ret $xoopsDB->query($query[0]);
while (
$row $xoopsDB->fetchArray($ret)){
    
$url[] = array("loc" => XOOPS_URL.'/modules/content/?id='.$row['storyid'],
                   
"lastmod" => date('Y-m-d',time()),
                   
"changefreq" => "monthly",
                   
"priority" => "1");
}

$ret $xoopsDB->query($query[1]);
while (
$row $xoopsDB->fetchArray($ret)){
    
$url[] = array("loc" => XOOPS_URL.'/modules/singleclip/?id='.$row['storyid'],
                   
"lastmod" => date('Y-m-d',time()),
                   
"changefreq" => "monthly",
                   
"priority" => "1");
}

$ret $xoopsDB->query($query[2]);
while (
$row $xoopsDB->fetchArray($ret)){
    
$url[] = array("loc" => XOOPS_URL.'/modules/vjmixes/?id='.$row['storyid'],
                   
"lastmod" => date('Y-m-d',time()),
                   
"changefreq" => "monthly",
                   
"priority" => "1");
}

$ret $xoopsDB->query($query[3]);
while (
$row $xoopsDB->fetchArray($ret)){
    
$url[] = array("loc" => XOOPS_URL.'/modules/myalbum/photo.php?lid='.$row['lid']."&amp;".'cid='.$row['cid'],
                   
"lastmod" => date('Y-m-d',$row['date']),
                   
"changefreq" => "monthly",
                   
"priority" => "1");
}

$ret $xoopsDB->query($query[4]);
while (
$row $xoopsDB->fetchArray($ret)){
    
$url[] = array("loc" => XOOPS_URL.'/modules/news/article.php?storyid='.$row['storyid'],
                   
"lastmod" => date('Y-m-d',$row['date']),
                   
"changefreq" => "monthly",
                   
"priority" => "1");
}

?>
<? 
echo "<?xml version="1.0" encoding="UTF-8"?>n"?>
  <urlset xmlns="http://www.google.com/schemas/sitemap/0.84">

  <?php
   
     
for($f=0;$f<count($url);$f++){
    
?>
   <url>
    <loc><? echo $url[$f]['loc'];?></loc>
    <lastmod><? echo $url[$f]['lastmod'];?></lastmod>
    <changefreq><? echo $url[$f]['changefreq'];?></changefreq>
    <priority><? echo $url[$f]['priority'];?></priority>
   </url>
    <?php
    
?>
  </urlset>
Resized Image
www.ohloh.net/accounts/226400

Follow, Like & Read:-

twitter.com/SimonXaies
github.com/Chronolabs-Cooperative
facebook.com/SimonSXaies


wishcraft

Module Developer
Posted on: 2007/12/26 1:21
wishcraft
wishcraft (Show more)
Module Developer
Posts: 3711
Since: 2007/5/18
#1333

Re: Antibot Signup Security Patch - V1.04

Yeah Jimmy it would be... You will have to edit register.php to do this, but I would suggest leaving it in the first part of the form, as this is the part attacked by robots, see if you put it at the finish button, it would make the sign up process, 2 steps of data entry... Most people find signing up to a site, annoying, but none the less, I would advise you to leave your form protected rather than the second step as it has put the data, i believe in the database at this point (but don't quote me on this).

Personally i will not do this in the version release I have done, but I am sure you would be able to do this, it is a simple modification to the script...

Later buddy!!
Resized Image
www.ohloh.net/accounts/226400

Follow, Like & Read:-

twitter.com/SimonXaies
github.com/Chronolabs-Cooperative
facebook.com/SimonSXaies


wishcraft

Module Developer
Posted on: 2007/12/25 22:56
wishcraft
wishcraft (Show more)
Module Developer
Posts: 3711
Since: 2007/5/18
#1334

Re: MakePayment Module v0.62

If you want to sign up for intabill use this link, I will lower your percentile rate - https://join.intagate.com/join.php?typ ... f2-102a-ba7a-00188b306089
Resized Image
www.ohloh.net/accounts/226400

Follow, Like & Read:-

twitter.com/SimonXaies
github.com/Chronolabs-Cooperative
facebook.com/SimonSXaies


wishcraft

Module Developer
Posted on: 2007/12/25 22:05
wishcraft
wishcraft (Show more)
Module Developer
Posts: 3711
Since: 2007/5/18
#1335

Antibot Signup Security Patch - V1.04

Well my apologies to the 45 people that have downloaded version 1.02, this contained a couple of bugs, namely the fonts library was missing and their is a setting on some servers that involved the replacement of $_SERVER["DOCUMENT_ROOT"] with XOOPS_ROOT_PATH as not all PHP servers have this server setting propagated.

I have updated the mirror download but the sourceforge path is not updated. If you want to use this version it should work fine, I got the copy of my mum's ministry site www.destinybreakers.com.au; if you want to have a look at this in action you can simply see it on any site I have made like http://www.bee-unlimited.co.uk/register.php

To download it goto the mirror from here https://xoops.org/modules/repository/singlefile.php?cid=43&lid=1674

Later yall!
Resized Image
www.ohloh.net/accounts/226400

Follow, Like & Read:-

twitter.com/SimonXaies
github.com/Chronolabs-Cooperative
facebook.com/SimonSXaies


wishcraft

Module Developer
Posted on: 2007/12/12 11:12
wishcraft
wishcraft (Show more)
Module Developer
Posts: 3711
Since: 2007/5/18
#1336

MakePayment Module v1.03

Well thats it for the moment, I have edited it upto v1.03 which include ability for Admins to process refunds, i would suggest you use it from the mirror as the source forge links has not been updated yet.

Quote:
by jimmyx on 2007/12/12 4:56:07

thank you ...this is a great module...a must feature with XOOPS e commerce site

go & add it at xoopsaddons.org


I have also added it to www.xoopsadons.org for that user that wanted me to add it.

It is also available from the source forge repository.
Resized Image
www.ohloh.net/accounts/226400

Follow, Like & Read:-

twitter.com/SimonXaies
github.com/Chronolabs-Cooperative
facebook.com/SimonSXaies


wishcraft

Module Developer
Posted on: 2007/12/11 23:53
wishcraft
wishcraft (Show more)
Module Developer
Posts: 3711
Since: 2007/5/18
#1337

Re: MakePayment Module v0.62

Umm no I am a reseller I set my own rates as far as I am informed, that why I was suggesting if you set up an interbill account I can lower the percentile for you, if you go directly then yes thats what you will be charged.

Most resellers charge around $200 AUD to be set up as there is fee's around there a few of these in Australia. But you know we are a community so unless your a #OOPS# I won't charge you anything for me talking to intabill and arranging an account for you.

But if you want set up an account online and just tell them that you want to be put in 'Simon Roberts' Reseller group on the application, I will lower the percentile on my console I have access to.

Sorry worked called today otherwise I would be fixing up the admin, more VB6 Version 1.03 will be out by the end of next week.

Later yal
Resized Image
www.ohloh.net/accounts/226400

Follow, Like & Read:-

twitter.com/SimonXaies
github.com/Chronolabs-Cooperative
facebook.com/SimonSXaies


wishcraft

Module Developer
Posted on: 2007/12/11 9:32
wishcraft
wishcraft (Show more)
Module Developer
Posts: 3711
Since: 2007/5/18
#1338

MakePayment Module v0.62

Module: Send Money
Merchant: Intabill
Version: 0.62
Author: Simon Roberts (simon@shower.geek.au)
Compatible: All Versions
SourceForge: http://sourceforge.net/projects/xoopsmakepaymen/
Download URL: http://bin.chronolabs.org.au/makepayment.zip

This is the first version released for makepayment for XOOPS for handling a payment via the credit cards available with Intabill, you will need to fill out the merchant application contract forms, scan them and email them back to me for me to set up a merchant account with intabill for you. My rates start at 3.5% upto around 10% for adult services like escorting.


This module utilizes a GPL Soap class library called nuSoap
to do the echeck or credit card transactions; with an
intabill merchant account you have your own test credit and
echeck numbers. We will be writing the refund module for
xoops soon, but for the moment this can be handled through
the intabill terminal.

If you want to contact intabill directly, you will need to quote my author name for speedy result as it is listed as a reseller there, intabill details are found at www.intabill.com an email for the implementation officer there is Matt Maxwell [matt@intabill.com].

Key Features: No more redirections | Bill from within your XOOPS portal | source forge Repository | 24Hr Support from intabill.com

System Requirements: Merchant ID from Intabill | ECH Approval and Application to Intabill

I will be writting this out to the final release there is a little bit more to do on the admin menu but this is the first payment module for xoops, that allows you to directly bill credit cards in XOOPS rather than having to use something like paypal.
Resized Image
www.ohloh.net/accounts/226400

Follow, Like & Read:-

twitter.com/SimonXaies
github.com/Chronolabs-Cooperative
facebook.com/SimonSXaies


wishcraft

Module Developer
Posted on: 2007/10/29 1:19
wishcraft
wishcraft (Show more)
Module Developer
Posts: 3711
Since: 2007/5/18
#1339

Re: Xoops MultiSite beta Release

Hmm I have built a multisite out of XOOPS I started with version 2.0.13 now running 2.0.16, I don't think you need to make a version like this as any programmer who wants a multiple site will probably get themselves blacklisted if they list the same content on each site by the search engines if they are displaying the same content.. They have to know what they are doing,,

But my multiple site is an Adult Classified Network, I have modified the core of XOOPS to handle by and area control table that control listing types by domains so none of my sites have the same content on them... It was still blacklisted by msn but runs fine on google, yahoo, voyager etc.

The URL's if you want to look at it are:

www.australian-escort-lounge.info
www.europe-escort-lounge.info
www.america-escort-lounge.info
www.asia-escort-lounge.info
www.newzealand-escort-lounge.info
www.french-escort-lounge.info
www.british-escort-lounge.info
www.sydney-escort-lounge.info
www.brisbane-escort-lounge.info
www.goldcoast-escort-lounge.info
www.newcastle-escort-lounge.info
www.perth-escort-lounge.info
www.melbourne-escort-lounge.info
www.adelaide-escort-lounge.info
www.darwin-escort-lounge.info
www.canberra-escort-lounge.info

Currently the australian side of the domains get around 400 people a day on adverage peaking at 700 a day.. It is ok but I want to sell it as I don't have enought time to propogate the listings.

Later
Resized Image
www.ohloh.net/accounts/226400

Follow, Like & Read:-

twitter.com/SimonXaies
github.com/Chronolabs-Cooperative
facebook.com/SimonSXaies


wishcraft

Module Developer
Posted on: 2007/10/26 12:19
wishcraft
wishcraft (Show more)
Module Developer
Posts: 3711
Since: 2007/5/18
#1340

Anti Bot Hack - Captcha

I wrote to phppp, to see if I can get this written in, it is an antibot hack for the registration process, make sure you put it in the right paths and chmod the one directory in uploads you need.

I have a fully working none beta validation patch for XOOPS 2.0.16, I went to email it around but I notices there have been a few spammers??

You can download it at http://www.chronolabs.org.au/bin/xoopsAntiBotSignup.zip I was hoping you could add it to the security modules section of the site, as I found when advertising XOOPS on a large system it gets alot of robots signing up.. well at least here in the australian sites.

Hope you like it!! Requires the GD2 Library to be enabled to generate the turing key.

Thanks
Resized Image
www.ohloh.net/accounts/226400

Follow, Like & Read:-

twitter.com/SimonXaies
github.com/Chronolabs-Cooperative
facebook.com/SimonSXaies



TopTop
« 1 ... 131 132 133 (134) 135 »