xoops forums

mojtabajml

Just popping in
Posted on: 2014/2/18 12:23
mojtabajml
mojtabajml (Show more)
Just popping in
Posts: 67
Since: 2007/7/16
#1

Xoops problem to index search engine image

I installed fmcontent module for managing content on my site.I create fmcontent plugin in sitemap module and add xml_google.php address to google webmaster tools. after 2 weeks that google index my site I checked google webmaster for my website index status. all the content indexed by google but nothing of my image content indexed! after some search in google I change sitemap module and add image sitemap protocole to this module then test xml_google.php with google webmaster and I found the problem.
the problem is fmcontent and some other module save images content in uploads folder but in robot.txt uploads folder is introduce as a blocked url so Google or other search engines can not access to this folder that coused google warning like this :
Sitemap contains urls which are blocked by robots.txt.

Type = Warnings Url blocked by robots.txt.
Issues = Sitemap contains urls which are blocked by robots.txt.
Example = Value: http://mydolfin.ir/uploads/fmcontent/img/Vehicle-Weight-Sensor.jpg

Mamba

Moderator
Posted on: 2014/2/18 13:40
Mamba
Mamba (Show more)
Moderator
Posts: 10792
Since: 2004/4/23
#2

Re: Xoops problem to index search engine image

Unfortunately, the fmContent module is not developed anymore by the author, so I would suggest to switch to Publisher.

If you want to fix fmContent, you can try to contact Voltan, as he is probably most familiar with the fmContent module.
Support XOOPS => DONATE
Use 2.5.10 | Docs | Modules | Bugs

heyula

Theme Designer
Posted on: 2014/2/18 14:01
heyula
heyula (Show more)
Theme Designer
Posts: 467
Since: 2008/4/24
#3

Re: Xoops problem to index search engine image

Proposed Solution :

http://www.xoops-tr.com/modules/newbb ... hp?topic_id=2055&forum=51

mojtabajml

Just popping in
Posted on: 2014/2/18 14:12
mojtabajml
mojtabajml (Show more)
Just popping in
Posts: 67
Since: 2007/7/16
#4

Re: Xoops problem to index search engine image

I can develop fmcontent it's a greate module for content manager and I don't have any problem with fmcontent. publisher have a same problem with image search!
I think that this issue is return to robot.txt! some module use uploads folder for saveing images but in robot.txt, uploads folder blocked for search engine access so this problem is public in all modules that use uploads folder such as publisher,news, fmcontent and ...

heyula

Theme Designer
Posted on: 2014/2/18 14:18
heyula
heyula (Show more)
Theme Designer
Posts: 467
Since: 2008/4/24
#5

Re: Xoops problem to index search engine image

Robot.txt

User-agentMediapartners-Google
Allow
: /
User-agent: *
Disallow: /cgi-bin/
Disallow: /tmp/
Disallow: /cache/
Disallow: /class/
Disallow: /images/
Disallow: /include/
Disallow: /install/
Disallow: /kernel/
Disallow: /language/
Disallow: /templates_c/
Disallow: /themes/
Disallow: /uploads/
User-agentGooglebot-Image
Allow
: /uploads/


Example:
https://www.google.com.tr/search?q=sit ... cQ_AUoAQ&biw=1920&bih=903

site:mydolfin.ir

3 ─░mages

Example:
https://www.google.com.tr/search?q=sit ... cQ_AUoAQ&biw=1920&bih=903

site:minecraftindir.info

mojtabajml

Just popping in
Posted on: 2014/2/18 16:04
mojtabajml
mojtabajml (Show more)
Just popping in
Posts: 67
Since: 2007/7/16
#6

Re: Xoops problem to index search engine image

Thanks heyula, I change the robot.txt and waitaing for google to crawl my site images.

I think it's necessary to change robot.txt in xoops core.

sova

Not too shy to talk
Posted on: 2014/2/19 4:15
sova
sova (Show more)
Not too shy to talk
Posts: 149
Since: 2010/4/13
#7

Re: Xoops problem to index search engine image

@mojtabajml
Do you want to develop this module?
https://github.com/faragostaresh/xoops-news
Nice module, and will be better

Apparently the author of this module for XOOPS community's lack of attention, intention does not support

==================
Excuse me.
I can not speak English well

Mamba

Moderator
Posted on: 2014/2/19 8:37
Mamba
Mamba (Show more)
Moderator
Posts: 10792
Since: 2004/4/23
#8

Re: Xoops problem to index search engine image

Quote:
Apparently the author of this module for XOOPS community's lack of attention, intention does not support

There was always interest, but the community recommended to change the name of the module to something different, because we already have a module called "news" and having another with the same name would only cause more confusion, as it happened on couple of occasions with other developers (see this thread)
Support XOOPS => DONATE
Use 2.5.10 | Docs | Modules | Bugs

mojtabajml

Just popping in
Posted on: 2014/2/21 13:14
mojtabajml
mojtabajml (Show more)
Just popping in
Posts: 67
Since: 2007/7/16
#9

Re: Xoops problem to index search engine image

heyula it seems robot.txt format is wrong. this is google webmaster analysis:

robots.txt analysis
Value     Result
Line 1
User agent Mediapartners Google     Syntax not understood
Line 2
Allow : /     No user-agent specified
Line 3
User agent : *     Syntax not understood
Line 4
Disallow : / cgi bin /     No user-agent specified
Line 5
Disallow : / tmp /     No user-agent specified
Line 6
Disallow : / cache /     No user-agent specified
Line 7
Disallow : /class/     No user-agent specified
Line 8
Disallow : / images /     No user-agent specified
Line 9
Disallow : /include/     No user-agent specified
Line 10
Disallow : / install /     No user-agent specified
Line 11
Disallow : / kernel /     No user-agent specified
Line 12
Disallow : / language /     No user-agent specified
Line 13
Disallow : / templates_c /     No user-agent specified
Line 14
Disallow : / themes /     No user-agent specified
Line 15
Disallow : / uploads /     No user-agent specified
Line 16
User agent Googlebot Image     Syntax not understood
Line 17
Allow : / uploads /     No user-agent specified