XOOPS 
Forum
Forum Index General Forums Community Support Modules Support Themes Support Development International Support Module Hack Reviews Theme Designer Talk
  1. Board index / 
  2. Xoops Development / 
  3. Xoops Bug Reports 
  4.  / Xoops problem to index search engine image
Register
1
mojtabajml
Xoops problem to index search engine image

  • 2014/2/18 12:23

  • mojtabajml

  • Just popping in

  • Posts: 67

  • Since: 2007/7/16


I installed fmcontent module for managing content on my site.I create fmcontent plugin in sitemap module and add xml_google.php address to google webmaster tools. after 2 weeks that google index my site I checked google webmaster for my website index status. all the content indexed by google but nothing of my image content indexed! after some search in google I change sitemap module and add image sitemap protocole to this module then test xml_google.php with google webmaster and I found the problem.
the problem is fmcontent and some other module save images content in uploads folder but in robot.txt uploads folder is introduce as a blocked url so Google or other search engines can not access to this folder that coused google warning like this :
Sitemap contains urls which are blocked by robots.txt.

Type = Warnings Url blocked by robots.txt.
Issues = Sitemap contains urls which are blocked by robots.txt.
Example = Value: http://mydolfin.ir/uploads/fmcontent/img/Vehicle-Weight-Sensor.jpg

2
Mamba
Re: Xoops problem to index search engine image

  • 2014/2/18 13:40

  • Mamba

  • Moderator

  • Posts: 11546

  • Since: 2004/4/23


Unfortunately, the fmContent module is not developed anymore by the author, so I would suggest to switch to Publisher.

If you want to fix fmContent, you can try to contact Voltan, as he is probably most familiar with the fmContent module.
Support XOOPS => DONATE
Use 2.7.x | Docs | Modules | Bugs
3
heyula
Re: Xoops problem to index search engine image

  • 2014/2/18 14:01

  • heyula

  • Theme Designer

  • Posts: 605

  • Since: 2008/4/24


Proposed Solution :

http://www.xoops-tr.com/modules/newbbex/viewtopic.php?topic_id=2055&forum=51
4
mojtabajml
Re: Xoops problem to index search engine image

  • 2014/2/18 14:12

  • mojtabajml

  • Just popping in

  • Posts: 67

  • Since: 2007/7/16


I can develop fmcontent it's a greate module for content manager and I don't have any problem with fmcontent. publisher have a same problem with image search!
I think that this issue is return to robot.txt! some module use uploads folder for saveing images but in robot.txt, uploads folder blocked for search engine access so this problem is public in all modules that use uploads folder such as publisher,news, fmcontent and ...
5
heyula
Re: Xoops problem to index search engine image

  • 2014/2/18 14:18

  • heyula

  • Theme Designer

  • Posts: 605

  • Since: 2008/4/24


Robot.txt

User-agent: Mediapartners-Google
Allow: /
User-agent: *
Disallow: /cgi-bin/
Disallow: /tmp/
Disallow: /cache/
Disallow: /class/
Disallow: /images/
Disallow: /include/
Disallow: /install/
Disallow: /kernel/
Disallow: /language/
Disallow: /templates_c/
Disallow: /themes/
Disallow: /uploads/
User-agent: Googlebot-Image
Allow: /uploads/

Example:
https://www.google.com.tr/search?q=site:mydolfin.ir&safe=off&source=lnms&tbm=isch&sa=X&ei=AGsDU6dlicyEB67RgTg&ved=0CAcQ_AUoAQ&biw=1920&bih=903

site:mydolfin.ir

3 İmages

Example:
https://www.google.com.tr/search?q=site:minecraftindir.info&safe=off&source=lnms&tbm=isch&sa=X&ei=y2sDU7CYDYKWhQeN1oDYAg&ved=0CAcQ_AUoAQ&biw=1920&bih=903

site:minecraftindir.info

6
mojtabajml
Re: Xoops problem to index search engine image

  • 2014/2/18 16:04

  • mojtabajml

  • Just popping in

  • Posts: 67

  • Since: 2007/7/16


Thanks heyula, I change the robot.txt and waitaing for google to crawl my site images.

I think it's necessary to change robot.txt in xoops core.
7
sova
Re: Xoops problem to index search engine image

  • 2014/2/19 4:15

  • sova

  • Not too shy to talk

  • Posts: 149

  • Since: 2010/4/13


@mojtabajml
Do you want to develop this module?
https://github.com/faragostaresh/xoops-news
Nice module, and will be better

Apparently the author of this module for XOOPS community's lack of attention, intention does not support

==================
Excuse me.
I can not speak English well
8
Mamba
Re: Xoops problem to index search engine image

  • 2014/2/19 8:37

  • Mamba

  • Moderator

  • Posts: 11546

  • Since: 2004/4/23


Quote:
Apparently the author of this module for XOOPS community's lack of attention, intention does not support
There was always interest, but the community recommended to change the name of the module to something different, because we already have a module called "news" and having another with the same name would only cause more confusion, as it happened on couple of occasions with other developers (see this thread)
Support XOOPS => DONATE
Use 2.7.x | Docs | Modules | Bugs
9
mojtabajml
Re: Xoops problem to index search engine image

  • 2014/2/21 13:14

  • mojtabajml

  • Just popping in

  • Posts: 67

  • Since: 2007/7/16


heyula it seems robot.txt format is wrong. this is google webmaster analysis:

robots.txt analysis
Value     Result
Line 1: User - agent : Mediapartners - Google     Syntax not understood
Line 2: Allow : /     No user-agent specified
Line 3: User - agent : *     Syntax not understood
Line 4: Disallow : / cgi - bin /     No user-agent specified
Line 5: Disallow : / tmp /     No user-agent specified
Line 6: Disallow : / cache /     No user-agent specified
Line 7: Disallow : /class/     No user-agent specified
Line 8: Disallow : / images /     No user-agent specified
Line 9: Disallow : /include/     No user-agent specified
Line 10: Disallow : / install /     No user-agent specified
Line 11: Disallow : / kernel /     No user-agent specified
Line 12: Disallow : / language /     No user-agent specified
Line 13: Disallow : / templates_c /     No user-agent specified
Line 14: Disallow : / themes /     No user-agent specified
Line 15: Disallow : / uploads /     No user-agent specified
Line 16: User - agent : Googlebot - Image     Syntax not understood
Line 17: Allow : / uploads /     No user-agent specified

Login

Register now!  |  Lost Password?

Search

Advanced Search

Recent Posts

Donat-O-Meter

Stats
Goal: $15.00
Due Date: Sep 30
Gross Amount: $0.00
Net Balance: $0.00
Left to go: $15.00
Make donations with PayPal!