1
mojtabajml
Xoops problem to index search engine image
  • 2014/2/18 12:23

  • mojtabajml

  • Just popping in

  • Posts: 67

  • Since: 2007/7/16


I installed fmcontent module for managing content on my site.I create fmcontent plugin in sitemap module and add xml_google.php address to google webmaster tools. after 2 weeks that google index my site I checked google webmaster for my website index status. all the content indexed by google but nothing of my image content indexed! after some search in google I change sitemap module and add image sitemap protocole to this module then test xml_google.php with google webmaster and I found the problem.
the problem is fmcontent and some other module save images content in uploads folder but in robot.txt uploads folder is introduce as a blocked url so Google or other search engines can not access to this folder that coused google warning like this :
Sitemap contains urls which are blocked by robots.txt.

Type = Warnings Url blocked by robots.txt.
Issues = Sitemap contains urls which are blocked by robots.txt.
Example = Value: http://mydolfin.ir/uploads/fmcontent/img/Vehicle-Weight-Sensor.jpg


2
Mamba
Re: Xoops problem to index search engine image
  • 2014/2/18 13:40

  • Mamba

  • Moderator

  • Posts: 11409

  • Since: 2004/4/23


Unfortunately, the fmContent module is not developed anymore by the author, so I would suggest to switch to Publisher.

If you want to fix fmContent, you can try to contact Voltan, as he is probably most familiar with the fmContent module.
Support XOOPS => DONATE
Use 2.5.11 | Docs | Modules | Bugs

3
heyula
Re: Xoops problem to index search engine image
  • 2014/2/18 14:01

  • heyula

  • Theme Designer

  • Posts: 596

  • Since: 2008/4/24



4
mojtabajml
Re: Xoops problem to index search engine image
  • 2014/2/18 14:12

  • mojtabajml

  • Just popping in

  • Posts: 67

  • Since: 2007/7/16


I can develop fmcontent it's a greate module for content manager and I don't have any problem with fmcontent. publisher have a same problem with image search!
I think that this issue is return to robot.txt! some module use uploads folder for saveing images but in robot.txt, uploads folder blocked for search engine access so this problem is public in all modules that use uploads folder such as publisher,news, fmcontent and ...

5
heyula
Re: Xoops problem to index search engine image
  • 2014/2/18 14:18

  • heyula

  • Theme Designer

  • Posts: 596

  • Since: 2008/4/24


Robot.txt

User-agentMediapartners-Google
Allow
: /
User-agent: *
Disallow: /cgi-bin/
Disallow: /tmp/
Disallow: /cache/
Disallow: /class/
Disallow: /images/
Disallow: /include/
Disallow: /install/
Disallow: /kernel/
Disallow: /language/
Disallow: /templates_c/
Disallow: /themes/
Disallow: /uploads/
User-agentGooglebot-Image
Allow
: /uploads/


Example:
https://www.google.com.tr/search?q=site:mydolfin.ir&safe=off&source=lnms&tbm=isch&sa=X&ei=AGsDU6dlicyEB67RgTg&ved=0CAcQ_AUoAQ&biw=1920&bih=903

site:mydolfin.ir

3 İmages

Example:
https://www.google.com.tr/search?q=site:minecraftindir.info&safe=off&source=lnms&tbm=isch&sa=X&ei=y2sDU7CYDYKWhQeN1oDYAg&ved=0CAcQ_AUoAQ&biw=1920&bih=903

site:minecraftindir.info


6
mojtabajml
Re: Xoops problem to index search engine image
  • 2014/2/18 16:04

  • mojtabajml

  • Just popping in

  • Posts: 67

  • Since: 2007/7/16


Thanks heyula, I change the robot.txt and waitaing for google to crawl my site images.

I think it's necessary to change robot.txt in xoops core.

7
sova
Re: Xoops problem to index search engine image
  • 2014/2/19 4:15

  • sova

  • Not too shy to talk

  • Posts: 149

  • Since: 2010/4/13


@mojtabajml
Do you want to develop this module?
https://github.com/faragostaresh/xoops-news
Nice module, and will be better

Apparently the author of this module for XOOPS community's lack of attention, intention does not support

==================
Excuse me.
I can not speak English well

8
Mamba
Re: Xoops problem to index search engine image
  • 2014/2/19 8:37

  • Mamba

  • Moderator

  • Posts: 11409

  • Since: 2004/4/23


Quote:
Apparently the author of this module for XOOPS community's lack of attention, intention does not support

There was always interest, but the community recommended to change the name of the module to something different, because we already have a module called "news" and having another with the same name would only cause more confusion, as it happened on couple of occasions with other developers (see this thread)
Support XOOPS => DONATE
Use 2.5.11 | Docs | Modules | Bugs

9
mojtabajml
Re: Xoops problem to index search engine image
  • 2014/2/21 13:14

  • mojtabajml

  • Just popping in

  • Posts: 67

  • Since: 2007/7/16


heyula it seems robot.txt format is wrong. this is google webmaster analysis:

robots.txt analysis
Value     Result
Line 1
User agent Mediapartners Google     Syntax not understood
Line 2
Allow : /     No user-agent specified
Line 3
User agent : *     Syntax not understood
Line 4
Disallow : / cgi bin /     No user-agent specified
Line 5
Disallow : / tmp /     No user-agent specified
Line 6
Disallow : / cache /     No user-agent specified
Line 7
Disallow : /class/     No user-agent specified
Line 8
Disallow : / images /     No user-agent specified
Line 9
Disallow : /include/     No user-agent specified
Line 10
Disallow : / install /     No user-agent specified
Line 11
Disallow : / kernel /     No user-agent specified
Line 12
Disallow : / language /     No user-agent specified
Line 13
Disallow : / templates_c /     No user-agent specified
Line 14
Disallow : / themes /     No user-agent specified
Line 15
Disallow : / uploads /     No user-agent specified
Line 16
User agent Googlebot Image     Syntax not understood
Line 17
Allow : / uploads /     No user-agent specified

Login

Who's Online

418 user(s) are online (294 user(s) are browsing Support Forums)


Members: 0


Guests: 418


more...

Donat-O-Meter

Stats
Goal: $100.00
Due Date: Nov 30
Gross Amount: $0.00
Net Balance: $0.00
Left to go: $100.00
Make donations with PayPal!

Latest GitHub Commits