Xoops problem to index search engine image [Xoops Bug Reports]

1

Xoops problem to index search engine image

2014/2/18 12:23
mojtabajml
Just popping in
Posts: 67
Since: 2007/7/16

I installed fmcontent module for managing content on my site.I create fmcontent plugin in sitemap module and add xml_google.php address to google webmaster tools. after 2 weeks that google index my site I checked google webmaster for my website index status. all the content indexed by google but nothing of my image content indexed! after some search in google I change sitemap module and add image sitemap protocole to this module then test xml_google.php with google webmaster and I found the problem.
the problem is fmcontent and some other module save images content in uploads folder but in robot.txt uploads folder is introduce as a blocked url so Google or other search engines can not access to this folder that coused google warning like this :
Sitemap contains urls which are blocked by robots.txt.

Type = Warnings Url blocked by robots.txt.
Issues = Sitemap contains urls which are blocked by robots.txt.
Example = Value: http://mydolfin.ir/uploads/fmcontent/img/Vehicle-Weight-Sensor.jpg

2

Re: Xoops problem to index search engine image

2014/2/18 13:40
Mamba
Moderator
Posts: 11409
Since: 2004/4/23

Unfortunately, the fmContent module is not developed anymore by the author, so I would suggest to switch to Publisher.

If you want to fix fmContent, you can try to contact Voltan, as he is probably most familiar with the fmContent module.

Support XOOPS => DONATE
Use 2.5.11 | Docs | Modules | Bugs

3

Re: Xoops problem to index search engine image

2014/2/18 14:01
heyula
Theme Designer
Posts: 596
Since: 2008/4/24

Proposed Solution :

http://www.xoops-tr.com/modules/newbbex/viewtopic.php?topic_id=2055&forum=51

4

Re: Xoops problem to index search engine image

2014/2/18 14:12
mojtabajml
Just popping in
Posts: 67
Since: 2007/7/16

I can develop fmcontent it's a greate module for content manager and I don't have any problem with fmcontent. publisher have a same problem with image search!
I think that this issue is return to robot.txt! some module use uploads folder for saveing images but in robot.txt, uploads folder blocked for search engine access so this problem is public in all modules that use uploads folder such as publisher,news, fmcontent and ...

5

Re: Xoops problem to index search engine image

2014/2/18 14:18
heyula
Theme Designer
Posts: 596
Since: 2008/4/24

Robot.txt

 User-agent: Mediapartners-Google 
Allow: / 
User-agent: * 
Disallow: /cgi-bin/ 
Disallow: /tmp/ 
Disallow: /cache/ 
Disallow: /class/ 
Disallow: /images/ 
Disallow: /include/ 
Disallow: /install/ 
Disallow: /kernel/ 
Disallow: /language/ 
Disallow: /templates_c/ 
Disallow: /themes/ 
Disallow: /uploads/ 
User-agent: Googlebot-Image 
Allow: /uploads/

Example:
https://www.google.com.tr/search?q=site:mydolfin.ir&safe=off&source=lnms&tbm=isch&sa=X&ei=AGsDU6dlicyEB67RgTg&ved=0CAcQ_AUoAQ&biw=1920&bih=903

site:mydolfin.ir

3 İmages

Example:
https://www.google.com.tr/search?q=site:minecraftindir.info&safe=off&source=lnms&tbm=isch&sa=X&ei=y2sDU7CYDYKWhQeN1oDYAg&ved=0CAcQ_AUoAQ&biw=1920&bih=903

site:minecraftindir.info

6

Re: Xoops problem to index search engine image

2014/2/18 16:04
mojtabajml
Just popping in
Posts: 67
Since: 2007/7/16

Thanks heyula, I change the robot.txt and waitaing for google to crawl my site images.

I think it's necessary to change robot.txt in xoops core.

7

Re: Xoops problem to index search engine image

2014/2/19 4:15
sova
Not too shy to talk
Posts: 149
Since: 2010/4/13

@mojtabajml
Do you want to develop this module?
https://github.com/faragostaresh/xoops-news
Nice module, and will be better

Apparently the author of this module for XOOPS community's lack of attention, intention does not support

==================
Excuse me.
I can not speak English well

8

Re: Xoops problem to index search engine image

2014/2/19 8:37
Mamba
Moderator
Posts: 11409
Since: 2004/4/23

Quote:

Apparently the author of this module for XOOPS community's lack of attention, intention does not support

There was always interest, but the community recommended to change the name of the module to something different, because we already have a module called "news" and having another with the same name would only cause more confusion, as it happened on couple of occasions with other developers (see this thread)

Support XOOPS => DONATE
Use 2.5.11 | Docs | Modules | Bugs

9

Re: Xoops problem to index search engine image

2014/2/21 13:14
mojtabajml
Just popping in
Posts: 67
Since: 2007/7/16

heyula it seems robot.txt format is wrong. this is google webmaster analysis:

 robots.txt analysis 
Value     Result 
Line 1: User - agent : Mediapartners - Google     Syntax not understood 
Line 2: Allow : /     No user-agent specified 
Line 3: User - agent : *     Syntax not understood 
Line 4: Disallow : / cgi - bin /     No user-agent specified 
Line 5: Disallow : / tmp /     No user-agent specified 
Line 6: Disallow : / cache /     No user-agent specified 
Line 7: Disallow : /class/     No user-agent specified 
Line 8: Disallow : / images /     No user-agent specified 
Line 9: Disallow : /include/     No user-agent specified 
Line 10: Disallow : / install /     No user-agent specified 
Line 11: Disallow : / kernel /     No user-agent specified 
Line 12: Disallow : / language /     No user-agent specified 
Line 13: Disallow : / templates_c /     No user-agent specified 
Line 14: Disallow : / themes /     No user-agent specified 
Line 15: Disallow : / uploads /     No user-agent specified 
Line 16: User - agent : Googlebot - Image     Syntax not understood 
Line 17: Allow : / uploads /     No user-agent specified

Stats
Goal:	$100.00
Due Date:	Nov 30
Gross Amount:	$0.00
Net Balance:	$0.00
Left to go:	$100.00

Xoops problem to index search engine image

Re: Xoops problem to index search engine image

Re: Xoops problem to index search engine image

Re: Xoops problem to index search engine image

Re: Xoops problem to index search engine image

Re: Xoops problem to index search engine image

Re: Xoops problem to index search engine image

Re: Xoops problem to index search engine image

Re: Xoops problem to index search engine image

Login

Search

Recent Posts

XOOPS MyMenus 1.54.0 Beta 10

Re: XOOPS MyMenus 1.54.0 Beta 7

Re: XOOPS MyMenus 1.54.0 Beta 7

Re: XOOPS MyMenus 1.54.0 Beta 7

Re: XOOPS MyMenus 1.54.0 Beta 7

Re: XOOPS MyMenus 1.54.0 Beta 7

Re: XOOPS MyMenus 1.54.0 Beta 7

Re: XOOPS MyMenus 1.54.0 Beta 7

Re: XOOPS MyMenus 1.54.0 Beta 7

Re: XOOPS MyMenus 1.54.0 Beta 7

Who's Online

Donat-O-Meter

Latest GitHub Commits

{{ record.sha.slice(0, 7) }} - {{ record.commit.message | truncate }}