Serving 2988 extensions to the community
Categories
Directory Menu
Login or Register
JCrawler 
Version
1.7 Beta (last update on Apr 21, 2009)
Rating
Compatibility
Votes
48
Favoured
68
License
GPL
Non-Commercial
Type
Views
35124
Date Added
13 July 2008
Features:
- sitemap generation on the fly, no additional plugins needed
- submit sitemap to 5 searchengines (google, yahoo, msn, ask.com, moreover)
- Automatic priority calculation based on internal PageRank (experimental)
- shows bad links, or not crawlable sites
- with curl: max 250 parallel connections to spider urls (configurable)
- exclude list
- modification of robots.txt with the location of the sitemap
- crawling with curl of fopen
- saves config in a xml-file
Note:
- fopen or Curl is required to crawl the site
Now Beta 1.7 is out!
Changes:
- Automatic priority calculation based on internal PageRank (experimental)
- Performance and compatibility improvments
- Submission to search engines via curl
- fixed empty loc-tag problem
- improved link detection
byrodrigojmz on June 17, 2009
No further words needed before the title.
Made my sitemap in few secconds, much better than the most used tools arround the web.
Congratulations.
Made my sitemap in few secconds, much better than the most used tools arround the web.
Congratulations.
byguysmiley on June 6, 2009
I recently tried this on my site of 1500+ links and had no issues whatsoever.
Note: It did take about 5 minutes to crawl my whole site (as I held my breath). But, 5 minutes later, I was a happy camper.
Thanks for a great addition!
Note: It did take about 5 minutes to crawl my whole site (as I held my breath). But, 5 minutes later, I was a happy camper.
Thanks for a great addition!
Engines couldn't find my website, but thanks to this component this problem is now solved. Even the Beta worked fast and made the job easy. Thank you!
byVampy on May 20, 2009
This seems like a very useful extension. I have only one problem / question.
Is it normal for my sitemap.xml to have just 7-8 URLs ? I mean, I have a lot of articles on my website but only a few URLs.
Is it normal for my sitemap.xml to have just 7-8 URLs ? I mean, I have a lot of articles on my website but only a few URLs.
bymmyhre on May 14, 2009
Since i am not on php4 i cannot say an opinion on that, but i am on PHP5, and what is confusing is that it installs fine, and also it crawls and says everything is a sucsess.
Of course the sitemap.xml file that is generated is very empty though.
Hope it will work with PHP, because this is what i am looking for.
Morten
Of course the sitemap.xml file that is generated is very empty though.
Hope it will work with PHP, because this is what i am looking for.
Morten
Owner's reply
Hey Morten, thx for your review.
Unfortunatly has JCrawler in version 1.7 a problem with relative links. So thats why your sitemap is empty. It will be fixed in version 1.8
Greets Patrick
byiNFERNO on April 7, 2009
Nice component! Unfortunately it does not works for me with PHP5 enabled. But if I disable and switch back to PHP4.x, the sitemap generation works like a charm!
Owner's reply
Thank you! The next version will be more compatible with different PHP versions/configurations.
byalsage13 on March 27, 2009
This is a great component that saved me so much time! From install to submission to the search engines it took 5 minutes. I'm so glad I found this component before I created my own site map by hand. Thank you!!!
bytomrocks on March 8, 2009
Installed fine and seemed to work great. However after submit to Google, the crawl produced 404 error on EVERY link. I looked at the crawl report and what Google saw was different than the xml I viewed. Each link had a menu title with Upper case letters which produced a 404 error. 77 links submitted 77 404 errors. Not sure about this bug. When I view my sitemap at everything looks ok, at Google, it's different. Went back to JMSitemap.
Owner's reply
thank you for your review, you're the first with this issue. i found the bug and it will be fixed for release 1.7 greets Patrick
byCrucialClick on March 4, 2009
Does exactly what it should do. Great job and thanks!
bysaadi78 on January 19, 2009
Does exactly what is says, easy to install easy to use, and submits to top five search engines at the click of a button. What more could you want!
byPlatothefish on January 8, 2009
Awsome component. I am not a teccy and submitting site maps to the search engines I though was not going to be easy until I came across this. Fantastic - thanks. 1 button to press! how good is that?
byalfauser on December 21, 2008
Thank you for this component. I tested many sitemap generating applications for joomla. Yours helped me to make all that work with one button pressing, without needing to search documentation or help forums. It's time saving application.
bym107 on December 1, 2008
thank you
JCrawler do all you want for you site map.
i had problems with others but this one satisfied me.
thanks in advance
JCrawler do all you want for you site map.
i had problems with others but this one satisfied me.
thanks in advance
byZatriX on November 14, 2008
thanks for a much needed sitemap component. As intuitive as they get, yet very valuable.
Still have to see about them submissions, though ;-)
Still have to see about them submissions, though ;-)
byyandos on November 14, 2008
I really enjoyed using this component. it develops fast and might be the next generation in sitemap creation. no plugins. no fuss...
support is great, quick, personal and friendly.
the component is getting more and more functions all the time, and i hope it will keep getting better so fast.
support is great, quick, personal and friendly.
the component is getting more and more functions all the time, and i hope it will keep getting better so fast.
byrdayal on November 11, 2008
Tried a couple of sitemap generators, a few seemed to work but google subsequently complained about formats etc. JCRAWLER WORKED FIRST TIME. Google liked it, so I like it.
Very clean page with configurable options.
Top comp and thank you very much.
Very clean page with configurable options.
Top comp and thank you very much.
byToni Marie on November 9, 2008
Absolutely the easiest sitemap component I've ever used. The automatic submission to search engines is nice too, although time will tell how well that actually works.
byhiddink on October 14, 2008
Very good plugin, a must have in my opinion. Would be nice for future versions to give different priorities to sections or categories.
Owner's reply
yes, you're absolutly right. actually im developping an algorythm for finding the priorities.
bymustardstache on October 14, 2008
Easy install, does what it says. I was planning on spending all morning generating and submitting sitemaps to different places but with this tool I submitted to the top 5 in about 5 minutes.
Page 1 of 2