JCrawler
Version
1.11 Stable (last update on Jan 29, 2012)
Rating
Compatibility
Votes
Favoured
117
License
GPLv2 or later
Non-Commercial
Type
Views
151771
Date Added
13 July 2008
Features:
- sitemap generation on the fly, no additional plugins needed
- submit sitemap to 5 searchengines (google, yahoo, msn, ask.com, moreover)
- Automatic priority calculation based on internal PageRank (experimental)
- shows bad links, or not crawlable sites
- with curl: max 250 parallel connections to spider urls (configurable)
- exclude list
- modification of robots.txt with the location of the sitemap
- crawling with curl of fopen
- saves config in a xml-file
There is a new forum and a new dedicated page for JCrawler!
JCrawler is under redeveloppment to create with even more features.
Note:
- fopen or Curl is required to crawl the site
Since i am not on php4 i cannot say an opinion on that, but i am on PHP5, and what is confusing is that it installs fine, and also it crawls and says everything is a sucsess.
Of course the sitemap.xml file that is generated is very empty though.
Hope it will work with PHP, because this is what i am looking for.
Morten
Of course the sitemap.xml file that is generated is very empty though.
Hope it will work with PHP, because this is what i am looking for.
Morten
Owner's reply
Hey Morten, thx for your review.
Unfortunatly has JCrawler in version 1.7 a problem with relative links. So thats why your sitemap is empty. It will be fixed in version 1.8
Greets Patrick
Installed fine and seemed to work great. However after submit to Google, the crawl produced 404 error on EVERY link. I looked at the crawl report and what Google saw was different than the xml I viewed. Each link had a menu title with Upper case letters which produced a 404 error. 77 links submitted 77 404 errors. Not sure about this bug. When I view my sitemap at everything looks ok, at Google, it's different. Went back to JMSitemap.
Owner's reply
thank you for your review, you're the first with this issue. i found the bug and it will be fixed for release 1.7 greets Patrick
Does exactly what it should do. Great job and thanks!
Awsome component. I am not a teccy and submitting site maps to the search engines I though was not going to be easy until I came across this. Fantastic - thanks. 1 button to press! how good is that?
I really enjoyed using this component. it develops fast and might be the next generation in sitemap creation. no plugins. no fuss...
support is great, quick, personal and friendly.
the component is getting more and more functions all the time, and i hope it will keep getting better so fast.
support is great, quick, personal and friendly.
the component is getting more and more functions all the time, and i hope it will keep getting better so fast.
Absolutely the easiest sitemap component I've ever used. The automatic submission to search engines is nice too, although time will tell how well that actually works.
Easy install, does what it says. I was planning on spending all morning generating and submitting sitemaps to different places but with this tool I submitted to the top 5 in about 5 minutes.
This works great. Easy as butter. I just ran into one glitch as one of my sites and I doubt it is related to the extension: In the Adapt to your site area my "HTTP host (readonly)" is coming up with a subdirectory that doesn't even exist, this is causing an error in the subsequent sitemap.xml file and errors within Google. Any ideas?
Excellent extension! Does exactly what it's supposed to do, dead-simple install, runs quickly, even submits the sitemap for you to google, yahoo, msn, and 2 others! It actually took me longer to get my account registered here to be able to write this review than it did to install and run the extension! Highly recommend!
Page 3 of 4