Welcome to the new directory. If you find a bug, please report it on our Issue Tracker.

Arrow up
Arrow down

Joomla! Extensions Directory

logo

Introduction

Site Map

JCrawler does the same as the Google crawler. It crawls your Joomla site and stores all the urls in a XML file without any plugins. After crawling you can ping Google, Ask.com and Bing.

  • Get this

Features:

  • sitemap generation on the fly, no additional plugins needed
  • submit sitemap to 4 searchengines (google, Bing, ask.com, moreover)
  • Automatic priority calculation based on internal PageRank (experimental)
  • shows bad links, or not crawlable sites
  • with curl: max 250 parallel connections to spider urls (configurable)
  • exclude list
  • modification of robots.txt with the location of the sitemap
  • crawling with curl of fopen
  • saves config in a xml-file

There is a new forum and a new dedicated page for JCrawler!

JCrawler is under redeveloppment to create with even more features.

Note:
- fopen or Curl is required to crawl the site


I love it


Posted on 19 October 2014

Works like a charm. It does what it needs to do and even with 100+ pages it crawls pretty fast. No problems sofar.


One of the best


Posted on 18 November 2013

It is very comfortable and adds all the URLs in a file sitemap.xml

You also have the option to create the robots.txt file


Simple and useful


Posted on 05 September 2013

It’s a very good and simple component, ideal for sites where contents don't change daily, automatically.

I tried Xmap before but it "looses" some pages even they are in the menu (to be xmapped, pages need a link on the menu; that's why I switched to JCrawler).

In the other hand, JCrawler has been discontinued, so if you need improvements or support, a bad thing. I understand developers, but it's a pity they decided not to continue or the fact that they don’t find collaboration.


Timeout 500


Posted on 13 August 2013

I have around 500 links on my page and it cannot crawl even with 250 parallel processes without timeout.


Useless


Posted on 20 April 2013

This component has a nice layout, and appears to be a very helpful resource to make sitemap generation and submission simple. My website, which consists of over two hundred pages, generated a single url using this tool. Sitemap submission failed for both Bing and ask.com. The documentation claims to submit sitemaps to "4 searchengines (google, Bing, ask.com, moreover)", yet it only attempted to submit the sitemap to three (google, Bing, and ask.com). I have uninstalled this extension and would not recommend it to anyone.


Great but small suggesting!


Posted on 08 February 2013

Would give five start but something didn't allow me. I have some links in the site which are not directly linked from front page but they are in the menu of back end. Even if I directly browse links they are running properly. Unline Xmap, JCrawler do not have menu selection option white making sitemap that disappointed. If there is option to select 'Menus" before making sitemap would be excellent.

Thanks!


Very Impressed


Posted on 22 January 2013

I used Xmap and it was only able to find 28 links on my site to put in the sitemap. It did it through the menu. I then tried some other fw-sitemap thing and it didn't even have an admin interface. Go figure.



JCrawler was perfect. It found 52 links, and made a nice XML file for me too! Simple and perfect. It makes me wonder how developers (others) can get simple use value so wrong.



Well done JCrawler!


Simple Sitemap


Posted on 01 January 2013

Very simple sitemap creator that worked prefect for my websites. Easy installation with no add-ons or fuzzy components. It does what it claims to do in a quick and simple manner.


Perfect


Posted on 01 December 2012

Excellent and useful component. It works without any problems or conflicts. After I discovered this component, I removed other sitemap component from all websites.

Enough said.


It's Amazing.


Posted on 20 November 2012

No more fretting over how to create a site map. Easy install and easy to use. Elegant! Installed in all my sites flawlessly. Showed me all my errors to fix, too! Many thanks.

JCrawler

Version:
1.13 Stable
Developer:
Patrick
Date added:
Jul 13 2008
License:
GPLv2 or later
Type:
Free download
Uses updater:
Includes:
Compatibility:
Download DemoNot available Support DocumentationNot available
  • Overall
  • Functionality

  • Ease of use

  • Documentation

  • Support