I couldn't make it work so wanted to share my experience
First you need to make Joomla core SEF work.
Just follow instructions
Then I renamed my .htaccess to .htacess.bak and Joomsef created it's own htacess. And suddnly it all works.
Thanks a lot for such handy tool