Depending on your joomla config, this could be:
1) your browser cache
2) your joomla cache, or
3) your web server cache
That's why you are still seeing the old page even though you have changed the tag (remember this is a plugin so the page url remains the same.)
Try to clear (1), (2) and (3) above and see if the page will refresh.