Hi All,

Updated SIOC RDF Crawler.

Added:
* reports User-Agent: when crawling
* can limit depth of crawling by the number of "jumps" from host to host

Found it more useful (and interesting) to limit the number of host
"jumps" as opposed to limiting just a number of page "jumps". Will add
limiting of page "jumps" later if necessary.

SIOC RDF Crawler 0.8:
http://sw.deri.org/svn/sw/2005/08/sioc/crawler/releases/crawler_v0.8.tar.gz

Uldis

[ http://captsolo.net/info/ ]

--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups "SIOC-Dev" group.
To post to this group, send email to sioc-dev@googlegroups.com
To unsubscribe from this group, send email to sioc-dev-unsubscribe@googlegroups.com
For more options, visit this group at http://groups.google.com/group/sioc-dev
-~----------~----~----~----~------~----~------~--~---