We are pleased to enable new crawling capabilities for the minerazzi web crawler:

04-29-11: Script tags detection capabilities added.
04-22-11: DocType, Base, and Link tags detection capabilities added.

If you are a Web developer, these new features of our crawler can help you to mine programming “gems” by examining, isolating, and collecting script lines that have been embedded in the source code of documents. And by crawling or accessing URLs of external files or link tags, programmers can view and dissect hidden scripts.

To learn more about these new features or previously added features, visit

http://www.minerazzi.com/labs/crawlinker.php

Advertisements