Unleashing a comprehensive news hub for beautiful Puerto Rico by providing free traffic to nearly 200 newsfeed sources, and counting.
Zillman’s 2019 Directory of Directories is a handy resource for those interested in finding specialized gateways to the Web.
Glad to know that this summer Minerazzi was included in the Academic/Education section.
Since 2018 we are listed in the Bot and Intelligent Agent Resources category and few other sections, but did not realize that in that one too.
A mnemonic for easily recalling the unicode entities of vowels with grave accents, acute accents, and circumflexes is available at
We developed the mnemonic after some work on mining the unicode system. It might come handy for those that need to encode said vowels without looking at reference books, tables,… It is also a great example for those teaching mnemonics.
For those interested, we have a tool for exploring unicode entities at
Update: I found a typo in the “o” lower case circumflex and also an error in the 194 entity. Fixed both. Sorry.
W3C Miner. http://minerazzi.com/w3c/
W3C public resources, news, standards, work groups, and more.
Use its news channel to easily access from a single place several rss news feeds relevant to World Wide Web Consortium.
Recrawl search results and build your own curated collection of resources.
Carcinomas Miner | Find resources relevant to the types of cancers known as carcinomas (http://www.minerazzi.com/carcinomas/).
Recrawl search results and build your own curated collection of resources. Use this miner to extract valuable front/back end data from relevant sites.
You may also use its rss news channels (http://www.minerazzi.com/carcinomas/spp.php) to find news from around the Web relevant to these and other types of cancers.
Researching the origins of so-called trusted publishers (https://www.theguardian.com/science/2017/jun/27/profitable-business-scientific-publishing-bad-for-science) helped me understand the
mentality behind alleged open access predatory journals & publishers which are beating them in their own game.
There is nothing new under the sun. It is all about the money (https://en.wikipedia.org/wiki/Robert_Maxwell). Time to build a miner on that.
The Chemistry Organizations Miner (http://www.minerazzi.com/chemorgs/) is our newest productivity-driven search engine.
This micro-index helps you find worldwide chemistry organizations, societies, industry groups, chemistry student organizations, and more.
Its news channels can help you search for research, articles, events, and other types of news relevant to chemistry.
Recrawl its search results and build your own curated collection of resources about chemistry organizations.
The figure was generated with our Chaos Game Explorer tool, using the algorithm described at
and as presented in Barnsley’s books (Fractals Everywhere, 1988; The Desktop Fractal Design HandBook, 1989).
The game was played N = 100,000 times by randomly placing a point within an n-gon (polygon with n vertices), using different combinations of vertices (n) and scale ratios (r), and by coloring in white the emerging patterns. Some combinations produce patterns somehow resembling ancient calendars, medallions, rings,… from different ancient cultures.
For the above figure, I used n = 12 and r = 0.30.
Running the algorithm by coding the pixels in different colors reveals that the patterns are just the result of partially overlapping the same n-gon across many scales of observations. Did ancient cultures know about this technique?
Just for fun, you may want to try with other values, then run searches in Google Images for ancient calendars, medallions, rings, etc and compare results. Share your images and let me know if you found something interesting. I’m documenting results.
ChemBios is our newest miner (http://www.minerazzi.com/chembios).
Find biographies of famous chemists from ancient to modern times, including all Chemistry Nobel Prize Laureates.
Build your own curated collection of chemist bios by recrawling this miner search result links. The miner also lets you build a collection driven by Wikipedia vast repository by recrawling links from said online encyclopedia.
The URL Cleaner (http://www.minerazzi.com/tools/url-cleaner/muc.php) is our most recent tool.
Clean URLs from search engine result pages and websites, including Google, Bing, Yahoo, Yandex, Wikipedia, and others.
- The Problem
Sometimes collection curators and content developers use web scrapers (Wikipedia, 2018a) to extract URLs from websites and search result pages.If a web scraper is not available or the target search engine reacts against the scraping (Wikipedia, 2018b), URL extraction can still be possible by installing a browser add-on like Copy Selected Links or a similar plugin. Once installed, users can right-click selected text and copy the URL of any links it contains. To copy all links from a page, they just need to press
Ctrl + Ato select the entire page text, right-click the selected text, and copy all available URLs at once.Regardless of how URLs are collected (with or without web scrapers), the end result might be a list of dirty, ugly records with obscure attribute-value pairs appended by the search engine.Sometimes the list of URLs include entries with:
- URLs pointing to social networks. These URLs are often viewed by collection curators as “plastic contamination” in search results suppose to be “organic”. Typical examples are results from Google and similar search engines.
- URLs about self-promotion. The same search engine might include URLs pointing to unrequested content like its own products, services, partners/ads, links to additional content, etc. Typical examples are results from Google and URLs extracted from Wikipedia webpages.
- URLs with special characters. For instance, those defining queries (?), fragment identifiers (#), and hash-bangs (#!), among others (Wikipedia, 2018c; 2018d).
- URLs with some characters encoded.
- 6-22-2018 Update: URLs obfuscated by shortening services: e.g., bit.ly, goo.gl, is.gd, t.co, and many more. Regardless of their merits, shortened URLs can open the door to all sort of problems (Wikipedia, 2018e). These are frequently viewed by collection curators as unnecessary noise.
- The Solution
Would it be nice to have a tool that lets users generate by default a list of clean, sorted, and deduplicated URLs, with options for selectively include/exclude some of the above contaminants? This is precisely what our Minerazzi URL Cleaner (MUC) does.
- Unlike other URL cleaners, MUC cleans multiple URLs at once from search engines and websites, and can be used free of charge. Before proceeding any further, lets explain what MUC is and is not. The tool is a data cleaner and a lightweight version of our popular Editor and Curator tool. It is not a web scraper, URL validator, or URL shortener resolver, but can be used to clean results from these.
- In the next section, we describe some uses for MUC, its features and limitations.
What is computed?
- Searches Support
MUC was designed to edit search results from the following.
- Google, Bing, Yahoo, Yandex, and DuckDuckGo
- 100searchengines, HotBot, Ask, and textise.net
- Google Scholar, and Wikipedia
The tool is compatible with individual sites and might be so with other search engines. Whenever possible, we are open to add support for other search engines as suggested by users.
- Editing Features
The tool implements the following edits by default.
- Social networks
URLs pointing to Linkedin, Facebook, Twitter, Myspace, Instagram, Pinterest, Snapchat, Youtube, Vimeo, and Tumblr are removed.
URLs about the supported search engines and pointing to their products, services, and partners/ads, or any additional content are removed.
- Special characters
Sections of a URL that start with ? # [ ] @ ! $ & ‘ ( ) * , ; = are removed. Trailing forward slashes (/) are also removed.
- Special strings
- Encoded characters
URL %-encoded characters are replaced by their unencoded versions.
- Shorteners (6-22-2018 Update)
URLs obfuscated by shortening services (nearly 600 of these services) are removed.
- One or more of the above edits can be disabled by properly checking the corresponding checkboxes.
Since these features are enabled by default, if a run produces no results it means that either all URLs are fully contaminated or there are no URLs to edit.
- Social networks
- First time users
We recommend first time users install the Copy Selected Links , or a similar add-on, before proceeding any further. Then do a search in Google and, with the add-on installed, clean URLs, first selectively and then at full blast, MUC.
- Tool limitations
Up to 5,000 URLs can be submitted at once. We arbitrarily imposed this limit to (a) provide fast responses, (b) minimize browser crashes, and (c) minimize abuses.
- Last but not least, the tool might fail to remove non English, obfuscated, or encrypted characters.