Here is a python-based search engine with an implementation inspired on one of our papers at the old Mi Islita.com site, now a search engine on Puerto Rico.
This module replicates the miislita vector spaces from
"A Linear Algebra Approach to the Vector Space Model -- A Fast Track Tutorial"
by Dr. E. Garcia...
Great and positive accomplishment!
That tutorial is no longer at miislita.com, but was long ago moved to minerazzi.com. Find it here:
For other resources do a search for python in our IR miner at
For inquiries about that implementation, contact its author.
For other inquiries, applications, suggestions, drop me a line.
PS. Please note that Nullege.com itself is a search engine for finding python code. Here is a good example: http://nullege.com/codes/search/wx.calendar.CalendarCtrl
The Open Source Projects (OSP) miner at
has been updated and reindexed. Additional records will be added soon.
The miner also features news results from Bing, Google, and other sites.
Use it to build your own curated collection of open software or to access latest news on open projects from around the world.
This is a new tool available at
If you are into chemical data mining, this post might interest you.
This new Minerazzi tool easily solves activity coefficient models for a missing term.
Thus the tool allows you to cross-map activity coefficients to ionic strengths and vice versa using the following models:
Debye-Hückel Limiting Law
Debye-Hückel Extended Limiting Law
The tool , written in PHP, was inspired in the WATEQF program originally written in FORTRAN (https://www.nrc.gov/docs/ML0331/ML033170395.pdf).
Recent versions of that program are available for download from the U.S. Geological Survey site at https://wwwbrr.cr.usgs.gov/projects/GWC_chemtherm/software.htm
Chemistry researchers, teachers and students can benefit from this tool, which is part of an ongoing effort of making available online scientific research tools across different disciplines.
04-05-2017 Update: Additional content and literature references added.
In a recent post,
we mentioned a design pattern for easily cross-mapping all experimental variables from a given model. By applying the pattern to the Nernst Equation, we were able to develop the Standard Electrode Potentials Calculator which cross-maps all 4 experimental terms from said equation. This tool is available at
In this post we just want to mention that by applying the same design pattern to the Goldman-Hodgkin-Katz (GHK) Equation we were able to develop the Membrane Potentials Calculator, which cross-maps 12 experimental terms. This new tool is available now at
Examples on how to do the mapping of variables are given in the Suggested Exercises section of the tool.
Overall, we are confident that the patterns used in the design of these tools can be applied, across disciplines, to mathematical models consisting of more experimental variables.
The Domain Extractor is a new Minerazzi tool, available now at
The tool extracts domains and subdomains from up to 10,000 URLs at once. Larger sets are resized to conform to this limit. This is done to avoid browser crashes.
From the input set, the Domain Extractor returns a set consisting of domains and subdomains. The results are deduplicated and sorted in alphabetical order
The tool comes handy when one wants to extract chunks consisting of 10,000 domains from databases or other sources.
It can be conveniently used in combinations of other of our tools, like
The FQU Bot
Simple, light, but a powerful toy/tool: The Domain Extractor can be used as part of a crawling strategy: Once domains and subdomains are extracted, the chunks of URLs can be sent to a queue for crawlers to revisit them.
Another application consists in querying a search engine, extract URLs from its results page and then process them through the tool.
There might be other applications, but the above can give you an idea of how handy the tool can be.
4D Printing Miner is a new Minerazzi miner available now at
Use it to find resources relevant to 4D Printing. As with all of our miners, you may use it to recrawl individual search results and build your own curated collections on this fascinating new disruptive technology.
Search Examples: Do a search with the miner for the following keywords: [ polymers ], [ printing materials ], and so forth.
Why a miner on 4D Printing?
Good question. Here is why: If you think that 3D printing is hot, think again because 4D Printing is here to rock the World!
4D Printing is right now revolutionizing many industries, fields, and disciplines: manufacturing, construction, medical research, biopharma, architecture, design, the arts, engineering, and computing, to mention a few.
What is 4D Printing?
4D Printing is one form of Programmable Matter (PM) technology. According to Wikipedia, the “programmable matter” term was coined in 1991 (1).
Skylar Tibbits, through his 2010 MS thesis “Logic Matter: digital logic as heuristics for physical self-guided assembly” (2), established the basis for a new technology: 4D Printing. Tibbits is a young Research Scientist, at MIT Department of Architecture and Director of the Self-Assembly Lab (3) at MIT. He is also credited of inventing the term “4D Printing”. I’m right now reading his fascinating thesis in pdf format. Simply awesome.
A light definition of 4D printing: Objects 3D-printed that evolve in time under environmental stimuli. In other words, 4D Printing is 3D printing with Time as the additional dimension.
So 4D-printed objects can evolve in time and change its molecular structures or mechanical, electrical, optical, or magnetic properties. All the changes are done without human intervention, but with environmental stimuli. Imagine building things that build themselves in the presence of a solvent (e.g, water), light, temperature changes, etc.
I guess you got the idea as to why, as this novel technology is impacting so many industries and sciences, MIT’s Self-Assembly Lab has the following partners and sponsors, among others:
and many more.
What is Self-Assembly?
Tibbits and co-workers define this process as follows (3):
“Self-Assembly is a process by which disordered parts build an ordered structure through local interaction. We have demonstrated that this phenomenon is scale-independent and can be utilized for self-constructing and manufacturing systems at nearly every scale. We have also identified the key ingredients for self-assembly as a simple set of responsive building blocks, energy and interactions that can be designed within nearly every material and machining process available. Self-assembly promises to enable breakthroughs across every applications of biology, material science, software, robotics, manufacturing, transportation, infrastructure, construction, the arts, and even space exploration. The Self-Assembly Lab is working with academic, commercial, nonprofit, and government partners, collaborators, and sponsors to make our self-assembling future a reality. ”
Programmable Matter Defined
As stated by Campbell, Tibbits, and Garrett in the May, 2014 report of the Atlantic Council of the United States (4, 5):
“Programmable matter (PM) is the science, engineering, and design of physical matter that has the ability to change form and/or function (shape, density, moduli, conductivity, color, etc.) in an intentional, programmable fashion. PM may come in at least two forms: (1) objects made of pre-connected elements that are 4D printed or otherwise assembled as one complete structure for self-transformation, and (2) unconnected voxels that can come together or break apart autonomously to form larger programmable structures. PM encompasses, yet goes beyond, a range of technological capabilities–including 3D printing, micro-robotics, smart materials, nanotechnology, and micro-electromechanical systems (MEMS), to name a few. ”
Useful Applications for 4D Printing
There are many. As noted by Achuth Rao (6):
“4D printing allows the manufacture of objects that transform with time, essentially allowing objects to be “programmed” to behave in certain manner. The prospects of such programmable materials are numerous:”
“On space missions astronauts can take 4D printed objects with them which can transform into desired objects/structures despite the harshness of space.”
“For plumbing & sewage structures, 4D printed pipes will have the ability to expand or contract depending on the amount of water passing through them.”
“In medicine, 4D printing could reduce surgical procedures by enabling doctors to inject self-transforming materials into the body.”
From Pixels to Voxels
A voxel is a volumetric pixel that defines the fundamental unit of digital space and programmable matter. These can be both digital (computational representation in 3D models) and physical (consisting of raw materials like integrated circuits, biomaterials, micro-robotics, titanium, nanomaterials, etc).
From Programming the Matter to Hacking the Matter: New Security Challenges
4D Printing opens the door to a new science: Programming the Matter. It also opens the door to new challenges: Hacking the Matter. That is to say that if matter can be programmed to change in time, it could also be hacked.
Hacking programmable matter presents new challenges to governments and the society in general. Imagine someone trying to hack a material that evolves in time so it becomes a different shape or adopts different characteristics in time and space. Imagine that once hacked the new shape becomes something else that could disrupt communications, services, or cause harm to humans. Three example suffices:
(a) hacking a programmable PM drug dispenser inside a human body so it dispenses more than the expected or morphs into a weapon.
(b) changing parts of a morphable transportation vehicle (car, train, airplane).
(c) modifying morphable components of clothing, engineered parts, etc.
PM technologies in the hands of terrorists or hostile governments is indeed a very bad thing as can be concluded from the Atlantic Council report (4, 5). In the right hands, as mentioned before, PM technologies and 4D Printing in particular, is set to rock the World!
PM + AI
Imagine Programmable Matter, by means of 4D Printing or other PM technologies, with an Artificial Intelligence component that under the morphological changes in time is also a self-learner, capable of making decisions…
To learn more about this incredible technology and research field, visit the Self-Assembly Lab site (3).
We have added a new algorithm to the MUST tool, available at
The tool now automatically detects bogus http status code responses. These types of response codes are frequently designed, though not always, to game crawlers and automated header request tools; i.e., to believe that a resource is not accessible.
For instance, test the following with our tool and as given:
That Quantum Computing and Searching is the next Information Security (IS) and Information Retrieval (IR) frontier is more than clear. According to Phys.org and quote
“The National Institute of Standards and Technology (NIST) is officially asking the public for help heading off a looming threat to information security: quantum computers, which could potentially break the encryption codes used to protect privacy in digital systems. NIST is requesting methods and strategies from the world’s cryptographers, with the deadline less than a year away.”
Read more at:
Now that Quantum Computers and Quantum Searches are at a corner near you, the implications are many: from search marketing to search apps, from social grids, to quantum PCs, from big challenges to big data, from quantum retrieval to mind retrieval: The sky is the limit. Back in 2013 we mentioned quantum searches in the context of XOR/XNOR searches.
A miner on quantum searches will soon be available at http://www.minerazzi.com. In the meantime, see some useful links below:
- Phys.org (2016). NIST asks public to help future-proof electronic information.
- Viamontes, G. F., Markov, I. L., & Hayes, P. (2005). Is Quantum Search Practical?
- Phys.org (2005). Data structures influence speed of quantum search in unexpected ways.
- Quora (2014). How do you use the Grover quantum search algorithm to find all the solutions to some search query?
- Paparo, G. D. & Martin-Delgado, M. A. (2012). Google in a Quantum Network.
- Wang, H., Wu, J., Yang, X., Chen, P., & Yi, X. (2014). An Enhanced Quantum PageRank Algorithm Integrated with Quantum Search.
- Lu, S., Zhang, Y., & Liu, F. (2013). An efficient quantum search engine on unsorted database.
- MIT Technology Review (2011). Quantum PageRank Algorithm Outperforms Classical Version.
This is a new miner, built with our in-context crawler, available now at
12-23-2016 Update: BREAKING NEWS: LIGO discovery named Science’s 2016 Breakthrough of the Year.
As its name states, our LIGO miner finds resources relevant to the Laser Interferometer Gravitational-Wave Observatory (LIGO) project, one of the largest NSF-funded projects and that is praised by the scientific community for its discoveries, receiving a lot of attention, recognition, and prizes all over the world.
The LIGO Project allows scientists to better understand and see the Universe: i.e., to see and analyze gravitational waves due to distant objects and events, like the collision and merging of black holes. It has already proven Albert Einstein theory of gravitational waves. See these links
A course on the subject has been available online for a long time at
To learn more about LIGO, visit these links:
This is a new way of seeing the Universe. It also opens the door for new technologies at the intersection of many disciplines like noise reduction, optics, among others; hence the importance of developing this miner.
Back in 1991, the New York Times reported that experts clashed over the project. Back then Dr. J. Anthony Tyson, an astrophysicist at A.T.&T. Bell Laboratories, and at the time chairman of the Astronomy Advisory Committee of the National Science Foundation, polled astronomers as to their views about the project: “I perused a list of about 2,000 astronomers and picked 70 who seemed to me likely to have thought about LIGO,” Dr. Tyson said in an interview. “I got 60 replies, and they ran 4 to 1 against LIGO. Most of the astrophysical community seems to feel it would be very difficult to get any important information from a gravity-wave signal, even if one should be detected.”
See the full story at this link:
Those detractors were all wrong! 26 years latter, I wonder what happened with them or what they are thinking these days.
The Challenge Now:
Are you ready for LIGO and a new kind of Astronomy?
Would you like to build curated collections about LIGO?
Then try our miner.
Here is a nice Mashable article on the subject
discovered with the miner for the query [einstein].