Vector Space Explorer Tool

Tags

global weights, local weights, term vector theory, term vectors, tf-idf, vector space explorer, Vector Space Models

Vector Space Explorer Tool is a new tool from Minerazzi, available now at

http://www.minerazzi.com/tools/vector-space-explorer/explorer.php

VSE is aimed at exploring combinations of local (e.g., FREQ, ATF1,…) and global (e.g., IDF, IDFP,…) term weighting schemes for documents and queries. All kind of combinations can be easily explored.

The tool lists results in decreasing order of cosine similarity scores, with or without implementing stopwords removal and parametric corrections.

VSE was developed for computer science students and those interested in information retrieval systems so they can learn how IR systems work.

First-time users may want to try the examples provided by pressing the Try This Example button from the tool. It is possible to cycle through the examples by repetitive pressing this button. Some of the examples list top titles obtained by querying commercial search engines.

Accepting the default settings instructs VSE to remove stopwords and implement the FREQ Model, also known as the Term Count Model. This is one of the simplest vector space implementations where term weights are mere raw frequencies (term counts).

Memory Based Reasoning in AI

Tags

Algorithms, Data Mining, lsi, Mathematics, Singular Value Decomposition, SVD, Vector Space Models

This is a nice course on Memory Based Reasoning in AI taught by Dr. Deepak Khemani and Dr. Sutanu Chakraborti at the Department of Computer Science & Engineering, Indian Institute of Technology Madras, Chennai, India. See

http://aidblab.cse.iitm.ac.in/cs625/

Happy to see that the following readings from the course are based on two articles we published long time ago at Mi Islita.com, now a search engine site about Puerto Rico resources.

Reading #10
Vector Space Models

Reading #11
SVD-LSI

72 Binary Similarity Measures

Tags

Algorithms, bioinformatics, chemical mining, chemistry, Data Conversion, data miners, Data Mining, information retrieval, ir, minerazzi, miners, mining, news, social mining, statistics, tools, tutorials, Vector Space Models

We have expanded the number of similarity measures that our Binary Similarity Calculator computes from 30 to 72 (and counting…)

Same measures with different names have been consolidated into a single record, and different measures with same name have been enumerated as necessary.

These similarity coefficients have many applications across disciplines: from bioinformatics to chemistry, chemometrics, statistics, data mining, information retrieval, marketing research, etc.

The tool is available at

http://www.minerazzi.com/tools/similarity/binary-similarity-calculator.php

We have also included the new similarity measures proposed by Consonni & Todeschini (2012), and Todeschini, et al (2012).

Our Tutorial on Distance and Similarity was also updated, accordingly. Check it out at

 

References

Consonni, V. and Todeschini, R. (2012). New Similarity Coefficients for Binary Data. MATCH Commun. Math. Comput. Chem. 68, 581-592.

Todeschini, R., Consonni, V., Xiang, H., Holliday, J., Buscema, M., and Willet, P. (2012). Similarity Coefficients for Binary Chemoinformatics Data: Overview and Extended Comparison Using Simulated and Real Data Sets. J. Chem. Inf. Model. 52 (11).

Vector Space Calculations without Linear Algebra

Tags

information retrieval, minerazzi, statistics, text mining, tools, tutorials, vector space, Vector Space Models

We have published the new tutorial,

Vector Space Calculations without Linear Algebra

as a complement for a previous one, titled

A Linear Algebra Approach to the Vector Space Model

The calculations presented in the new tutorial are so simple that can be carried out with a spreadsheet, online calculator, or by hand. Thus, the article is suitable for those interested in learning about vector space models, but that lack of a linear algebra background.

A Linear Algebra Approach to the Vector Space Model

Tags

Data Mining, information retrieval, ir, minerazzi, text mining, Vector Space Models

Another fast-track tutorial updated and improved is back!

This is a fast track tutorial on vector space calculations. A linear algebra approach is used. The tutorial covers term-document and term-query matrices, matrix transposition, dot products, cosine similarities, and local and global weights.