• About IR Thoughts
  • Minerazzi Tools
  • Minerazzi Tutorials

IR Thoughts

~ Thoughts on Information Retrieval, Search Engines. Data Mining, and Science & Engineering

IR Thoughts

Tag Archives: Vector Space Models

Vector Space Explorer Tool

07 Sunday Jun 2020

Posted by egarcia in Algorithms, cosine similarity, Data Mining, information retrieval, ir, IR Tools, minerazzi, Queries, Ranking Results, search engines, Software, Vector Space Models, Web Mining

≈ Leave a comment

Tags

global weights, local weights, term vector theory, term vectors, tf-idf, vector space explorer, Vector Space Models

Vector Space Explorer Tool is a new tool from Minerazzi, available now at

http://www.minerazzi.com/tools/vector-space-explorer/explorer.php

VSE is aimed at exploring combinations of local (e.g., FREQ, ATF1,…) and global (e.g., IDF, IDFP,…) term weighting schemes for documents and queries. All kind of combinations can be easily explored.

The tool lists results in decreasing order of cosine similarity scores, with or without implementing stopwords removal and parametric corrections.

VSE was developed for computer science students and those interested in information retrieval systems so they can learn how IR systems work.

First-time users may want to try the examples provided by pressing the Try This Example button from the tool. It is possible to cycle through the examples by repetitive pressing this button. Some of the examples list top titles obtained by querying commercial search engines.

Accepting the default settings instructs VSE to remove stopwords and implement the FREQ Model, also known as the Term Count Model. This is one of the simplest vector space implementations where term weights are mere raw frequencies (term counts).

Memory Based Reasoning in AI

05 Monday Jun 2017

Posted by egarcia in Algorithms, Data Mining, ir, IR Tutorials, Latent Semantic Indexing, Mathematics, Software, SVD

≈ Leave a comment

Tags

Algorithms, Data Mining, lsi, Mathematics, Singular Value Decomposition, SVD, Vector Space Models

This is a nice course on Memory Based Reasoning in AI taught by Dr. Deepak Khemani and Dr. Sutanu Chakraborti at the Department of Computer Science & Engineering, Indian Institute of Technology Madras, Chennai, India. See

http://aidblab.cse.iitm.ac.in/cs625/

Happy to see that the following readings from the course are based on two articles we published long time ago at Mi Islita.com, now a search engine site about Puerto Rico resources.

Reading #10
Vector Space Models

Click to access 10.VectorSpace-model.pdf

Reading #11
SVD-LSI

Click to access 11.SVD-LSI.pdf

72 Binary Similarity Measures

12 Monday Sep 2016

Posted by egarcia in Algorithms, bioinformatics, calculators, chemistry, Data Conversion, Data Mining, IR Tools, IR Tutorials, News, Programming, Scripts, Software, Statistics and Mathematics, Vector Space Models, Web Mining Course

≈ Leave a comment

Tags

Algorithms, bioinformatics, chemical mining, chemistry, Data Conversion, data miners, Data Mining, information retrieval, ir, minerazzi, miners, mining, news, social mining, statistics, tools, tutorials, Vector Space Models

We have expanded the number of similarity measures that our Binary Similarity Calculator computes from 30 to 72 (and counting…)

Same measures with different names have been consolidated into a single record, and different measures with same name have been enumerated as necessary.

These similarity coefficients have many applications across disciplines: from bioinformatics to chemistry, chemometrics, statistics, data mining, information retrieval, marketing research, etc.

The tool is available at

http://www.minerazzi.com/tools/similarity/binary-similarity-calculator.php

We have also included the new similarity measures proposed by Consonni & Todeschini (2012), and Todeschini, et al (2012).

Our Tutorial on Distance and Similarity was also updated, accordingly. Check it out at

Click to access distance-similarity-tutorial.pdf

 

References

Consonni, V. and Todeschini, R. (2012). New Similarity Coefficients for Binary Data. MATCH Commun. Math. Comput. Chem. 68, 581-592.

Todeschini, R., Consonni, V., Xiang, H., Holliday, J., Buscema, M., and Willet, P. (2012). Similarity Coefficients for Binary Chemoinformatics Data: Overview and Extended Comparison Using Simulated and Real Data Sets. J. Chem. Inf. Model. 52 (11).

Vector Space Calculations without Linear Algebra

04 Friday Mar 2016

Posted by egarcia in calculators, Data Mining, Graduate Courses, Machine Learning, Marketing Research, Queries, Statistics and Mathematics, Vector Space Models, Web Mining Course

≈ Leave a comment

Tags

information retrieval, minerazzi, statistics, text mining, tools, tutorials, vector space, Vector Space Models

We have published the new tutorial,

Vector Space Calculations without Linear Algebra

as a complement for a previous one, titled

A Linear Algebra Approach to the Vector Space Model

The calculations presented in the new tutorial are so simple that can be carried out with a spreadsheet, online calculator, or by hand. Thus, the article is suitable for those interested in learning about vector space models, but that lack of a linear algebra background.

A Linear Algebra Approach to the Vector Space Model

29 Monday Feb 2016

Posted by egarcia in Data Mining, IR Tutorials, Queries, Statistics and Mathematics, Vector Space Models

≈ Leave a comment

Tags

Data Mining, information retrieval, ir, minerazzi, text mining, Vector Space Models

Another fast-track tutorial updated and improved is back!

Click to access term-vector-linear-algebra.pdf

This is a fast track tutorial on vector space calculations. A linear algebra approach is used. The tutorial covers term-document and term-query matrices, matrix transposition, dot products, cosine similarities, and local and global weights.

January 2021
M T W T F S S
 123
45678910
11121314151617
18192021222324
25262728293031
« Sep    

Favorite Sites

  • Minerazzi.com

Pages

  • About IR Thoughts
  • Minerazzi Tools
  • Minerazzi Tutorials

Categories

  • 4D Printing
  • AIRWeb Course
  • Algorithms
  • Amazon Alexa
  • Android
  • Arithmetic Geometry
  • Best Match Models (BM)
  • Big Data
  • BioDesign
  • bioinformatics
  • Blogroll
  • calculators
  • Cancer
  • Cancer Research
  • Causality & Determinism
  • Chaos
  • chemical mining
  • Chemist Biographies
  • chemistry
  • Chemometrics
  • Clinical Trials
  • Cloud Computing
  • Conferences
  • coronavirus (COVID-19)
  • Correlation Coefficients
  • Cortana
  • cosine similarity
  • Crawlers
  • Curated Collections
  • Data Conversion
  • Data Mining
  • Data Structures
  • Deep Neural Networks
  • directories
  • Directories
  • Docker
  • Dynamics
  • Favorite Sites
  • Feed Tools
  • Fisher Transformations
  • Fractal Geometry
  • Fractal Patterns
  • google
  • Graduate Courses
  • Hacking
  • Homeland Security
  • Human-Computer Interaction
  • Image Compression
  • information retrieval
  • Internet Engineering
  • Internet of Senses
  • Internet Standards
  • inverted index
  • ir
  • IR Quizzes
  • IR Tools
  • IR Tutorials
  • Kubernetes
  • Latent Semantic Indexing
  • Legacy Posts
  • LIGO
  • Machine Learning
  • Marketing Research
  • Mathematics
  • Medical Cannabis
  • meta-analysis
  • Mind Retrieval
  • miner
  • minerazzi
  • Miscellaneous
  • National Laboratories
  • New Information Retrieval Paradigms
  • News
  • Newsletters
  • Nonlinear Dynamics
  • One-to-Many (O2M)
  • Open Source Projects
  • PageRank
  • Patents
  • PCA
  • People Searches
  • Perfectoid Spaces
  • PHP
  • Physiology
  • Poems
  • political networks
  • Predatory Conferences
  • Predatory Journals
  • Programming
  • Public Databases
  • Public Records
  • Quack Science
  • Quantum Computing
  • Quantum Information Retrieval
  • Quantum Searches
  • Quantum Theory
  • Queries
  • Ranking Results
  • Research Centers
  • RSS/Atom Feeds
  • Scripts
  • search engines
  • Search Engines Architecture Course
  • Search Modes
  • self-weighting
  • SEO Myths
  • Sitemaps
  • social mining
  • social pulse parser
  • Software
  • Spam
  • Statistics and Mathematics
  • SVD
  • Technology Inventions
  • Theoretical Physics
  • Theses
  • twitter
  • URLs Mining
  • Vector Space Models
  • Voice Assistants
  • Web Mining
  • Web Mining Course
  • Web Security
  • Xamarin

Recent Posts

  • On Fake Research, “Academic” Spam, and ASEO
  • The Almost Binary Heuristic
  • Vector Space Explorer Tool
  • Revamping the Cosine Similarity Calculator Tool
  • RAR Parser |An RSS, ATOM, and RDF Parser
  • Latent Simplex Position Model
  • Coronavirus (COVID-19) Miner
  • The Ideal Gas Law Oracle
  • Weighted Averages of Correlation Coefficients
  • On the Internet of Senses and Cyborg Organoids
  • Internet of Senses Miner
  • On the Myth of d Orbitals Hybridization
  • The Bond Order Calculator: Updates
  • Semantic Similarity of Healthcare Data
  • Going the multidisciplinary way

Archives

  • September 2020
  • July 2020
  • June 2020
  • April 2020
  • March 2020
  • February 2020
  • January 2020
  • November 2019
  • October 2019
  • September 2019
  • August 2019
  • July 2019
  • June 2019
  • May 2019
  • April 2019
  • March 2019
  • February 2019
  • January 2019
  • December 2018
  • November 2018
  • October 2018
  • September 2018
  • August 2018
  • July 2018
  • June 2018
  • May 2018
  • April 2018
  • March 2018
  • February 2018
  • January 2018
  • September 2017
  • August 2017
  • July 2017
  • June 2017
  • May 2017
  • April 2017
  • March 2017
  • February 2017
  • January 2017
  • December 2016
  • November 2016
  • October 2016
  • September 2016
  • August 2016
  • July 2016
  • June 2016
  • May 2016
  • April 2016
  • March 2016
  • February 2016
  • January 2016
  • December 2015
  • November 2015
  • October 2015
  • September 2015
  • August 2015
  • July 2015
  • June 2015
  • May 2015
  • April 2015
  • March 2015
  • February 2015
  • January 2015
  • December 2014
  • November 2014
  • October 2014
  • September 2014
  • August 2014
  • July 2014
  • June 2014
  • May 2014
  • April 2014
  • March 2014
  • January 2014
  • December 2013
  • November 2013
  • October 2013
  • September 2013
  • August 2013
  • July 2013
  • May 2013
  • April 2013
  • March 2013
  • February 2013
  • January 2013
  • December 2012
  • November 2012
  • October 2012
  • September 2012
  • August 2012
  • July 2012
  • June 2012
  • May 2012
  • April 2012
  • March 2012
  • February 2012
  • January 2012
  • December 2011
  • November 2011
  • October 2011
  • September 2011
  • August 2011
  • July 2011
  • June 2011
  • May 2011
  • April 2011
  • February 2011
  • January 2011
  • December 2010
  • November 2010
  • October 2010
  • September 2010
  • August 2010
  • July 2010
  • June 2010
  • May 2010
  • April 2010
  • March 2010
  • February 2010
  • January 2010
  • December 2009
  • November 2009
  • October 2009
  • September 2009
  • August 2009
  • July 2009
  • June 2009
  • May 2009
  • April 2009
  • March 2009
  • February 2009
  • January 2009
  • December 2008
  • November 2008
  • October 2008
  • September 2008
  • August 2008
  • July 2008
  • June 2008
  • May 2008
  • April 2008
  • March 2008
  • February 2008
  • January 2008
  • December 2007
  • November 2007
  • October 2007
  • September 2007
  • August 2007
  • July 2007
  • June 2007
  • May 2007
  • April 2007

Algorithms calculators chemical mining Conferences Data Mining Hacking Homeland Security Human-Computer Interaction IR Tools IR Tutorials Latent Semantic Indexing Machine Learning Marketing Research Mathematics miner minerazzi Miscellaneous New Information Retrieval Paradigms News Newsletters Programming Queries Scripts Search Engines Architecture Course SEO Myths Software Spam Statistics and Mathematics Vector Space Models Web Mining Course

Create a free website or blog at WordPress.com.

Privacy & Cookies: This site uses cookies. By continuing to use this website, you agree to their use.
To find out more, including how to control cookies, see here: Cookie Policy