JoSimText

This system performs word sense induction form text. This is an implementation of the JoBimText approach in Scala, Spark, tuned for induction of word Senses (hence the "S" instead of "B" in the name, but also because of the name of the initial developer of the project Johannes Simon). The original JoBimText implementation is written in Java/Pig and is more generic as it supposes that "Jo"s (i.e. objects) and "Bims (i.e. features) can be any linguistic objects. This particular implementation is designed for modeling of words and multiword expressions.

The system consist of several modules:

1. Term feature extraction
2. Term similarity (this reposiroty). This repository performs construction of a distributional thesaurus from word-feature frequencies.
3. Word sense induction

Requirements

• git
• java 1.8+
• spark 2.0+

Build

make build