PrincetonML / SIF_mini_demo

minimal example for sentence embedding by Smooth Inverse Frequency weighting scheme
MIT License
35 stars 11 forks source link

SIF

This is a minimum example for the sentence embedding algorithm in the paper "A Simple but Tough-to-Beat Baseline for Sentence Embeddings". This example is good for those who would like to try SIF embeddings. If one would like to check the experiments in the paper, please see the full set of code here.

The code is written in python and requires numpy, scipy, pickle, and sklearn.

Install

To install all dependencies virtualenv is suggested:

$ virtualenv .env
$ . .env/bin/activate
$ pip install -r requirements.txt 

Get started

To get started, cd into the directory examples/ and run demo.sh. It downloads the pretrained GloVe word embeddings, and then runs the script sif_embedding.py, which is an demo on how to generate sentence embedding using the SIF weighting scheme.

Source code

The code is separated into the following parts:

References

For technical details and full experimental results, see the paper.

@article{arora2017asimple, 
    author = {Sanjeev Arora and Yingyu Liang and Tengyu Ma}, 
    title = {A Simple but Tough-to-Beat Baseline for Sentence Embeddings}, 
    booktitle = {International Conference on Learning Representations},
    year = {2017}
}