usc-isi-i2 / dig-etl-engine

Download DIG to run on your laptop or server.
http://usc-isi-i2.github.io/dig/
MIT License
101 stars 39 forks source link

Compute embeddings #85

Open szeke opened 6 years ago

szeke commented 6 years ago

The embedding code will read from a kafka topic to compute the embeddings. It will read as many docs as it needs from the topic and then write the embedding file resource. Coordinate with @GreatYYX to decide where to put the embedding files.