GateNLP / gateplugin-LearningFramework

A plugin for the GATE language technology framework for training and using machine learning models. Currently supports Mallet (MaxEnt, NaiveBayes, CRF and others), LibSVM, Scikit-Learn, Weka, and DNNs through Pytorch and Keras.
https://gatenlp.github.io/gateplugin-LearningFramework/
GNU Lesser General Public License v2.1
26 stars 6 forks source link

Consider making it work with online learning algorithms #55

Open johann-petrak opened 6 years ago

johann-petrak commented 6 years ago

This is interesting for huge datasets and stream learning. The LF would essentially just get document by document and pass extracted features on to the online learning algorithm (e.g. Vowpal Wabbit, AROW). This could happen via streaming/reading from a pipe or via REST.

The learning algorithm must be able to write an updated model at regular intervals or when somehow triggered from the outside.

The application PR could also support a trigger to reload its model, thus supporting using the very latest model from e.g. a stream-learning job.