Paralellize Training & Mapping

26medias / context-aware-markov-chains

Markov Chain combined with word vector embedding (word2vec) and part-of-speech tagging, for context-aware text generation. License: MIT

98 stars 9 forks source link

Open cphoover opened 7 years ago

cphoover commented 7 years ago

Split the training data into chunks assign chunks to each cpu. Parallelize the process of training the data and mapping.

26medias commented 7 years ago

I agree it'd be great.

I have no plan to work on this at the moment, not enough free time.

Free free to implement and send a pull request or fork though.