apple / turicreate

Turi Create simplifies the development of custom machine learning models.
BSD 3-Clause "New" or "Revised" License
11.2k stars 1.14k forks source link

Better Text Modeling #3288

Open anishpdoshi opened 4 years ago

anishpdoshi commented 4 years ago

Currently, TC's text capabilities are limited to using logistic regression on top of BOW encoded text.

While this is suitable for some cases, many use cases require more sophisticated/modern NLP methods. It would be nice to for TC have more support for modeling, classifying, and generating text with such, and then serializing results into CoreML models.

Some potential pathways this could take:

c.f. https://github.com/huggingface/swift-coreml-transformers

sonica1987 commented 4 years ago

i need BERT support for mlm