NER Remaining Work - Githubissues

dotnet / machinelearning

ML.NET is an open source and cross-platform machine learning framework for .NET.

https://dot.net/ml

MIT License

9.02k stars 1.88k forks source link

NER Remaining Work #6910

Open luisquintanilla opened 9 months ago

luisquintanilla commented 9 months ago

[ ] Provide E2E sample
[ ] Look into Tokenizer questions / concerns
- [ ] Data needs to be tokenized
- [ ] Choosing a different tokenizer

The tokenizer may not be possible because it's what the model expects. However, you should be able to use a different vocabulary.

luisquintanilla commented 9 months ago

Blocking Model Builder as well.

cc @zewditu

zewditu commented 9 months ago

It appears that we must adhere to a specific version: libtorch-cpu version 1.13.0.1, I think the is the main blocker for GPU usage in Model Builder.