search

allenai / dolma

Data and tools for generating and inspecting OLMo pre-training data.
https://allenai.github.io/dolma/
Apache License 2.0
910 stars 95 forks source link

When will a version that can add tagger be released? #93

Closed suolyer closed 9 months ago

suolyer commented 9 months ago

Hello, great work, I want to add my own tagger, but the current version 0.9.1 does not seem to support users to add taggers. But I see that the main branch already has the function of adding tagger. When will you release a version that can add tagger?

https://github.com/allenai/dolma/blob/main/docs/taggers.md