Fixed Dangling CLI Options; E2E Tokenizer Tests - Githubissues

allenai / dolma

Data and tools for generating and inspecting OLMo pre-training data.

https://allenai.github.io/dolma/

Apache License 2.0

909 stars 94 forks source link

Fixed Dangling CLI Options; E2E Tokenizer Tests #103

Closed soldni closed 7 months ago