search

allenai / dolma

Data and tools for generating and inspecting OLMo pre-training data.
https://allenai.github.io/dolma/
Apache License 2.0
976 stars 108 forks source link

Fix spawn method for multiprocessing #64

Closed soldni closed 1 year ago

soldni commented 1 year ago

As suggested in #58 .