allenai / dolma

Data and tools for generating and inspecting OLMo pre-training data.
https://allenai.github.io/dolma/
Apache License 2.0
972 stars 107 forks source link

Mattj/requirements #212

Open revbucket opened 1 month ago

revbucket commented 1 month ago

Added a requirements.txt file just to make local installs easier.

Got this by running uv on a clean environment and then calling pip install dolma and freezing the result.