DNM: Patch FT Tagger - Githubissues

allenai / dolma

Data and tools for generating and inspecting OLMo pre-training data.

https://allenai.github.io/dolma/

Apache License 2.0

972 stars 107 forks source link

Open undfined opened 1 month ago

undfined commented 1 month ago

Experimental patch to allow tagging a specific field in the document metadata.