centre-for-humanities-computing / danish-foundation-models

A project for training foundational Danish language model
https://foundationmodels.dk
MIT License
68 stars 4 forks source link

Refactor input file glob pattern in tokenize_jsonl.py #258

Closed rlrs closed 2 months ago