allenai / OLMo

Modeling, training, eval, and inference code for OLMo
https://allenai.org/olmo
Apache License 2.0
4.2k stars 392 forks source link

Make include_instance_metadata a kwarg of build_train_dataloader #614

Closed 2015aroras closed 3 weeks ago

2015aroras commented 3 weeks ago

This is needed for the script I made in https://github.com/allenai/oe-data-internal/pull/120 for inspecting training data.