search

Kipok / NeMo-Skills

A pipeline to improve skills of large language models
https://kipok.github.io/NeMo-Skills/
Apache License 2.0
185 stars 41 forks source link

Filtering long solutions out #93

Closed shtoshni closed 2 months ago

shtoshni commented 2 months ago

This PR adds the option to remove long solutions, where the model's tokenizer determines length.