Kipok / NeMo-Skills

A pipeline to improve skills of large language models
https://kipok.github.io/NeMo-Skills/
Apache License 2.0
185 stars 41 forks source link

Update SDP pipeline #106

Closed i-vainn closed 1 month ago

i-vainn commented 1 month ago

Moved majority voting filtering to sdp pipeline and added exclude_optional_keys option to decrease output file size.