bigcode-project / bigcode-analysis

Repository for analysis and experiments in the BigCode project.
Apache License 2.0
115 stars 20 forks source link

add subtsring decontamination #16

Closed RaymondLi0 closed 2 years ago

RaymondLi0 commented 2 years ago

Exact-substring match for decontamination #13

This removes 336 files from the python-permissive dataset and 292 from the python-permissive-dedup dataset. All these removals match HumanEval samples.