openai / mle-bench

MLE-bench is a benchmark for measuring how well AI agents perform at machine learning engineering
https://openai.com/index/mle-bench/
Other
534 stars 60 forks source link

Ensure data dir paths are absolute #21

Closed thesofakillers closed 3 days ago

thesofakillers commented 3 days ago

When preparing for public release, we changed the default data dir to be the user's cache dir, and enabled user-specified data dirs.

We forgot to resolve these paths (make them absolute), which led to some downstream bugs with code that assumed an absolute (resolved) data dir (e.g. #20)

This PR adds those resolves.

For completeness, we also provide a more general fix to #20 with a fix in the comp's prepare script.