trishullab / PutnamBench

An evaluation benchmark for undergraduate competition math in Lean4, Isabelle, Coq, and natural language.
56 stars 8 forks source link

Fix lean build setup and add CI #170

Closed eric-wieser closed 3 months ago

eric-wieser commented 3 months ago

The globs field makes lake build work.

The CI script includes some basic caching which should prevent it doing any work if the lean files don't change.

Note that CI fails, because three of the lean files contain either type errors or invalid syntax; I would argue that CI that fails is better than no CI at all, and the fixes can come later.