zhangir-azerbayev / ProofNet

Benchmark for undergraduate-level formal mathematics
MIT License
83 stars 14 forks source link

Some flaws in Munkres.lean #21

Open Hziwara opened 4 months ago

Hziwara commented 4 months ago

I have found the following flaws in the formal translation of exercises from Munkres' textbook. While some are only a matter of faithfulness to the original, some make propositions implausible.

In addition, natural language proofs sometimes refer to theorems or exercises excluded from the benchmark by labels in the textbook, which makes it difficult to autoformalize proofs without retrieval from the textbook.

BartoszPiotrowski commented 4 months ago

Hi @Hziwara, thank you very much for pointing at these mistakes! We are determined to fix all of that, we are going to look into it soon. If you see any other flaws, please, let us know.

zhangir-azerbayev commented 4 months ago

Hi @Hziwara, thanks for catching these. Maintenance of this repo is paused while we figure out whether to merge the Lean 4 translation from https://github.com/rahul3613/ProofNet-lean4 or archive this repo in favor of it. If the issues you've raised persist in the Lean 4 version, we'll make sure to correct them.