lgabs / gpt-resolve

Can GPT solve Brazilian university entrance exams?
MIT License
17 stars 2 forks source link

Show which solution could not be compiled to pdf when errors happen #20

Open lgabs opened 1 week ago

lgabs commented 1 week ago

Context

In the README, the troubleshooting section describes common errors when running the package. Pdf compilation can fail when some solution has some syntax error, since they can happen as they are generated by a llm. Currently, when this happens, it's not clear which solution has wrong syntax.

Objective

In the generate_pdf.py, check the syntax for each question and throw an error if one or more questions have wrong syntax, so that the user can fix them.

This check could be some pylatex method for syntax check (I'm not sure there is one) or trying to compile each question individually.

Krishn1412 commented 1 week ago

Hello @lgabs , Can I pick up this issue?

lgabs commented 1 week ago

@Krishn1412, for sure! Thank you for the interest in this project 🙏

Krishn1412 commented 1 week ago

Hey @lgabs, I have raised a PR, could you review it? https://github.com/lgabs/gpt-resolve/pull/21