Spider Execution bug fixes; Added new annotations for spider (some need to be revised with spider execution change)

Yale-LILY / NLP4Code

Repository for the NLP4Code project at the LILY lab.

Apache License 2.0

5 stars 1 forks source link

Spider Execution bug fixes; Added new annotations for spider (some need to be revised with spider execution change) #17

Closed StephenYin01 closed 1 year ago

StephenYin01 commented 1 year ago

new annotations for spider (need to revise some with new execution); debugged spider execution capitalization issues and exec match issues with numpy int not being detected

niansong1996 commented 1 year ago

The changes in evaluating answer equivalence makes sense. Looks good to me!