boschresearch / EaT-PIM

EaT-PIM (Embedding and Transforming Procedural Instructions for Modification)
GNU Affero General Public License v3.0
4 stars 5 forks source link

Patch 2 - add more frozendict fixes, fix do_test #3

Closed solashirai closed 1 year ago

solashirai commented 1 year ago

Add a couple additional checks to fix the issue caused by frozendict no longer being detected as an instanceof dict Add a fix to correctly get the scoring when performing evaluation in the test step. Tested running through the entire pipeline & running evaluation over the test set (using the --do_test flag).