search

xingyaoww / code4struct

Official repo for ACL 2023 paper Code4Struct: Code Generation for Few-Shot Structured Prediction from Natural Language.
GNU General Public License v3.0
40 stars 1 forks source link

lack files for evaluation #1

Closed mayubo2333 closed 1 year ago

mayubo2333 commented 1 year ago

Hi,

Thanks for your impressive work! When I evaluate the generation results, however, I found there might lacks some file:

  1. I could not find the ace_roles.json (though I have ace_roles+hierarchy.json) https://github.com/xingyaoww/code4struct/blob/main/src/scripts/evaluation/eval-all-ace.sh#L16

  2. I could not find the src/tools/pandoc-toc-sidebar/toc-sidebar.html as well https://github.com/xingyaoww/code4struct/blob/main/src/scripts/evaluation/eval-all-ace.sh#L21

Would you mind updating the two files in this repo? Looking forward for your help!

InfiniH commented 1 year ago

You can solve your problem by executing the following command.
python3 src/scripts/data/parse_ACE_events.py \ --ace-roles-filepath data/ontology/ace/raw/event_role_ACE.json \ --ace-entity-filepath data/ontology/ace/raw/event_role_entity_ACE.json \ --base-entity-filepath data/ontology/ldc/base_entities/base_entities.json \ --output-filepath data/ontology/ace/processed/ace_roles

xingyaoww commented 1 year ago

Thanks for pointing it out! You can follow @InfiniH's instructions to generate the ace_roles.json. I have updated the repo to include src/tools/pandoc-toc-sidebar.