madaan / self-refine

LLMs can generate feedback on their work, use it to improve the output, and repeat this process iteratively.
https://selfrefine.info
Apache License 2.0
596 stars 48 forks source link

reproduction for the paper #19

Open yananchen1989 opened 5 months ago

yananchen1989 commented 5 months ago

hello.

May I ask how to run the full test cases to get the figures reported in the paper ? For example, in acronym task, I only see the unit testing, and I cannot find any code to run https://github.com/madaan/self-refine/blob/main/src/acronym/run_mcts.py.

also, where is the titles_file in https://github.com/madaan/self-refine/blob/main/src/acronym/run.py#L102 ?

For task Commongen, it seems that running python -u src/commongen/run.py cmd stair bubble team dryer puppy aliens cat could not download any data.