search

shunzh / Code-AI-Tree-Search

MIT License
101 stars 23 forks source link

Beam Search Baseline #2

Open Laknath1996 opened 1 month ago

Laknath1996 commented 1 month ago

I have been going through generate/synthesis_exp.py script. I noticed that default num_beams is set to 1 for the generation. Does this mean you're doing greedy decoding for "Beam-Search" entry of the Table 1 metrics in the paper? Thanks

shunzh commented 1 month ago

Thanks for your question! We actually used a beam size of 5 as described in the paper. So there's a missing argument in the script (I reorganized the scripts before release and it looks like I missed this argument). I just updated the script below. Sorry for the confusion. https://github.com/shunzh/Code-AI-Tree-Search/blob/d075c6892ef3bd3ce2f747420acac05d406b0ce4/generate/scripts/beam/run.sh#L5