facebookresearch / CodeGen

Reference implementation of code generation projects from Facebook AI Research. General toolkit to apply machine learning to code, from dataset creation to model training and evaluation. Comes with pretrained models.
MIT License
710 stars 144 forks source link

Fixes #60 set max workers in ThreadPoolExecutor #61

Closed AlexShypula closed 2 years ago

AlexShypula commented 2 years ago

Fixes #60

As mentioned in #60, the output consolidated statistics.csv file often is missing 1/2 to 2/3 of expected lines. After making these changes, the csv output is more reasonable. It is expected that ThreadPoolExecutor by default utilizes too many threads (5 times the number of cores available) which slows down or creates other issues for evosuite.