That folder would than contain modules / scripts for running the preprocessing, rephrasing, saving, evaluation, and any further processing regarding SEED-Benchmarks.
Create an external main file, powered by configuration management module (s.a hydra, omegaConf for instance) to run the scripts in the SEED-Bench package.
Wrap SEED-Bench with a proper setup.py file / any package required files
That folder would than contain modules / scripts for running the preprocessing, rephrasing, saving, evaluation, and any further processing regarding SEED-Benchmarks.
Create an external main file, powered by configuration management module (s.a
hydra
,omegaConf
for instance) to run the scripts in the SEED-Bench package.Wrap SEED-Bench with a proper
setup.py
file / any package required filesCreate docs