search

cucapra / dahlia-evaluation

Evaluation for Dahlia
3 stars 0 forks source link

Separate out extraction file download and result.json generation #27

Open rachitnigam opened 5 years ago

rachitnigam commented 5 years ago

The extraction script current does two things:

  1. Download file matching a specific function/string for each job.
  2. Run an extraction function to generate a results.json entry for the benchmark.

And finally coalesce all of them into a singular results.json file. Any failure requires restarting the download step.

Separate these steps out and make the script resumable.