Closed Sukh-P closed 4 months ago
All modified and coverable lines are covered by tests :white_check_mark:
Project coverage is 57.14%. Comparing base (
26ddadf
) to head (ef3752e
). Report is 40 commits behind head on main.
:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.
Pull Request
Description
Adding in a fix to the repo (that @dfulu had found and been using locally) that helps use multiprocessing/multiple workers when creating training batches
Also changing one pip command in the readme
How Has This Been Tested?
This has been tested locally by @dfulu and myself, when specifying num_workers > 1 in the streamed batches config it stops the script from hanging for long periods.
Checklist: