m3dev / gokart

Gokart solves reproducibility, task dependencies, constraints of good code, and ease of use for Machine Learning Pipeline.
https://gokart.readthedocs.io/en/latest/
MIT License
318 stars 57 forks source link

Careful assertion on empty dump #165

Closed Hi-king closed 3 years ago

Hi-king commented 3 years ago

introduce new feature TaskOnKart.fail_on_empty_dump, which raises error on empty dump.

Why: Empty caches sometimes hide bugs and let us spend much time debugging. This feature notice us some bugs (including wrong datasources) in the early stage.

hirosassa commented 3 years ago

Looks good! Thanks.