search

m3dev / gokart

Gokart solves reproducibility, task dependencies, constraints of good code, and ease of use for Machine Learning Pipeline.
https://gokart.readthedocs.io/en/latest/
MIT License
318 stars 57 forks source link

[WIP]Change dump log timing #145

Closed vaaaaanquish closed 3 years ago

vaaaaanquish commented 4 years ago

https://github.com/m3dev/gokart/issues/144

Hi-king commented 3 years ago

@vaaaaanquish Don't us need failed task logs? For example, checking task_params of failed tasks.

vaaaaanquish commented 3 years ago

@Hi-king I thought.

If we want to experiment at hand we may need. but if we are managing the experiment in the production GCS, S3, even access to its log files will be difficult (because file amount).

I think Optional is better. How do you think? (Temporarily change to WIP)