m3dev / gokart

Gokart solves reproducibility, task dependencies, constraints of good code, and ease of use for Machine Learning Pipeline.
https://gokart.readthedocs.io/en/latest/
MIT License
305 stars 57 forks source link

New feature: dump task info #176

Closed mski-iksm closed 3 years ago

mski-iksm commented 3 years ago

Added a new feature dumping task cache information file after running tasks.

Task cache information file is a pandas dataframe which has information such as task name, unique id, cache file path, parameter and processing time of completed tasks.

Please review. @Hi-king @hirosassa @vaaaaanquish @e-mon

vaaaaanquish commented 3 years ago

[MUST]Please add the appropriate test code.

vaaaaanquish commented 3 years ago

@mski-iksm Thanks, so cool PR. It will be very useful during development. Please address some of the points raised.