search

m3dev / gokart

Gokart solves reproducibility, task dependencies, constraints of good code, and ease of use for Machine Learning Pipeline.
https://gokart.readthedocs.io/en/latest/
MIT License
305 stars 57 forks source link

fix issue #254 #257

Closed vaaaaanquish closed 2 years ago

vaaaaanquish commented 2 years ago

Hi. Compressing strings reduces memory usage and allows sample code to run.

Please note that this is "quick" solution. TaskInstanceParameter.serialize and luigi.to_str_params is used in a variety of ways. And it's recursive. We will need to cache input of TaskInstanceParameter.serialize in the future.

vaaaaanquish commented 2 years ago

[WIP]Cannot Decode properly

vaaaaanquish commented 2 years ago

@hirosassa @Hi-king @mski-iksm plz review. There is existing hash value change problem in this PR.

Hi-king commented 2 years ago

Looks Good :)