search

Netflix / metaflow

Open Source Platform for developing, scaling and deploying serious ML, AI, and data science systems
https://metaflow.org
Apache License 2.0
8.26k stars 774 forks source link

Metaflow Configs #1962

Open romain-intel opened 3 months ago

romain-intel commented 3 months ago

This is not yet fully ready but putting out so people can get a general sense of the direction.

bhogan-bdai commented 2 months ago

As a user interested in using a config file instead of using different sets of parameters, what would a config file look like?

romain-intel commented 2 months ago

@bhogan-bdai -- the idea so far is to support a simple format like JSON (nested dicts basically) but other formats could be supported as well. We are also providing a parser option which means you would be able to write your own parser and would need to return a dict. If you have other ideas/wish-list type of things, please let us know though. This is still a WIP although it kind of works. I'll post an example script a bit later to show the functionality.