search

Netflix / metaflow

Open Source Platform for developing, scaling and deploying serious ML, AI, and data science systems
https://metaflow.org
Apache License 2.0
8.26k stars 774 forks source link

[POC][cli-options-from-step-decorators][WIP] #1985

Open valayDave opened 2 months ago

valayDave commented 2 months ago

Two parts to this whole change:

How do step decorators inject CLI parameters

  • This part is handled by piggy backing on the flow_context to inject the unique steps decorators in the code.
  • Once the unique step decorators are available via the current_flow local variable, we can extract all the options a decorator class exposes and then inject them into the CLI based on the kind/type of CLI we need to inject it into.

How are the injected parameters passed down to the decorators.

  • Current TBD
  • Needs more discussion to decide what needs to happen here.