DirectAI / simple-data-free-model-server

Apache License 2.0
8 stars 0 forks source link

model config transformation should happen in Ray #23

Open ben-directai opened 1 month ago

ben-directai commented 1 month ago

Summary:

See discussion in #21

We are storing a transformed dictionary in Redis to represent model configs. There's a lot of annoyance related to representing the configs correctly when we return them back to the client. Would be ideal if none of that transformation was happening in fastapi and we just passed a ClassifierDeploy or DetectorDeploy instance directly to Ray.