Support ObjectStore as another datasource

InftyAI / llmaz

☸️ Easy, advanced inference platform for large language models on Kubernetes

Apache License 2.0

13 stars 5 forks source link

Closed kerthcet closed 3 weeks ago

kerthcet commented 1 month ago

What would you like to be added:

We may have s3, gcs, oss as model storage, we should load them during runtime.

Why is this needed:

Support more model sources.

Completion requirements:

This enhancement requires the following artifacts:

The artifacts should be linked in subsequent comments.

kerthcet commented 1 month ago

/kind feature /milestone v0.2.0