Serving Storage Cache - Githubissues

kserve / kserve

Standardized Serverless ML Inference Platform on Kubernetes

https://kserve.github.io/website/

Apache License 2.0

3.66k stars 1.07k forks source link

Serving Storage Cache #280

Open rakelkar opened 5 years ago

rakelkar commented 5 years ago

/kind feature

KFServing storage-initializer downloads data per pod. KFServing should support integration of a serving storage cache so that data is downloaded only once during service provisioning.

Strawman Design Proposal https://docs.google.com/document/d/1NOHSiZ-G3XbA1H4BExXpMltnB9F3qY0WH8F5-tZKJX0/edit?usp=sharing

jtfogarty commented 4 years ago

/kind feature /area engprod /priority p2

issue-label-bot[bot] commented 4 years ago

Issue-Label Bot is automatically applying the labels:

Label	Probability
area/inference	0.90

Please mark this comment with :thumbsup: or :thumbsdown: to give our bot feedback! Links: app homepage, dashboard and code for this bot.