bentoml / BentoML

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
https://bentoml.com
Apache License 2.0
7.17k stars 792 forks source link

feat: docker images provider #1731

Closed aarnphm closed 3 years ago

aarnphm commented 3 years ago

Is your feature request related to a problem? Please describe.

It would be nice if bentoml provided a Pythonic way of using docker_base_image with bentoml/model-server.

Describe the solution you'd like

@env(docker_base_image=bentoml.docker.ProvidedImages(os="debian", gpu=True, python_version=3.7))
class Service(bentoml.Service)

It should also have backward compatibility so that users can have a better experience when new releases is introduced on docker

Exploration ideas:

aarnphm commented 3 years ago

This is also related to current redesigning package bundle, thus will be on hold at the moment.