Customize docker environment for the EC2 deployment

bentoml / aws-ec2-deploy

Fast model deployment on AWS EC2

Apache License 2.0

14 stars 9 forks source link

Customize docker environment for the EC2 deployment #17

Closed Matthieu-Tinycoaching closed 2 years ago

Matthieu-Tinycoaching commented 3 years ago

When deploying bentoML service onto an AWS EC2 instance, it for now impossible to customize the docker environment such as activating microbatching via BENTOML_ENABLE_MICROBATCH and add further gunicorn workers via BENTOML_GUNICORN_WORKERS.

Could it be possible to develop these customizations which are really needed regarding to microbatching when deploying on cloud.

stale[bot] commented 3 years ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

parano commented 2 years ago

With the new bentoctl tool and its aws-ec2-deploy plugin, it is now possible to customize environment variables of an EC2 deployment, via the environment_variables option in the deployment config file: https://github.com/bentoml/aws-ec2-deploy/blob/pre-v1.0/ec2_config.json