thammegowda / nllb-serve

Meta's "No Language Left Behind" models served as web app and REST API
http://rtg.isi.edu/nllb/
150 stars 20 forks source link

feat: add dockerfile, docker-compose, and gunicorn+gevent based run #3

Closed PresentJay closed 1 year ago

PresentJay commented 1 year ago

Hello developer of 'nllb-serve', I have found the flask-based deployment method of the nllb model you developed to be convenient.

The pull request (PR) I am requesting includes the content of virtualizing your deployment using docker-compose. I would like to make it easy to use your deployment in a cloud environment and also improve the use of computing resources by using gunicorn and gevent.

However, I expect that if this PR is applied, a more careful modification will be needed to match the CLI-based operation you have written. Would it be possible for you to consider applying the PR?

thammegowda commented 1 year ago

Sorry I had missed merging this PR. Thanks @PresentJay