request handler code - Githubissues

kingfischer16 / mldeploy

Deploy ML code to cloud resources as a REST API for inference and training.

MIT License

2 stars 0 forks source link

request handler code #37

Open kingfischer16 opened 3 years ago

kingfischer16 commented 3 years ago

Regardless of whatever model and code gets copied into the Docker image, there will need to be a file, e.g. handler.py, that:

Polls SQS for 1 new task
Gathers required resources (data, hyperparameters) before the execution
Executes the task (user definition, making use of user code via imports)
Sends the results (metrics, files) to appropriate storage (S3, RDS)