search

awslabs / multi-model-server

Multi Model Server is a tool for serving neural net models for inference
Apache License 2.0
994 stars 231 forks source link

Is it possible to implement multi-stage inferences? #939

Closed bedilbek closed 4 years ago

bedilbek commented 4 years ago

Lets say I want to create an inference server for human pose estimation which consists of 2 stages, human proposal stage for human detection and pose proposal stage for pose estimation upon given human proposals. So, how it is possible to create one endpoint with multi-stage inference?

bedilbek commented 4 years ago

Actually, it was just a matter of understanding the repository :) I could implement a demo version as described here on medium