tnc-ca-geo / animl-ml

Machine Learning resources for camera trap data processing
Other
4 stars 1 forks source link

Look into hosting mira models as multi-model endpoint #38

Closed nathanielrindlaub closed 1 year ago

nathanielrindlaub commented 3 years ago

Consider consolidating mira-small and mira-large into a multi model endpoint? Would that be cheaper to host?

The sagemaker Tensorflow Serving container looks like it might be able to support multiple models on it's own. We should run that to ground.

nathanielrindlaub commented 2 years ago

This will be a very good thing to do now that we're taking on the cost of hosting Megadetector ourselves (#55).

I also would like to revisit instance types to make sure we're not over provisioning.

nathanielrindlaub commented 1 year ago

Closing this out as it will no longer be relevant with MIRAv2.