Open lboschman opened 1 week ago
Make the model in such a way that it can make predictions in real time.
The current model can handle approximately 1000 images/second on a 12-core M2 CPU. This is probably fast enough for real-time prediction. The rate limiting step is probably creating the image
Make the model in such a way that it can make predictions in real time.