Open Yaandle opened 9 months ago
Instead of processing images one at a time, batch multiple images together during inference. This allows for parallel processing and reduces the overhead of loading and running the model on each image individually.
Run batch through Virtual Machine with Google Cloud Storage bucket. https://cloud.google.com/batch/docs/get-started
Explore later as it cost about $40 a month. Look for other ways to improve prediction.
Instead of processing images one at a time, batch multiple images together during inference. This allows for parallel processing and reduces the overhead of loading and running the model on each image individually.