Why is the thread blocked until coral tpu finishes working? Is there a reason for this?
If the api was designed to work async I could utilize multiple tpus in one thread instead of spawning multiple threads for each tpu.
It would be fantastic if you redesign it to async or add a async mode.
Click to expand!
### Issue Type
Feature Request
### Operating System
_No response_
### Coral Device
_No response_
### Other Devices
_No response_
### Programming Language
_No response_
### Relevant Log Output
_No response_
google-coral-bot[bot]
commented
5 months ago
Description
Why is the thread blocked until coral tpu finishes working? Is there a reason for this? If the api was designed to work async I could utilize multiple tpus in one thread instead of spawning multiple threads for each tpu.
It would be fantastic if you redesign it to async or add a async mode.
Click to expand!
### Issue Type Feature Request ### Operating System _No response_ ### Coral Device _No response_ ### Other Devices _No response_ ### Programming Language _No response_ ### Relevant Log Output _No response_