Closed normand1 closed 3 months ago
It's true that CoreML cannot run on GPU in the background - this is due to some OS protections to give the foregrounded app priority for framerate. For iOS in particular, I'd recommend using the ANE compute unit, which is allowed to submit work in the background. You can also limit it to just CPU, but since our models are optimized to ANE, the CPU accuracy may be degraded.
@ZachNagengast Got it, thank you, I'll look into it!
When running the example application I get the following error when I put the app in the background. I don't see it explicitly mentioned anywhere if background transcription is possible or not so I'm just asking the question in case there is some known solution. Thank you!