hotg-ai / rune

Rune provides containers to encapsulate and deploy edgeML pipelines and applications
Apache License 2.0
134 stars 15 forks source link

Split out inference backends #390

Closed Michael-F-Bryan closed 2 years ago

Michael-F-Bryan commented 2 years ago

We'll need to port the fix from https://github.com/hotg-ai/rune/pull/394 into this PR before it can be merged. I'd also like to make sure each inference backend has tests for models that take one input/output and multiple inputs/outputs.