search

hotg-ai / rune

Rune provides containers to encapsulate and deploy edgeML pipelines and applications
Apache License 2.0
133 stars 15 forks source link

Warn when using `rune run` on MacOS #355

Closed Michael-F-Bryan closed 2 years ago

saidinesh5 commented 2 years ago

We may need a more generic version of this?

Certain models crash with certain acceleration backends .. So when attempting to run a model on an acceleration backend that isn't supported - we should warn users?

Michael-F-Bryan commented 2 years ago

@saidinesh5 yeah, it only happens when inference is done using the CPU backend, but I don't know how to easily programmatically check when it is being used so I'm just going to emit the warning unconditionally on MacOS.

saidinesh5 commented 2 years ago

@Michael-F-Bryan We let the Runefile creators specify the supported platforms? because it depends on the model basically... For me some models crash on GPU acceleration etc.. too