Create an example for using the web runtime

hotg-ai / rune

Rune provides containers to encapsulate and deploy edgeML pipelines and applications

Apache License 2.0

136 stars 15 forks source link

Create an example for using the web runtime #272

Open Michael-F-Bryan opened 3 years ago

Michael-F-Bryan commented 3 years ago

Originally mentioned by @f0rodo in https://github.com/hotg-ai/rune/pull/261#issuecomment-903305619, we need to have some simple examples of using the web runtime in a real application.

I'm thinking our options are:

Make a command-line app which reads images/audio/whatever using the provided command-line arguments, similar to rune run (depends on #270)
Create a GUI app (e.g. using React and TypeScript/plain JS) which lets people upload a Rune to the browser and hooks up to your webcam
261

@Ge-te, I'm not really sure how to approach this one, do you have any suggestions?

Ge-te commented 3 years ago

@Michael-F-Bryan is it even possible to run tflite in nodejs? or do we make tf.js runes as example?

Ge-te commented 3 years ago

I'm in favor of command line

Michael-F-Bryan commented 3 years ago

I like the command-line option because it's easiest to implement and the the vast majority of the example will be about using the Rune runtime, whereas in a React app people would get distracted/overwhelmed by the code for making a functional UI.

That said, if we wanted to make a command-line version we'd need to comment out all TensorFlow Lite code until #270 is resolved... But I don't really want to do that because we won't be able to run Runes with TensorFlow Lite models in a browser, even though there is nothing stopping us.

f0rodo commented 3 years ago

We need to do browsers cause we have users wanting that.