brilliantlabsAR / noa-for-ios

You AI companion. ChatGPT and translation for Monocle AR
ISC License
70 stars 14 forks source link

[feature request] User applets/scripts #104

Open josuah opened 3 months ago

josuah commented 3 months ago

Noa is progressively integrating quite a few infrastructure elements.

It brings a library, which opens the opportunity to write small scripts inside of Noa to build applications without requiring an iOS or Android development environment, or even a computer at all.

For instance, some JavaScript a bit like what LÖVE does with Lua: all the libraries already loaded and integrated, and only the app-specific content to add.

Some examples suggested:

https://discord.com/channels/963222352534048818/1220631244266668074/1225473830965874818

bvoq commented 3 months ago

I want to add that it would be awesome to run multiple applications at the same time for frame. There could be multiple triggers, through voice commands or hand gestures. Let's say I have two apps I'm interested in:

I wouldn't want to give up one functionality for the other or switch apps every time (although this wouldn't be that bad if it can be done without opening your phone).

One proposal on how to solve this: If I write serious apps for the brilliant glasses I wouldn't want to use a scripting language either, but more something like flutter but I guess typescript is ok. Developers could then deploy their apps through the google play and app store and you wouldn't have to write moderation tools, mod loaders or a payment processor. Users could run two or more apps as a background task. The only thing the glasses would need to take care of is a protocol for multiple apps to use BLE without them getting confused with each other.

Note that the rayban glasses from meta don't support developers at all and I think this is could be your ticket to fast growth and adaption. I bought one of your glasses for this reason anyways. 👍

josuah commented 3 months ago

Given there is going to be a rewrite of the Noa app, it can be interesting to see how this becomes in the new app, and what kind of hooks are left for "applet" developers to integrate multiple apps.

This might come within a few weeks.