BasedHardware / omi

AI wearables
https://omi.me
MIT License
3.62k stars 448 forks source link

Proactive Notifications (+infra) ($3,000) #1132

Open kodjima33 opened 1 week ago

kodjima33 commented 1 week ago

Core value of our product should be proactive notifications We should make it very very simple for developers to build plugins that use notifications.

Creating a plugin with notifications should be so simple as we currently use memory/chat plugins with prompts, so that devsd could create notifications-plugins in 10 minutes.

We need to do 2 things:

  1. plugin infrastructure + instructions that allows devs create plugins with notifications in 10 minutes
  2. plugin-showcase (let's call it "mentor") that does these things below (they are sorted by importance):

ALL NOTIFICATIONS SHOULD BE BASED ON FACTS THAT APP KNOWS ABOUT THE USER

What Example
During the meeting, I want to get advice to move faster either proactively or if I ask "hey Omi, what do you think?" noticed you are trying to brainstorm ways of how to get viral on hackernews
If I were you, I'd publish your link first and then text Alex, James, Jacob and Scott and ask them to upvote. Just make sure not to send them direct links!
during and After the arguing, I want to get alternative opinion to know if i was wrong or another person. (It should be triggered either when conversation ends (if there was an argument), or if I ask a codeword like "hey Omi, what do you think") Hey Nik, you were talking with Joan about current goals. In my opinion, I think you should keep doing marketing activities because they bring you a lot of momentum, but also spend at least 40% on trying to make the product better. It's important to spend time on the product as well, since you don't yet have a product market fit and it's important
I want to get relevant questions during conversation that will help to extract more value from conversation It seems Richard is very experienced in scaling hardware companies but you didn't ask him about it, even though it's your current main goal!
Ask him "how did you get your first 10k sales?" - this might help you with your goals
After meeting, I want to know how efficient was my communication Nice work on that pitch, Joan! You've shown real improvement since last week. Let's go over the specific areas where you've gotten better.
In your last pitch, you got straight to the point without much of a warming-up period. This can sometimes feel cut and dry. Today, however, you took some time to engage with Leo, asked about him and the firm before diving into the subject matter. This created a more receptive environment for your pitch, which is a definite improvement.
I want to know what should I be working on this day, week and month "Good morning! You mentioned that your weekly goals are "to get 10k users". Here is what I think you should be working on today
Reach out to 3 influencers (your advisor Monisha recommended this earlier this week)
Make the twitter announcement (this is what brings you most traffic)
* 20 SEO-optimized pages (in your last company SEO brought you biggest result)
Same for monthly and weekly

But notifications should bring valuable feedback. Example of NOT VALUABLE feedbackl: Image

As a user, I don't want useless notifications (like from above) to interrupt my day. I want to receive them rarely, but only when it's actually super important

this is a paid task. This is a paid task. Reward is $3,000 in cash. Simply link your PR to this issue to receive the mo eh

josancamon19 commented 1 day ago

Helping

josancamon19 commented 1 day ago

Thinking

josancamon19 commented 1 day ago

nvm, I have no clue how could this be built with the other 100 things that are being attempted to get built rn.

I can set-up the AI portions of this kinda things, a framework or something, then pls decide what's going to be built

josancamon19 commented 1 day ago

I'll build the following:

This feels like part 0.01 But honestly is still confusing, the extend of those 5 use cases, it's ridiculously huge.

josancamon19 commented 1 day ago

1,2,3 ish would covered with previous 2

smian1 commented 1 day ago

@josancamon19 Happy to brainstorm on this with you.

beastoin commented 17 hours ago

what i understand ?

a kind of the transcript_processed (real-time transcript) plugin. the plugin will:

1/ decide when Omi should send a proactive notification to users by triggering the codeword hey Omi, what do you think (the plugin triggers the codeword)

2/ instruct Omi to call the llm with Plugin's prompt + Omi's facts + Omi's context and send the notification to user. how ? they just need response {"proactive_notification": {"prompt": "xyz"}} then Omi will do the rest. (Omi call LLM and send notification to users)

hope that helps :)

any thoughts or am i missing something man ?

josancamon19 commented 9 hours ago

Building a way for people to build plugins and shit without even been able to build it ourselves sounds weird to me.

josancamon19 commented 9 hours ago

Implemented an example of part 1, this is all the information (as an example) plugins would need to access.

https://github.com/BasedHardware/Friend/blob/11aa451ed3fa97a47c5e406a14932aa31af242fc/backend/utils/retrieval/graph_realtime.py

josancamon19 commented 9 hours ago

Also, if you want to change "Omi" word. Youd need adding the keyword here in soniox. Image

beastoin commented 1 hour ago

got, it's too hard for people to build the plugin if we put too much(such as detect the codeword) on their side, right ?

so, once you finish the implementation yourself, let's go ahead with the 1st show-case.

Image

we'll collect feedback and then move to the next one ( not this week~ )

beastoin commented 1 hour ago

also, Nik is the stakeholder of this ticket. don't forget to talk to him if you have any concerns. go direct.