mediar-ai / screenpipe

rewind.ai x cursor.com = your AI assistant that has all the context. 24/7 screen & voice recording for the age of super intelligence. get your data ready or be left behind
https://screenpi.pe
MIT License
8.92k stars 512 forks source link

Strange audio transcriptions when silent #86

Closed moltar closed 3 months ago

moltar commented 3 months ago

It seems during the moments of silence, the transcription goes insane and writes this kind of stuff:

[2024-08-01T10:34:41Z INFO screenpipe_audio::stt] 0.0s-...: I'm going to use the other side of the screen. I'm going to use the other side of the screen. I'm going to use the other side of the screen. I'm going to use the other side of the screen. I'm going to use the other side of the screen. I'm going to use the other side of the screen. I'm going to use the other side of the screen. I'm going to use the other side of the screen. I'm going to use the other side of the screen. I'm going to use the other side of the screen. I'm going to use the other side of the screen. I'm going to use the other side of the screen. I'm going to use the other side of the screen. I'm going to use the other side of the screen. I'm going to use the other side of the screen. I'm going to use the other side of the screen. I'm going to use the other side of the screen. I'm going to use the other side of the screen. I'm going to use the other

[2024-08-01T10:37:11Z INFO screenpipe_audio::stt] 0.0s-...: I'm going to do this. I'm going to do this. I'm going to do this. I'm going to do this. I'm going to do this. I'm going to do this. I'm going to do this. I'm going to do this. I'm going to do this. I'm going to do this. I'm going to do this. I'm going to do this. I'm going to do this. I'm going to do this. I'm going to do this. I'm going to do this. I'm going to do this. I'm going to do this. I'm going to do this. I'm going to do this. I'm going to do this. I'm going to do this. I'm going to do this. I'm going to do this. I'm going to do this. I'm going to do this. I'm going to do this. I'm going to do this. I'm going to do this. I'm going to do this. I'm going to do this. I'm going to do this

[2024-08-01T10:37:41Z INFO screenpipe_audio::stt] 0.0s-...: I'm going to make a video about the next video. I'm going to make a video about the next video. I'm going to make a video about the next video. I'm going to make a video about the next video. I'm going to make a video about the next video. I'm going to make a video about the next video. I'm going to make a video about the next video. I'm going to make a video about the next video. I'm going to make a video about the next video. I'm going to make a video about the next video. I'm going to make a video about the next video. I'm going to make a video about the next video. I'm going to make a video about the next video. I'm going to make a video about the next video. I'm going to make a video about the next video. I'm going to make a video about the next video. I'm going to make a video about the next video. I'm going to make a video about the next video. I'm going to make a video

[2024-08-01T10:39:12Z INFO screenpipe_server::core] Inserting audio chunk: Some("<|0.00|> I'm going to do a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little bit of a little")

moltar commented 3 months ago

Btw, I have a fan nearby, but it's not too loud. Could be picking up the white/brown noise from that.

louis030195 commented 3 months ago

yes sorry about that we added a noise filter in new version

you can upgrade to latest version using brew upgrade and brew upgrade screenpipe

note that then when running the CLI it is now using by default Deepgram which is a cloud model much more powerful than the local one (we offer it for free)

you can keep local model using screenpipe --cloud-audio-off

moltar commented 3 months ago

CLI it is now using by default Deepgram

Does that need an API key?

moltar commented 3 months ago

Seems to work well! ❤️ Thanks!

louis030195 commented 3 months ago

CLI it is now using by default Deepgram

Does that need an API key?

@moltar nope, we have bunch of credits after winning hackathon(s) so we offer it for free!

moltar commented 3 months ago

Do they use that data in some nefarious ways? ;)