Visualize live sound within the Orcasound live-listening web app

orcasound / orcagsoc

Google Summer of Code projects and products related to Orcasound & orca sounds

http://orcasound.net

MIT License

19 stars 14 forks source link

Visualize live sound within the Orcasound live-listening web app #6

Open valentina-s opened 4 years ago

valentina-s commented 4 years ago

Visualize live sound within the Orcasound live-listening web app

Display audio stream as a spectrogram or other visualization that evolves over time.

Stretch goal: add both human and ML annotations and labels in real-time!

Required skills: Elixir, Javascript

Bonus skills: time-series analysis

Possible mentors: Scott, Paul (with technical assistance from Orcasound contributors Sam and Skander)

References and open-source building blocks:

Associated Orcasound feature card (Trello) in the long-term road map
Inspiring web-based real-time spectrogram with machine learning model outputs: Cornell’s BirdNet (open in FireFox)
Spectrogram with WebAudio

Getting Started (these are suggestions, there is no one way to go)

Get acquainted with the code on the spectrogram branch
Study how the Birdnet demo (for Raspberry Pi) can be adapted to run on your computer, what can be integrated with Orcasound website

rathovarun commented 4 years ago

Hi, I am interested to work on this issue. Below is the link to my proposal draft. I am looking forward to get feedback from you on my proposal. Thank you for your time!! https://docs.google.com/document/d/1t0Gzh5V-ISLm3y9GwoA2OA0FB_ZlvjpuOvX2_JgyUU4/edit?usp=sharing

YashKumarVerma commented 3 years ago

was the label supposed to be 2021?

d-e-v-esh commented 3 years ago

Hey @ivanoats I want to confirm if this issue is available for the GSOC 2021, and can I start working on a proposal for this project?

ivanoats commented 3 years ago

On the map or the main site? @scottveirs ?

scottveirs commented 3 years ago

@ivanoats This feature was initially requested in the Orcasound live-listening web app roadmap. It's beyond the scope of the current version 3 re-design, but having a student work on it could provide new functionality to version 4.

It's an interesting question of how such a visualization of the real-time audio data might manifest in a map UI like the one that's emerging in orcamap-react repo...

scottveirs commented 3 years ago

Clarifying title: this is a feature request for the live-listening web app at live.orcasound.net, rather than one of the other web apps that is emerging within the Orcasound organization.

kushalShukla-web commented 3 years ago

Hello guys , this is my first time to the opensource . iam interested in this project can anyone tell me where is code for this project. pls

Molkree commented 3 years ago

@kushalShukla-web, the code is here: https://github.com/orcasound/orcasite