joyhughes / Jen

Image processing, generative photography, cellular automata
https://discord.gg/GQQHUbkf
23 stars 20 forks source link

Sound Input #167

Open joyhughes opened 2 months ago

joyhughes commented 2 months ago

Create functions that respond to sound, either microphone input or audio clip. Functions will give the amplitude over a given frequency band. Image output can then respond to the sound.

DM-netizen commented 2 months ago

Hello @joyhughes Can I take up this issue?

joyhughes commented 2 months ago

Yes, but I'm not sure exactly how to do it. We must find a cross platform open source library to get the sound input. A Jen function can be constructed that returns a floating point value that approximates the amplitude over a given frequency range and interval of time.


From: Disha Mukherjee @.> Sent: Tuesday, July 30, 2024 11:11:43 PM To: joyhughes/Jen @.> Cc: Joy Hughes @.>; Mention @.> Subject: Re: [joyhughes/Jen] Sound Input (Issue #167)

Hello @joyhugheshttps://github.com/joyhughes Can I take up this issue?

— Reply to this email directly, view it on GitHubhttps://github.com/joyhughes/Jen/issues/167#issuecomment-2259746808, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AKBIGEAXIDTA2AJBVZCM7YLZPB5Z7AVCNFSM6AAAAABK3KL6VWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDENJZG42DMOBQHA. You are receiving this because you were mentioned.Message ID: @.***>

joyhughes commented 2 months ago

We can probably get audio from the web browser https://web.dev/articles/media-recording-audio

Then process in C++.

Doing it in real time is a challenge


From: Joy Hughes @.> Sent: Wednesday, July 31, 2024 3:07:38 AM To: joyhughes/Jen @.>; joyhughes/Jen @.> Cc: Mention @.> Subject: Re: [joyhughes/Jen] Sound Input (Issue #167)

Yes, but I'm not sure exactly how to do it. We must find a cross platform open source library to get the sound input. A Jen function can be constructed that returns a floating point value that approximates the amplitude over a given frequency range and interval of time.


From: Disha Mukherjee @.> Sent: Tuesday, July 30, 2024 11:11:43 PM To: joyhughes/Jen @.> Cc: Joy Hughes @.>; Mention @.> Subject: Re: [joyhughes/Jen] Sound Input (Issue #167)

Hello @joyhugheshttps://github.com/joyhughes Can I take up this issue?

— Reply to this email directly, view it on GitHubhttps://github.com/joyhughes/Jen/issues/167#issuecomment-2259746808, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AKBIGEAXIDTA2AJBVZCM7YLZPB5Z7AVCNFSM6AAAAABK3KL6VWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDENJZG42DMOBQHA. You are receiving this because you were mentioned.Message ID: @.***>

DM-netizen commented 2 months ago

Okk I will try to implement it

joyhughes commented 2 months ago

I think a good way to start purely in C++ is to load an audio file from built-in storage (the same way it loads images, from lux_files directory).


From: Joy Hughes @.> Sent: Wednesday, July 31, 2024 4:14:24 AM To: joyhughes/Jen @.>; joyhughes/Jen @.> Cc: Mention @.> Subject: Re: [joyhughes/Jen] Sound Input (Issue #167)

We can probably get audio from the web browser https://web.dev/articles/media-recording-audio

Then process in C++.

Doing it in real time is a challenge


From: Joy Hughes @.> Sent: Wednesday, July 31, 2024 3:07:38 AM To: joyhughes/Jen @.>; joyhughes/Jen @.> Cc: Mention @.> Subject: Re: [joyhughes/Jen] Sound Input (Issue #167)

Yes, but I'm not sure exactly how to do it. We must find a cross platform open source library to get the sound input. A Jen function can be constructed that returns a floating point value that approximates the amplitude over a given frequency range and interval of time.


From: Disha Mukherjee @.> Sent: Tuesday, July 30, 2024 11:11:43 PM To: joyhughes/Jen @.> Cc: Joy Hughes @.>; Mention @.> Subject: Re: [joyhughes/Jen] Sound Input (Issue #167)

Hello @joyhugheshttps://github.com/joyhughes Can I take up this issue?

— Reply to this email directly, view it on GitHubhttps://github.com/joyhughes/Jen/issues/167#issuecomment-2259746808, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AKBIGEAXIDTA2AJBVZCM7YLZPB5Z7AVCNFSM6AAAAABK3KL6VWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDENJZG42DMOBQHA. You are receiving this because you were mentioned.Message ID: @.***>