search

pcc-capstone-2024 / capstone2024

0 stars 0 forks source link

Haptic vest integration #31

Open jmej opened 4 months ago

jmej commented 4 months ago

sound design considerations for vests:

shift frequencies down from HF to low frequency that works with the haptics convolution? FFT? maybe the range is 20hz to 200hz probably we will also need to design specific audio for the vests in addition to shifting down maybe some specific design inspired by the feeling of mycelium under footsteps is there a way to track vests as they move through the space

DillonSimeone commented 4 months ago

Jesse played around a bit with the haptic vests after class, he found it pretty easy to design things in Max and get the haptics responding. Fun stuff! Universal Music Design will be able to bring those vests on specific days for students interested in experimenting with them.

There's a few ways to track vest movements through spaces. https://www.youtube.com/watch?v=i7K-_zALYdg

This one is becoming really popular among my nerd friends lately, have me thinking about how nice it'd have the tree to become the origin point, and track the distance of vests from the tree via this method.

Likely will need to pipe the data back to a computer to generate specific sounds via max patches, then stream the sound over an ESP32 (Possibly the same festive tracker ESP32s!). https://www.adafruit.com/product/1712 i2c audio device, wire a 3.5mm jack in then plug into the vests, bam.

Might be easier to do local sound processing on the ESP32 instead... Something like a procedural sound generation process where the seed is your appx. coords away from the tree?

locationY * locationX ... Fancy math formula ... = magically generated never heard before sounds

Schnittk4 commented 4 months ago

Sweet, thanks!! Will try to check this out throughout the weekend

On Thu, Apr 18, 2024, 8:47 PM DillonSimeone @.***> wrote:

Jesse played around a bit with the haptic vests https://www.woojer.com/products/vest-3 after class, he found it pretty easy to design things in Max and get the haptics responding. Fun stuff!

There's a few ways to track vest movements through spaces. https://www.youtube.com/watch?v=i7K-_zALYdg

This one is becoming really popular among my nerd friends lately, have me thinking about how nice it'd have the tree to become the origin point, and track the distance of vests from the tree via this method.

Likely will need to pipe the data back to a computer to generate specific sounds via max patches, then stream the sound over an ESP32 (Possibly the same festive tracker ESP32s!). https://www.adafruit.com/product/1712 i2c audio device, wire a 3.5mm jack in then plug into the vests, bam.

Might be easier to do local sound processing on the ESP32 instead... Something like a procedural sound generation process where the seed is your appx. coords away from the tree?

locationY * locationX ... Fancy math formula ... = magically generated never heard before sounds

— Reply to this email directly, view it on GitHub https://github.com/pcc-capstone-2024/capstone2024/issues/31#issuecomment-2065695842, or unsubscribe https://github.com/notifications/unsubscribe-auth/BEQLQBRLE5BJVG7DLVNSAWLY6CHVBAVCNFSM6AAAAABGN54FH2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDANRVGY4TKOBUGI . You are receiving this because you were assigned.Message ID: @.***>

Schnittk4 commented 4 months ago

I kinda want to try making something cheaper, so that we could have more available for anyone to use. Does that sound ok?

DillonSimeone commented 4 months ago

I kinda want to try making something cheaper, so that we could have more available for anyone to use. Does that sound ok?

Something being haptic devices, specifically?

Universal Music Design is planning to order 40 of those Vest3 vests... Are you expecting more for the space?

Kek. Well, cheaper options would be haptic bracers. Vibrating Motors Motor driver ESP32 C6s LiPo battery

@jmej Asked me during the capstone classroom last week what I use to recharge LiPo batteries... I mentioned those modules, however, what makes the ESP32 C6 insanely awesome is that one of its many features is recharging batteries. There's an inbuilt battery recharger! Like, dude, look at the spec sheet for the ESP32 C6s, it's insane for what you pay. You can pretty much just connect a bunch of 5v solar panels to the ESP32, and... BAM, the battery gets tickle-charged! I've been wanting to build indoor solar stuff...

Solar panels for the tree's leaves? My lazy napkin math suggests that if I efficiently use the ESP32 family's deep sleep and wake abilities, I potentially can keep the batteries connected topped off!

ANYWAY. I had this on the top of my head because I actually already have all of this on my table, and is planning to start assembling bracers that'll sync up with the Vest3 vests via the vests' audio output port. (My personal bracers will sync up with my Quest 3 so I might be able to have haptics while using the headset's finger tracking.)

ESP32s are the future!

Schnittk4 commented 4 months ago

Ooh, ok. Yeah, I did not know there'd be that many

On Sat, Apr 20, 2024, 7:48 PM DillonSimeone @.***> wrote:

I kinda want to try making something cheaper, so that we could have more available for anyone to use. Does that sound ok?

Something being haptic devices, specifically?

Universal Music Design is planning to order 40 of those Vest3 vests... Are you expecting more for the space?

Kek. Well, cheaper options would be haptic bracers. Vibrating Motors https://www.amazon.com/gp/aw/d/B07Q1ZV4MJ/ Motor driver https://www.amazon.com/dp/B07X7MSGT4/ ESP32 C6s https://www.dfrobot.com/product-2778.html LiPo battery https://www.amazon.com/KBT-3-7V-1000mAh-Li-Polymer-Battery/dp/B0BJPJ9R6L/

@jmej https://github.com/jmej Asked me during the capstone classroom last week what I use to recharge LiPo batteries... I mentioned those modules https://www.adafruit.com/product/4410, however, what makes the ESP32 C6 insanely awesome is that one of its many features is recharging batteries. There's an inbuilt battery recharger! Like, dude, look at the spec sheet for the ESP32 C6s, it's insane. You can pretty much just connect a bunch of 5v solar panels to the ESP32, and... BAM, the battery gets tickle-charged! I've been wanting to build indoor solar stuff...

Solar panels https://www.amazon.com/FellDen-Panels-5V-Photovoltaic-110mmx60mm/dp/B0BML3PR4Z/ for the tree's leaves? My lazy napkin math suggests that if I efficiently use the ESP32 family's deep sleep and wake abilities, I potentially can keep the batteries connected topped off!

ANYWAY. I had this on the top of my head because I actually already have all of this on my table, and is planning to start assembling bracers that'll sync up with the Vest3 vests. (My personal bracers will sync up with my Quest 3 so I might be able to have haptics while using the headset's finger tracking.)

ESP32s are the future!

— Reply to this email directly, view it on GitHub https://github.com/pcc-capstone-2024/capstone2024/issues/31#issuecomment-2067869945, or unsubscribe https://github.com/notifications/unsubscribe-auth/BEQLQBQXZHFACYIKXIXASRTY6MSJLAVCNFSM6AAAAABGN54FH2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDANRXHA3DSOJUGU . You are receiving this because you were assigned.Message ID: @.***>

DillonSimeone commented 4 months ago

It's... very WIP. I'm actually not sure if the plan will be pushed through or cancelled, there's a lot of internal debuts going on about those vests. In order to save money and time, I've long removed myself from those internal debuts and have been focusing on the trees in front of me instead of the entire forest. I can shake down the project leader to see what's popping on that front next week.

I'd suggest assuming that the vests won't arrive in time. At worse, you'll have epic bracers that you can layer on top of what the vest3s already can do and can easily be reprogrammed for other purposes... Haptic effects from doing dragonball attacks in the middle of the school, with everyone giving you weird looks, kek!