search

ryanontheinside / ComfyUI_RyanOnTheInside

Particle systems! Optical flow! Temporal masks! For ComfyUI!
175 stars 7 forks source link

Patch Matrix module? #6

Open kuzman123 opened 1 month ago

kuzman123 commented 1 month ago

Hello Ryan, I really enjoy using your modules and thank you for selflessly sharing them with the community. You will best understand what and what i mean by Patch Matrix module if you google "Erica synths matrix mixer". I think such a module would be very useful for 2 reasons:

  1. It would solve the "spaghetti" problem
  2. This way of working is very inspiring and intuitive. I believe that most users of your fantastic modules have no experience with signal "paths", except those who have used modular synths and are versed in subtractive synthesis. Color labeling of compatible modulation sources and destinations would help immeasurably to everyone, especially those who meet the aforementioned conditions (modular freaks like me), but don't know the difference between float and string. The other day i was unsuccessfully trying to externally modulate the angle parameter on the chromatic aberration node (converted to input). I tried all the nodes and functions that my little brain knows, but it kept telling me that it can't receive a float but only a string signal. ComfyUI on its own should have one such but universal module, with different colors for each type of signal. If you are willing to make such a thing, I am willing to help you as much as I know and can. I had a Nord Modular G2 for a long time, but unfortunately i had to sell it. I think its software editor can run without hardware. Maybe that would serve as a starting point for you, in case you embark on that adventure. https://www.nordkeyboards.com/legacy-products/nord-modular-g2/downloads/
kuzman123 commented 3 weeks ago

@ryanontheinside Midi is working fine :-) But we need something like audio separator, but for midi channels. I think 4 would be enough - drums, bass, melody and rest.... Can you do it? To be honest, i have a whole list of thing you should incorporate. I think the most important (IMHO) is some kind of sketch board, when you can draw your function. Just for IPAdapetr weight strategy, for the start.

ryanontheinside commented 3 weeks ago

Awesome! You should be able to achieve this separation by using multiple 'MIDI Load & Feature Extract' nodes, and using a different value for track_selection for each. Let me know if that's not what you meant!

kuzman123 commented 2 weeks ago

@ryanontheinside Since we have fully functional MIDI, can you integrate something like this? https://git.sr.ht/~hecanjog/pippi a simple Subtractive synth with midi input, 2 envelopes for osc and filter, and we can literary create music and picture together... What do you think? i also found this: https://wiki.python.org/moin/PythonInMusic

As soon as i have time i will test multiple midi setups :-)