Oneirocom / Magick

Magick is a cutting-edge toolkit for a new kind of AI builder. Make Magick with us!
https://magickml.com
Other
686 stars 112 forks source link

Task optimizations #1293

Closed michaelsharpe closed 1 year ago

michaelsharpe commented 1 year ago

What Changed:

Swicthed task plugin to use central store of tasks rather than hold them all in memory. Moved our rete fork to internal so we can modify and have control of the source code. Rete now lives in @magickml/rete.

How to test:

Load a large spell, like Rob Lennons big ugly one, and watch your system processes. There should be no huge spikes in memory and things should remain stable.

Ensure agents work, and spells fire off nodes are light up the node graph. This touches the task plugin, so should be well tested with a few different spells if possible. Alternative, we push it to dev and test it there and patch as needed. This is a major fix needed to stabilize infrastructure.

Additional information:

Any other information that might be useful while reviewing.

vercel[bot] commented 1 year ago

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
magick-client ✅ Ready (Inspect) Visit Preview 💬 Add feedback Sep 7, 2023 11:11pm
magick-docs ✅ Ready (Inspect) Visit Preview 💬 Add feedback Sep 7, 2023 11:11pm
michaelsharpe commented 1 year ago

@benbot lots of files touched and some formatting things also updated things. Main files to pay attention to changes in are taskPlugin/index and taskPlugin/task.js. Other changes to files were swapping to use internal rete rather than external.