RocketLR
commented
1 month ago I have an idea which i been wanting to implement.. Not sure if i have the skills or time tbh. But a useful feature would be to be able to cluster other machines which can host LLMs.
For example, you want to run the main LLM on your main server, but then have a bunch of other servers that can function as your agents.
Or have i lost sight here? I will try and understand how agent-zero works then see if i can implement something like this.
DoiiarX
This project is truly impressive. Based on my own experiments, the possibilities are limitless, and it already works exceptionally well. I have a couple of ideas to further enhance its capabilities:
Mixture-of-Agents Approach: The quality of some responses could be improved with a special additional tool that can handle this. The MoA approach is a novel technique that organizes multiple LLMs into a layered architecture, where each layer comprises multiple “agents” (individual LLMs). These agents collaborate by generating responses based on the outputs from agents in the previous layer, iteratively refining and improving the final output.
Improved Workflow Execution: Would it be possible to build a workflow where, if a user prompts "use this prompt," Agent-zero would check the prompt from the "prompts" folder and start executing it? While this is somewhat feasible already, I have noticed that some commands tend to overlap, disrupting the workflow or causing excessive and nested use of tools. Optimizing this process would greatly improve user experience and efficiency.
Integration with OpenWebUI Pipeline: Could this be developed into a tool for OpenWebUI's Pipeline? (Like this Groq MoA Pipeline) Combining these two would elevate open-source GPT tools directly into the heavyweight category, significantly enhancing their utility and reach.
Utilization of Open Search Engines: I strongly advocate for the use of open (re)search engines, such as SearXNG, Perplexica, Morphic.sh (on a personal instance), or of course DuckDuckGo. These options align well with the principles of open-source development and offer greater privacy and control over search data.
Thank you for considering these suggestions. I believe they can significantly contribute to the project's success and usability.