janhq / jan

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)
https://jan.ai/
GNU Affero General Public License v3.0
23.4k stars 1.36k forks source link

epic: Users can create Agents in Jan #2820

Open takeerdevs opened 6 months ago

takeerdevs commented 6 months ago

Motivation

Designs

I don't have a design prepared, but I have an idea on how it can be drafted, hopefully someone else may dive in!. On left pane where there is Jan Logo, we have Threads icon, which can allow user to chat with LLM, below that we have Hub, but before Hub, there should be an Icon for Agents i.e chatting with agents. In settings, we can have a settings section for Agents, like Creating an Agent that will allow creation of either AssistantAgent or UserProxyAgent etc., each agent can be set to specific LLM, which can be very useful since LLM's perform differently in different areas.

Jan server should be able to switch models i.e turning off current model then start another model that has been requested by specific agent. Jan normal chat can be turned off while chat with agents is active.

What will this Unlock? Jan has enabled chatting with LLM easily, but If AutoGen feature is integrated, Jan will be a powerful multi professional tool and can allow Jan to have access to internet with the help of AutoGen.

Use cases:

Creation of Agents can be delegated to users so they can control the flow of agents communication, code execution etc.. including making sure that docker is installed in the host machine if code execution will be involved.

This is just an Idea, If anyone else has this vision in mind, you can contribute where I haven't covered.. including defining Tasklist, GUI, technical advice etc.

mr-september commented 6 months ago

+1 for agents/swarm. Some of these repos might help: https://github.com/kyrolabs/awesome-agents

0xSage commented 2 months ago

Changed title to better reflect ask.