microsoft / autogen

A programming framework for agentic AI 🤖
https://microsoft.github.io/autogen/
Creative Commons Attribution 4.0 International
32.53k stars 4.74k forks source link

AutoGen hangs on querying LMStudio, not able to kill or start other workflow #1626

Open stevenbaert opened 8 months ago

stevenbaert commented 8 months ago

Describe the issue

No response

Steps to reproduce

  1. asked uncensored model running on LMStudio a standard censored (by other llms) question "how to break into a car?"
  2. Output uncensored model (see that in LMStudio) was there but AutoGenStudio wanted to create a script for it and failed/hung.
  3. There is no kill option or way to start other workflow once one is started

Screenshots and logs

No response

Additional Information

No response

victordibia commented 8 months ago

@sonichi .. is there a way to programatically interrupt an "in-progress" agent chat (ie a run of initiate_chat)?
Any pointers here will be helpful in crafting a solution that is lifted up into autogenstudio

sonichi commented 8 months ago

One plausible approach is to use the async method a_initiate_chat() and in a_check_termination_and_human_input() check an event's status which can be set outside.

victordibia commented 8 months ago

@sonichi, is there anyone else looking at this who can share insights? Maybe @ekzhu ?

It would be good if you can share more details on the async method you are referring to above or pointers to examples. Concretely, what is a code example where a chat can be initiated and then also terminated midway execution.

In the mean time, a developer experience that seems reasonable to me includes:

It's 100% possible I am thinking of this the wrong way, so happy to get thoughts.

victordibia commented 8 months ago

@jackgerrits , this is the issue I mentioned on the ability to terminate an agent run.