microsoft / autogen

A programming framework for agentic AI 🤖
https://microsoft.github.io/autogen/
Creative Commons Attribution 4.0 International
33.79k stars 4.88k forks source link

[Bug]: New skills are not added to skills.py and LLM can not "see" them #2506

Open cmcintosh opened 6 months ago

cmcintosh commented 6 months ago

Describe the bug

Reopening of a bug reported here: https://github.com/microsoft/autogen/issues/1610.

As confirmation steps, I have added the skills as a part of the agent, and workflow prior to posting.

Steps to reproduce

  1. Create a new skill, in this case I used https://gist.githubusercontent.com/business24ai/ffc275267b9c928805756fe6dace19b0/raw/c28e338f1a53664d12493f896a3a6abc01b50782/save_note_to_obsidian.py to save notes to obsidian.
  2. name the skill store_note_to_obsidian ( matches the method defined in the file).
  3. Add the skill to both the agent, and workflow as normal
  4. Perform a request, in this case i used the following: "Write a test note using obsidian to validate that you can. For this note name it AutoGen Studio Test, and then file the note with a summary of what AutoGen Studio 2.0 can do."

Model Used

gpt-4-1106-preview

Expected Behavior

The Agent should create a new file in the obsidian directory based on the information provided for the request.

Screenshots and logs

No response

Additional Information

First response primary_assistant ( to userproxy ):

To create a test note in Obsidian, you would typically open the Obsidian application, create a new note, and then write the content for the note. However, as an AI, I can't directly interact with applications or file systems. Instead, I can provide you with the Markdown content that you can use to create a note in Obsidian.

Here's the Markdown content for the note titled "AutoGen Studio Test" with a summary of what AutoGen Studio 2.0 can do:

...

userproxy ( to primary_assistant ) exitcode: 1 (execution failed) Code output: unknown language markdown

...

primary_assistant ( to userproxy ) It seems there was a misunderstanding. To create a note in Obsidian, you would typically do so manually within the Obsidian application, as it does not support direct creation of notes via code execution from an external source like this platform.

However, I can provide you with a Python script that will create a Markdown file on your local system, which you can then import into Obsidian. Please execute the following Python code to create the Markdown file:

.... CODE FILE ...

After running this script, a file named "AutoGen Studio Test.md" will be created in the current directory. You can then import this file into Obsidian by moving it to your Obsidian vault folder.

... userproxy ( to primary_assistant ) exitcode: 0 (execution succeeded) Code output: Note 'AutoGen Studio Test.md' has been created. You can now import this file into Obsidian. ... primary_assistant ( to userproxy ) Great! The Markdown file "AutoGen Studio Test.md" has been successfully created on your local system. To import this file into Obsidian, please follow these steps:

Locate the "AutoGen Studio Test.md" file in the directory where you ran the script. Open the Obsidian application. Navigate to the vault where you want to import the note. Move or copy the "AutoGen Studio Test.md" file into your Obsidian vault's directory using your file explorer. Once the file is in your Obsidian vault's directory, it should appear in your Obsidian file explorer within the application, and you can click on it to view the note.

If you have any further requests or need assistance with another task, feel free to ask. Otherwise, if you're all set, that concludes our session.

TERMINATE

PLEASE note, it did not actually created the note in the location. It did generate a file that was included as a part of the final resposne to the user.

ekzhu commented 6 months ago

@cmcintosh is this for autogen studio?