search

microsoft / vscode

Visual Studio Code
https://code.visualstudio.com
MIT License
164.9k stars 29.52k forks source link

Expose more LLM capabilities to chat agents #203867

Open lijie-lee opened 10 months ago

lijie-lee commented 10 months ago

Hi VSCode team,

I'm a developer that currently want to build a chat agent by leveraging ChatAgentAPI.

Before I integrate my idea to agent, I've impletement some demo by calling OpenAI API. And capabilities of OpenAI API like "Function Calling" and "JSON Mode" are very helpful.

But when I makeRequest by ChatAgentAPI, I found there is no corresponding settings / parameters to enable those capabilities. That's a little tricky for me.

So I'm here for asking If there is a plan for ChatAgentAPI to support those capabilities?

Thanks so much.

roblourens commented 10 months ago

We aren't exposing the OpenAI API, we are actually exposing a different API that has a smaller feature set (although does use the OpenAI API under the hood). But I agree that it would be good to be able to expose features like this.

lijie-lee commented 10 months ago

@roblourens Is there any detail doc about the "a different API" in your words?

We aren't exposing the OpenAI API, we are actually exposing a different API that has a smaller feature set (although does use the OpenAI API under the hood). But I agree that it would be good to be able to expose features like this.

I'd like to know what capabilities the "a different API" offers currently. As far as I know, I could only post chat messages and get reseponse which like the "ChatCompletion" of the OpenAI API.

roblourens commented 10 months ago

The only capabilities are what you see here, just being able to send chat messages.