search

microsoft / vscode

Visual Studio Code
https://code.visualstudio.com
MIT License
161.93k stars 28.46k forks source link

Expose more LLM capabilities to chat agents #203867

Open lijie-lee opened 7 months ago

lijie-lee commented 7 months ago

Hi VSCode team,

I'm a developer that currently want to build a chat agent by leveraging ChatAgentAPI.

Before I integrate my idea to agent, I've impletement some demo by calling OpenAI API. And capabilities of OpenAI API like "Function Calling" and "JSON Mode" are very helpful.

But when I makeRequest by ChatAgentAPI, I found there is no corresponding settings / parameters to enable those capabilities. That's a little tricky for me.

So I'm here for asking If there is a plan for ChatAgentAPI to support those capabilities?

Thanks so much.

roblourens commented 7 months ago

We aren't exposing the OpenAI API, we are actually exposing a different API that has a smaller feature set (although does use the OpenAI API under the hood). But I agree that it would be good to be able to expose features like this.

lijie-lee commented 7 months ago

@roblourens Is there any detail doc about the "a different API" in your words?

We aren't exposing the OpenAI API, we are actually exposing a different API that has a smaller feature set (although does use the OpenAI API under the hood). But I agree that it would be good to be able to expose features like this.

I'd like to know what capabilities the "a different API" offers currently. As far as I know, I could only post chat messages and get reseponse which like the "ChatCompletion" of the OpenAI API.

roblourens commented 7 months ago

The only capabilities are what you see here, just being able to send chat messages.