[x] extend ProxyContext with an LLM class responsible for communicating with an LLM, as specified in the config. The class exposes the GenerateCompletion method which calls to LLM to get a completion for the specified prompt. If calling an LLM failed, it returns null.
[x] extend the OpenApiSpecGeneratorPlugin to use LLM for:
[x] generating operationId from the operation path and method
[x] generating operation description from the operation path and method
[x] generating API description from the list of operations and methods
[ ] publish docs to explain how to use an LLM with Dev Proxy
llmUrl
(optional, defaultnull
)model
(optional, default tophi3
)GenerateCompletion
method which calls to LLM to get a completion for the specified prompt. If calling an LLM failed, it returnsnull
.