uripeled2 / llm-client-sdk

SDK for using LLM
MIT License
74 stars 11 forks source link

Add list models function in BaseLLMClient #27

Open uripeled2 opened 1 year ago

uripeled2 commented 1 year ago

We can add and abstract method to BaseLLMClient like: def list_models(**kwargs) -> list[str] And then we need to implement it in the different clients, we can add a static constants that will return the LLMs names or we can make a call to the relative urls. Here is OpenAI docs for this kind of endpoint: https://platform.openai.com/docs/api-reference/models/list