search

kardolus / chatgpt-cli

ChatGPT CLI is a versatile tool for interacting with ChatGPT models via OpenAI and Azure, as well as with models from Perplexity AI. It offers streaming, query mode, and history tracking for seamless, context-aware interactions. With extensive configuration options, it’s designed for both users and developers to create a tailored GPT experience.
MIT License
503 stars 34 forks source link

listModule interface design suggestions #55

Closed zzerding closed 3 months ago

zzerding commented 3 months ago

Description:

Currently, the ⁠listModule interface in Litelm uses the “gpt” prefix for all models. This makes it difficult to identify and use models other than GPT models.

Proposed Solutions:

  1. Remove the “gpt” prefix: This would make the interface more inclusive and allow users to easily identify all available models.
  2. Use parameters: Instead of hardcoding the “gpt” prefix, using a parameter to specify the model type would provide more flexibility and clarity. This would allow users to filter models based on specific criteria, such as model family or provider.

Expected Outcome:

Implementing one of these solutions would improve the user experience by: • Providing a clear and consistent interface for listing models. • Allowing users to easily identify and utilize models other than GPT models. • Enhancing the overall flexibility and usability of the ⁠listModule interface.

kardolus commented 3 months ago

@zzerding thanks for the suggestion! I am busy this weekend but am off all of next week. Will look into it!

kardolus commented 3 months ago

@zzerding is there any chance you could provide a permalink? There's no listModule interface in the code.

zzerding commented 3 months ago

https://github.com/kardolus/chatgpt-cli/blob/main/client/client.go#L82 For example, the litellm openai compatible interface model list I configured includes gpt- gemini- . gptchat -l can only list gpt models. My branch does not manage vendors, so I cannot give PR. You can refer to this commit.https://github.com/zzerding/chatgpt-cli/commit/03cc0bf1e907af54b14f964efa2705b85479accd#diff-bd3a55a72186f59e2e63efb4951573b2f9e4a7cc98086e922b0859f8ccc1dd09L82