search

Eladlev / AutoPrompt

A framework for prompt tuning using Intent-based Prompt Calibration
Apache License 2.0
1.86k stars 149 forks source link

Hope to support gemini #39

Closed Stanley-baby closed 4 months ago

Stanley-baby commented 4 months ago
  1. gemini has a free usage quota
  2. Convenient for users without OpenAI api

    Although OpenAI is currently the most cutting-edge llm, there is no doubt that using gemini can lower the threshold for use

Eladlev commented 4 months ago

Hi, Adding LLMs that are supported by langchain, is simple I've attached a PR specifically on googe_genai. In order to use Gemini you need to modify the config file:

llm:
    type: 'Google'
    name: 'gemini-pro'

One last thing, since Gemini doesn't support functions, you need to change the prompts path to the completion type:

meta_prompts:
    folder: 'prompts/meta_prompts_completion'

We will soon add documentation on using the system with non-OpenAI models.