search

e-p-armstrong / augmentoolkit

Convert Compute And Books Into Instruct-Tuning Datasets! Makes: QA, RP, Classifiers.
MIT License
1.03k stars 140 forks source link

[FEATURE] Add support for Gemini API #15

Closed alexandreteles closed 5 months ago

alexandreteles commented 6 months ago

With the release of the new Gemini 1.5 Flash model the Google LLMs have become more attractive while being competitive with alternatives like Mistral-Large. Although we can use alternatives like OpenRouter to run the requests against this model, having direct support would allow for cheaper and faster inference.

darkacorn commented 6 months ago

should be fairly easy as new engine

e-p-armstrong commented 6 months ago

I don't know if I can test this; I live in Canada so API access to the latest models is questionable at best. Would appreciate if someone living in a country that's not in the stone age of AI could test adding gemini support? I think it'd be good to have.

alexandreteles commented 6 months ago

I don't know if I can test this; I live in Canada so API access to the latest models is questionable at best. Would appreciate if someone living in a country that's not in the stone age of AI could test adding gemini support? I think it'd be good to have.

I can share a key for testing if that would help but sadly I don't have the time to implement the feature myself.