search

explainers-by-googlers / prompt-api

A proposal for a web API for prompting browser-provided language models
Creative Commons Attribution 4.0 International
267 stars 20 forks source link

Accessing non-instruction-tuned model variants #56

Open ACMCMC opened 2 weeks ago

ACMCMC commented 2 weeks ago

Hello!

Even though I acknowledge that a bigger share of developers could be interested in accessing instruction-tuned versions of Gemini (and that's the justified rationale behind the design choice of only including those), I think it would be a mistake to restrict all usages to IT versions.

The whole reason why non-IT models are offered is that there's genuine use cases for those models that merit attention.

In fact, if you take a quick look at the most downloaded HF text completion models, you'll see that most of them are non-IT versions.

I'm personally interested in that use case and I think that many others could be — it'd be great to have support for them!

ACMCMC commented 2 weeks ago

(I'd be happy to write this into a proper proposal but would like to gather other people's thoughts first)