search

explainers-by-googlers / prompt-api

A proposal for a web API for prompting browser-provided language models
Creative Commons Attribution 4.0 International
267 stars 20 forks source link

Plausible interoperability? #23

Closed slightlyoff closed 4 months ago

slightlyoff commented 4 months ago

Hey folks,

There have been conversations in our world about the difficulty in achieving plausible interoperability for this design. A layered version which relies on downloaded models that execute on WebNN with some solution for cross-origin sharing of models seems like it could be more plausibly interoperable.

I didn't see explorations of alternatives along these lines in the Explainer. Have they been considered?

ianand commented 4 months ago

For posterity, some discussion on interop in https://github.com/explainers-by-googlers/prompt-api/issues/9 as well.

domenic commented 4 months ago

Let's dupe this into #9. Note that this is discussed in https://github.com/explainers-by-googlers/prompt-api?tab=readme-ov-file#goals :

The following are explicit non-goals:

[...]

  • We do not intend to provide guarantees of language model quality, stability, or interoperability between browsers. In particular, we cannot guarantee that the models exposed by these APIs are particularly good at any given use case. These are left as quality-of-implementation issues, similar to the shape detection API. (See also a discussion of interop in the W3C "AI & the Web" document.)