search

explainers-by-googlers / prompt-api

A proposal for a web API for prompting browser-provided language models
Creative Commons Attribution 4.0 International
266 stars 20 forks source link

Supported devices? #24

Closed zerosrat closed 4 months ago

zerosrat commented 4 months ago

I enabled Enables optimization guide on device and Prompt API for Gemini Nano flags on Chrome Canary. Then running await window.ai.canCreateTextSession() returned no.

Device info: MacBook Pro + Apple M2 Pro.

Is this feature only supported on M3 Pro chip? Maybe it is better to list the supported devices.

christianliebel commented 4 months ago

Did you try rebooting and downloading the component as described here? That worked for me on my M1 Max.

zerosrat commented 4 months ago

  1. Ensure you’re running Chrome version 127.0.6512.0 or later My Chrome Canary version: Version 128.0.6598.0 (Official Build) canary (arm64)

  2. Enable the two flags chrome://flags/#optimization-guide-on-device-model and chrome://flags/#prompt-api-for-gemini-nano. My config:

    Screenshot 2024-07-16 at 22 38 26

  3. Find the Optimization Guide On Device Model component. I cannot find it

    Screenshot 2024-07-16 at 22 44 42

It seems that Optimization Guide On Device Model component is not found causes the problem.

I've tried to restart the chrome and mac, but Optimization Guide On Device Model component still not be found.

domenic commented 4 months ago

This appears to be about the Chrome web browser, and not the API proposal, so it's not on topic for this explainer. Please use https://crbug.com for Chromium-specific discussions.

christianliebel commented 4 months ago

@zerosrat Could you set chrome://flags/#optimization-guide-on-device-model to Enabled BypassPerfRequirement and try it again?