Open hemanth opened 5 months ago
Got the answer? i'm facing the same error with the int4-cpu model
Are you guys running this on Web? or Android? Would like to know your platforms?
web
I think it happens when i completely drain my gpu , so sometimes it runs sometimes it doesn't
The LLM Inference Task only supports GPU models on Web, gemma-2b-it-cpu-***.bin
models are not supported.
"For web applications, the model must be GPU-compatible." https://ai.google.dev/edge/mediapipe/solutions/genai/llm_inference/web_js#model
llm_inference
on local is throwing the below error forgemma-2b-it-cpu-int8.bin
onlygpu
backend type is supported?