search

ngxson / wllama

WebAssembly binding for llama.cpp - Enabling in-browser LLM inference
https://ngxson.github.io/wllama/examples/basic/
MIT License
231 stars 5 forks source link

Unreachable #62

Open flatsiedatsie opened 1 month ago

flatsiedatsie commented 1 month ago
Screenshot 2024-06-05 at 07 08 03
ngxson commented 1 month ago

Probably it's an issue of the browser (equivalent to segfault if run in native)

felladrin commented 1 month ago

I think the browser may be clearing the blobs from the memory when the tab gets suspended (after some time not being used).