search

ngxson / wllama

WebAssembly binding for llama.cpp - Enabling in-browser LLM inference
https://ngxson.github.io/wllama/examples/basic/
MIT License
231 stars 5 forks source link

404-ed model still ended up in wllama_cache? #57

Closed flatsiedatsie closed 1 month ago

flatsiedatsie commented 1 month ago

Because I made a typo in the URL of a local model file I noticed something strange. It seems that invalid URL ended up in the wllama_cache anyway.

I checked to see if my code was perhaps adding the URL to the cache manually, but didn't think so, and also didn't find that.

The result is that my projects thinks the model is loaded, but then Wllama crashes when loading it.

Perhaps it cached the 404 page?

Screenshot 2024-05-24 at 13 08 37

(currently my code tries to recognise an event object, and see that as an indication that the (down)load process failed, and not the actual loading of the model itself. See also: https://github.com/ngxson/wllama/issues/56

felladrin commented 1 month ago

Oh yeah! I've faced this problem too!

ngxson commented 1 month ago

FYI, for the downloading function, I'm planning to replace XMLHttpRequest with modern fetch API. This should fix the problem.

ngxson commented 1 month ago

Resolved by #59 . Any invalid URL (which does not have status code 200) will be rejected by fetch API.