search

cryscan / web-rwkv

Implementation of the RWKV language model in pure WebGPU/Rust.
Other
231 stars 16 forks source link

TensorNotFound error appearing with v5 upgrade #8

Closed mal-sh closed 12 months ago

mal-sh commented 1 year ago

root@79532d12746a:/workspace/web-rwkv# cargo run --release --example chat -- --model assets/models/converted.st Finished release [optimized] target(s) in 0.07s Running target/release/examples/chat --model assets/models/converted.st error: XDG_RUNTIME_DIR not set in the environment. error: XDG_RUNTIME_DIR not set in the environment. error: XDG_RUNTIME_DIR not set in the environment. error: XDG_RUNTIME_DIR not set in the environment. ✔ Please select an adapter · NVIDIA RTX A4000 (Vulkan) error: XDG_RUNTIME_DIR not set in the environment. error: XDG_RUNTIME_DIR not set in the environment. error: XDG_RUNTIME_DIR not set in the environment. error: XDG_RUNTIME_DIR not set in the environment. AdapterInfo { name: "NVIDIA RTX A4000", vendor: 4318, device: 9392, device_type: DiscreteGpu, driver: "NVIDIA", driver_info: "535.104.05", backend: Vulkan, } thread 'main' panicked at 'called Result::unwrap() on an Err value: TensorNotFound("blocks.0.att.time_mix_g")', examples/chat.rs:263:34 note: run with RUST_BACKTRACE=1 environment variable to display a backtrace

cryscan commented 12 months ago

Seems that you are running v4 models. Currently the examples support v5 only (for quick test, but the library itself supports both versions), I will add support for detecting and loading both versions in the examples later.

cryscan commented 12 months ago

Hi! May you try the latest v0.3.1 build? It should detect the version automatically.

mal-sh commented 12 months ago

yes, it worked, I successfully loaded v4 models, thank you!