alk0
commented
2 weeks ago (sigh) Look, I know I'm weird - my GPU and CPU are from Victorian era, and I'm on Linux. According to https://caniuse.com/webgpu WebGPU is not even enabled in Chrome engine on Linux by default, and I've no idea how to check if it would be available within that iframe adapter from under Obsidian that you use to run it. The error seems to originate from onnxruntime-web called by xenova/transformers (although I'm not 100% sure, given my lack of expertise in all this JS stuff).
brianpetro
AsfixGroup
Local embedding models don't work without a supported GPU anymore (2.1.96)
See the log below:
VM211 throws "WebAssembly SIMD is not supported in the current environment", then smart-connections says "model loaded" (it is not), then later VM211 throws "Error: Model not loaded" when trying to access it, and this is "Uncaught (in promise)" by smart-connections.
Questions:
partial log (click to fold/unfold)
plugin:smart-connections:12574 Loading Smart Connections v2... plugin:smart-connections:5870 opts {global_ref: global, env_path: '', env_data_dir: '.smart-connections', smart_env_settings: {…}, smart_chunks_class: ƒ, …} plugin:smart-connections:5959 smart_env_settings SmartEnvSettings {env: _SmartEnv, opts: {…}, _fs: SmartFs, _settings: {…}, _saved: true} plugin:smart-connections:7030 Parent changed, reloading plugin:smart-connections:10996 {model_key: 'TaylorAI/bge-micro-v2', batch_size: 1, dims: 384, max_tokens: 512, name: 'BGE-micro-v2', …} plugin:smart-connections:12085 loading iframe adapter {model_key: 'TaylorAI/bge-micro-v2', batch_size: 10, dims: 384, max_tokens: 512, name: 'BGE-micro-v2', …} VM211 about:srcdoc:306 init VM211 about:srcdoc:309 load {model_key: 'TaylorAI/bge-micro-v2', batch_size: 10, dims: 384, max_tokens: 512, name: 'BGE-micro-v2', …} VM211 about:srcdoc:132 {model_key: 'TaylorAI/bge-micro-v2', batch_size: 10, dims: 384, max_tokens: 512, name: 'BGE-micro-v2', …} VM211 about:srcdoc:236 [Transformers] Using GPU VM211 about:srcdoc:154 Error loading model TaylorAI/bge-micro-v2: Error: no available backend found. ERR: [webgpu] Error: WebAssembly SIMD is not supported in the current environment. at l (transformers@3.0.0-alpha.13:100:1798) at async e.create (transformers@3.0.0-alpha.13:100:18017) at async f (transformers@3.0.0-alpha.13:151:1428) at async transformers@3.0.0-alpha.13:175:14907 at async Promise.all (index 0) at async E (transformers@3.0.0-alpha.13:175:12934) at async Promise.all (index 0) at async U.from_pretrained (transformers@3.0.0-alpha.13:175:22072) at async uo.from_pretrained (transformers@3.0.0-alpha.13:175:55855) at async Promise.all (index 1) load @ VM211 about:srcdoc:154 await in load (async) processMessage @ VM211 about:srcdoc:310 (anonymous) @ VM211 about:srcdoc:338 postMessage (async) eval @ plugin:smart-connections:12124 _send_message @ plugin:smart-connections:12121 load @ plugin:smart-connections:12108 await in load (async) load @ plugin:smart-connections:11011 load_smart_embed @ plugin:smart-connections:9350 init @ plugin:smart-connections:9338 await in init (async) init @ plugin:smart-connections:10459 init @ plugin:smart-connections:8847 init_collections @ plugin:smart-connections:5971 init @ plugin:smart-connections:5961 plugin:smart-connections:12131 model loaded plugin:smart-connections:9340 SmartEmbed not loaded for smart_blocks. Continuing without embedding capabilities. plugin:smart-connections:5979 loading collection smart_sources plugin:smart-connections:9094 Loading smart_sources: 1075 items plugin:smart-connections:9101 Loaded smart_sources in 4002ms plugin:smart-connections:10576 Smart Connections: Processing import queue: 1 items plugin:smart-connections:10584 Smart Connections: Processed import queue in 110ms plugin:smart-connections:9501 Smart Connections: No active embedding model for smart_blocks, skipping embedding plugin:smart-connections:9506 Processing smart_sources embed queue: 1 items VM211 about:srcdoc:328 Error processing message: Error: Model not loaded at processMessage (VM211 about:srcdoc:315:17) at VM211 about:srcdoc:338:44 processMessage @ VM211 about:srcdoc:328 (anonymous) @ VM211 about:srcdoc:338 postMessage (async) eval @ plugin:smart-connections:12124 _send_message @ plugin:smart-connections:12121 embed_batch @ plugin:smart-connections:12150 embed_batch @ plugin:smart-connections:11042 process_embed_queue @ plugin:smart-connections:9513 await in process_embed_queue (async) process_import_queue @ plugin:smart-connections:10588 await in process_import_queue (async) process_load_queue @ plugin:smart-connections:10571 plugin:smart-connections:12136 Uncaught (in promise) Error: Model not loaded at SmartEmbedTransformersIframeAdapter._handle_message (plugin:smart-connections:12136:39) _handle_message @ plugin:smart-connections:12136 plugin:smart-connections:7030 Parent changed, reloading