search

lmstudio-ai / lmstudio-bug-tracker

Bug tracking for the LM Studio desktop application
10 stars 3 forks source link

Error 6 using Llama 3.x on Apple Silicon #150

Closed si2w closed 1 month ago

si2w commented 1 month ago

I tried LMStudio 0.3.4 on Apple Studio M2 Max 32 Gb (Ventura 13.5 (22G74)) with both llama 3.1 and 3.2 in MLX format. I don't get any response from LMStudio (Error 6). What's the issue ?

[2024-10-10 04:58:24.846] [info]  App starting...
[2024-10-10 04:58:25.572] [info]  Creating config map file at /Users/usr/.cache/lm-studio/config-presets/config.map.json
[2024-10-10 04:58:25.803] [info]  [AppUpdater] Checking for updates... (current state: idle)
[2024-10-10 04:58:25.803] [info]  AppUpdater state changed to checking-for-updates-periodic
[2024-10-10 04:58:25.803] [info]  [AppUpdater] Fetching version info from https://versions-prod.lmstudio.ai/darwin/arm64/0.3.4
[2024-10-10 04:58:26.160] [info]  [AppUpdater] Received version info response
[2024-10-10 04:58:26.160] [info]  [AppUpdater] Current version: 0.3.4 (build: 3), new version: 0.3.3 (build: undefined)
[2024-10-10 04:58:26.160] [info]  No update available: 0.3.3 (build: undefined) <= 0.3.4 (build: 3)
[2024-10-10 04:58:26.160] [info]  AppUpdater state changed to idle
[2024-10-10 04:58:26.818] [info]  Checking if LM Studio dev tools exist on the system...
[2024-10-10 04:58:26.830] [info]  LM Studio dev tools are not present, copying them over to .cache/lm-studio/bin...
[2024-10-10 05:05:18.253] [error] (node:99278) [DEP0147] DeprecationWarning: In future versions of Node.js, fs.rmdir(path, { recursive: true }) will be removed. Use fs.rm(path, { recursive: true }) instead
(Use `LM Studio --trace-deprecation ...` to show where the warning was created)
[2024-10-10 05:05:58.538] [error] (node:99278) MaxListenersExceededWarning: Possible EventEmitter memory leak detected. 11 child-exit listeners added to [f]. Use emitter.setMaxListeners() to increase limit
[2024-10-10 05:10:03.657] [error] [LMSInternal][Client=LM Studio][Endpoint=predict] Error in channel handler: Error: The model has crashed without additional information. (Exit code: 6)
    at f.o (/Applications/LM Studio.app/Contents/Resources/app/.webpack/main/index.js:8:1136932)
    at f.emit (node:events:525:35)
    at f.onChildExit (/Applications/LM Studio.app/Contents/Resources/app/.webpack/main/index.js:8:1123386)
    at ForkUtilityProcess.<anonymous> (/Applications/LM Studio.app/Contents/Resources/app/.webpack/main/index.js:8:1122992)
    at ForkUtilityProcess.emit (node:events:513:28)
    at ForkUtilityProcess.a.emit (node:electron/js2c/browser_init:2:68545)
[2024-10-10 05:10:03.659] [error] [LMSInternal][Client=LM Studio][Endpoint=sendMessage] Error in RPC handler: Error: Rehydrated error
crashed without additional information. (Exit code: 6)
    at t.fromSerializedError (/Applications/LM Studio.app/Contents/Resources/app/.webpack/main/index.js:242:62805)
    at s.subscriber (/Applications/LM Studio.app/Contents/Resources/app/.webpack/main/index.js:61:996)
    at s.notifier (/Applications/LM Studio.app/Contents/Resources/app/.webpack/main/index.js:82:97539)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
- Caused By: Error: Channel Error
    at t.DefaultGenerator.generate (/Applications/LM Studio.app/Contents/Resources/app/.webpack/main/index.js:64:40529)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
- Caused By: Error: The model has crashed without additional information. (Exit code: 6)
    at f.o (/Applications/LM Studio.app/Contents/Resources/app/.webpack/main/index.js:8:1136932)
    at f.emit (node:events:525:35)
    at f.onChildExit (/Applications/LM Studio.app/Contents/Resources/app/.webpack/main/index.js:8:1123386)
    at ForkUtilityProcess.<anonymous> (/Applications/LM Studio.app/Contents/Resources/app/.webpack/main/index.js:8:1122992)
    at ForkUtilityProcess.emit (node:events:513:28)
    at ForkUtilityProcess.a.emit (node:electron/js2c/browser_init:2:68545)
[2024-10-10 05:10:03.659] [error] Unhandled Rejection at: {} reason: Error: Rehydrated error
crashed without additional information. (Exit code: 6)
    at t.fromSerializedError (/Applications/LM Studio.app/Contents/Resources/app/.webpack/main/index.js:242:62805)
    at s.subscriber (/Applications/LM Studio.app/Contents/Resources/app/.webpack/main/index.js:61:996)
    at s.notifier (/Applications/LM Studio.app/Contents/Resources/app/.webpack/main/index.js:82:97539)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
- Caused By: Error: Channel Error
    at t.DefaultGenerator.generate (/Applications/LM Studio.app/Contents/Resources/app/.webpack/main/index.js:64:40529)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
- Caused By: Error: The model has crashed without additional information. (Exit code: 6)
    at f.o (/Applications/LM Studio.app/Contents/Resources/app/.webpack/main/index.js:8:1136932)
    at f.emit (node:events:525:35)
    at f.onChildExit (/Applications/LM Studio.app/Contents/Resources/app/.webpack/main/index.js:8:1123386)
    at ForkUtilityProcess.<anonymous> (/Applications/LM Studio.app/Contents/Resources/app/.webpack/main/index.js:8:1122992)
    at ForkUtilityProcess.emit (node:events:513:28)
    at ForkUtilityProcess.a.emit (node:electron/js2c/browser_init:2:68545)
[2024-10-10 05:10:03.667] [error] [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: TypeError: Cannot read properties of undefined (reading 'indexedModelRepresentation')
    at t.ModelLoadingProvider.getInstanceBySpecifierOrThrow (/Applications/LM Studio.app/Contents/Resources/app/.webpack/main/index.js:36:6666)
    at t.ModelLoadingProvider.getLLMModelBySpecifierOrThrow (/Applications/LM Studio.app/Contents/Resources/app/.webpack/main/index.js:36:8415)
    at Object.handler (/Applications/LM Studio.app/Contents/Resources/app/.webpack/main/index.js:58:80911)
    at t.ServerPort.receivedRpcCall (/Applications/LM Studio.app/Contents/Resources/app/.webpack/main/index.js:205:76)
    at a.receivedMessage (/Applications/LM Studio.app/Contents/Resources/app/.webpack/main/index.js:178:7825)
    at MessagePortMain.<anonymous> (/Applications/LM Studio.app/Contents/Resources/app/.webpack/main/index.js:178:6782)
    at MessagePortMain.emit (node:events:513:28)
    at MessagePortMain._internalPort.emit (node:electron/js2c/browser_init:2:99603)
[2024-10-10 05:10:03.670] [error] [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: TypeError: Cannot read properties of undefined (reading 'indexedModelRepresentation')
    at t.ModelLoadingProvider.getInstanceBySpecifierOrThrow (/Applications/LM Studio.app/Contents/Resources/app/.webpack/main/index.js:36:6666)
    at t.ModelLoadingProvider.getLLMModelBySpecifierOrThrow (/Applications/LM Studio.app/Contents/Resources/app/.webpack/main/index.js:36:8415)
    at Object.handler (/Applications/LM Studio.app/Contents/Resources/app/.webpack/main/index.js:58:80911)
    at t.ServerPort.receivedRpcCall (/Applications/LM Studio.app/Contents/Resources/app/.webpack/main/index.js:205:76)
    at a.receivedMessage (/Applications/LM Studio.app/Contents/Resources/app/.webpack/main/index.js:178:7825)
    at MessagePortMain.<anonymous> (/Applications/LM Studio.app/Contents/Resources/app/.webpack/main/index.js:178:6782)
    at MessagePortMain.emit (node:events:513:28)
    at MessagePortMain._internalPort.emit (node:electron/js2c/browser_init:2:99603)
pavele commented 1 month ago

I have a similar error - the exception is the same, the message is. MBP M2 Max, 32GB, 15.1 with LM-Studio 0.3.4 (build 4). The model that I'm trying to load is Qwen2-VL-7B-Instruct-4bit. The same happens with the other Qwen VL models. In the same time I'm able to use successfully llava-v1.6-mistral-7b-4bit, Llama-3.2-3B-Instruct-8bit, and Qwen2.5-Coder-7B-Instruct-8bit

🥲 Failed to load the model

Failed to load model

Error when loading model: ValueError: Model type qwen2_vl not supported.
yagil commented 1 month ago

Our Apple MLX engine currently only supports macOS 14 and up. Sorry for the inconvenience