Can't load any model since 3.x upgrade

dynamiccreator commented 1 month ago

As for me no model is able to load anymore with versions higher then 2.x.

yagil commented 1 month ago

Please include:

which operating system
Which CPU
Which GPU
Which model exactly does not load?

Screenshots always help. Also specific errors

mrge-org commented 1 month ago

I am on Kubuntu 22.04 with 1 Intel® Xeon® Processor E3-1225 v3 and 32GB RAM (Edit: GPU is NVIDIA Quadro M4000). Just downloaded LM_Studio-0.3.4.AppImage and it starts, downloads Llama-3.2-1B-Instruct-Q8_0-GGUF but cannot load it and show the error: Failed to load the model

Error loading model.

(Exit code: 134). Please check settings and try loading the model again.

Experimenting with different settings does not help.

mrge-org commented 1 month ago

Did the same, this time from console and this is the log in it: (base) gpetrov@LE32:~/Downloads$ ./LM_Studio-0.3.4.AppImage 20:26:48.043 › App starting... [CachedFileDataProvider] Watching file at /home/gpetrov/.cache/lm-studio/.internal/backend-preferences-v1.json [SettingsProvider] Reading package.json at /tmp/.mount_LM_StuK60oiU/resources/app/package.json [CachedFileDataProvider] Watching file at /home/gpetrov/.config/LM Studio/settings.json [HttpServerProvider][SettingsFile] Initializing FileData [FileData] Initializing FileData [SystemResourcesProvider] Hardware survey successfully achieved through bundled 'vulkan' liblmstudio. 20:26:50.328 › Hardware survey for general system resources through 'vulkan' took 290.01ms [CachedFileDataProvider] Watching file at /home/gpetrov/.cache/lm-studio/.internal/model-data.json [PresetsProvider][PresetsIndexer] Creating index for path /home/gpetrov/.cache/lm-studio/config-presets [PresetsProvider][PresetsIndexer] Creating index for path /home/gpetrov/.cache/lm-studio/config-presets/chatml.preset.json [PresetsProvider][PresetsIndexer] Creating index for path /home/gpetrov/.cache/lm-studio/config-presets/codellama_instruct.preset.json [PresetsProvider][PresetsIndexer] Creating index for path /home/gpetrov/.cache/lm-studio/config-presets/cohere_command_r.preset.json [PresetsProvider][PresetsIndexer] Creating index for path /home/gpetrov/.cache/lm-studio/config-presets/config.map.json [PresetsProvider][PresetsIndexer] Creating index for path /home/gpetrov/.cache/lm-studio/config-presets/deepseek_coder.preset.json [PresetsProvider][PresetsIndexer] Creating index for path /home/gpetrov/.cache/lm-studio/config-presets/falcon.preset.json [PresetsProvider][PresetsIndexer] Creating index for path /home/gpetrov/.cache/lm-studio/config-presets/google_gemma_instruct.preset.json [PresetsProvider][PresetsIndexer] Creating index for path /home/gpetrov/.cache/lm-studio/config-presets/ibm_granite.preset.json [PresetsProvider][PresetsIndexer] Creating index for path /home/gpetrov/.cache/lm-studio/config-presets/llama_3_v2.preset.json [PresetsProvider][PresetsIndexer] Creating index for path /home/gpetrov/.cache/lm-studio/config-presets/metaai_llama_2_chat.preset.json [PresetsProvider][PresetsIndexer] Creating index for path /home/gpetrov/.cache/lm-studio/config-presets/mistral_instruct.preset.json [PresetsProvider][PresetsIndexer] Creating index for path /home/gpetrov/.cache/lm-studio/config-presets/openchat.preset.json [PresetsProvider][PresetsIndexer] Creating index for path /home/gpetrov/.cache/lm-studio/config-presets/phi_2.preset.json [PresetsProvider][PresetsIndexer] Creating index for path /home/gpetrov/.cache/lm-studio/config-presets/phi_3.preset.json [PresetsProvider][PresetsIndexer] Creating index for path /home/gpetrov/.cache/lm-studio/config-presets/phind_codellama.preset.json [PresetsProvider][PresetsIndexer] Creating index for path /home/gpetrov/.cache/lm-studio/config-presets/starcoder_2_instruct.preset.json [PresetsProvider][PresetsIndexer] Creating index for path /home/gpetrov/.cache/lm-studio/config-presets/vicuna_v1_5_16k.preset.json [PresetsProvider][PresetsIndexer] Creating index for path /home/gpetrov/.cache/lm-studio/config-presets/zephyr.preset.json [LLMExternalAPIProvider] Creating HTTP server extender [LLMExternalAPIProvider] Registering IPC server [EmbeddingExternalAPIProvider] Creating HTTP server extender [EmbeddingExternalAPIProvider] Registering IPC server [PlatformExternalAPIProvider] Creating HTTP server extender [PlatformExternalAPIProvider] Registering IPC server [SystemExternalAPIProvider] Creating HTTP server extender [SystemExternalAPIProvider] Registering IPC server [DiagnosticsExternalAPIProvider] Creating HTTP server extender [DiagnosticsExternalAPIProvider] Registering IPC server [RetrievalExternalAPIProvider] Creating HTTP server extender [RetrievalExternalAPIProvider] Registering IPC server [FilesExternalAPIProvider] Creating HTTP server extender [FilesExternalAPIProvider] Registering IPC server [LMSInternal][Client=LM Studio] Client created. Client with id 'LM Studio' registered. [ConversationsProvider][Indexer] Creating index for path /home/gpetrov/.cache/lm-studio/conversations [ConversationsProvider][Indexer] Creating index for path /home/gpetrov/.cache/lm-studio/conversations/1729182403129.conversation.json [ConversationsProvider][Indexer] Creating index for path /home/gpetrov/.cache/lm-studio/conversations/1729182685122.conversation.json [ConversationsProvider][ConfigFile] Initializing FileData 20:26:50.542 › [AppUpdater] Checking for updates... (current state: idle) 20:26:50.542 › AppUpdater state changed to checking-for-updates-periodic 20:26:50.543 › [AppUpdater] Fetching version info from https://versions-prod.lmstudio.ai/linux/x86/0.3.4 [DeepLinkHandlingExternalAPIProvider] Registering IPC server [AppSettingsInternalAPIProvider] Registering IPC server [ModelIndexInternalAPIProvider] Registering IPC server [ContextMenuInternalAPIProvider] Registering IPC server [ConversationsInternalAPIProvider] Registering IPC server [HttpServerInternalAPIProvider] Registering IPC server [SearchInternalAPIProvider] Registering IPC server [ModelLoadingInternalAPIProvider] Registering IPC server [LLMInstanceStateInternalAPIProvider] Registering IPC server [TransientStorageInternalAPIProvider] Registering IPC server [RuntimeIndexInternalAPIProvider] Registering IPC server [DownloadsAPIProvider] Registering IPC server [UserFilesInternalAPIProvider] Registering IPC server [SystemResourcesInternalAPIProvider] Registering IPC server [SoftwareUpdateInternalAPIProvider] Registering IPC server [BackendDownloadInternalAPIProvider] Registering IPC server [PredictionProcessInternalAPIProvider] Registering IPC server [UserModelDefaultConfigInternalAPIProvider] Registering IPC server [VirtualModelInternalAPIProvider] Registering IPC server [PathOpenerInternalAPIProvider] Registering IPC server [ModelDataInternalAPIProvider] Registering IPC server [PresetsInternalAPIProvider] Registering IPC server [ServerSessionInternalAPIProvider] Registering IPC server [LMStudioClient][LLM][Generator (LM Studio Default Generator)] Register to LM Studio [LMStudioClient][LLM][Preprocessor (legacyRagPromptPreprocessor)] Register to LM Studio [LMSInternal][Client=LM Studio][Endpoint=registerGenerator] Registering generator with identifier: LM Studio Default Generator [LMSInternal][Client=LM Studio][Endpoint=registerPreprocessor] Registering preprocessor with identifier: legacyRagPromptPreprocessor [FileWatchingProvider] Start syncing file watching provider... Changes may be missed during this process. [FileWatchingProvider][Watcher-0] Sync: Subscribing to /home/gpetrov/.cache/lm-studio/.internal [FileWatchingProvider][Watcher-1] Sync: Subscribing to /home/gpetrov/.config/LM Studio [FileWatchingProvider][Watcher-2] Sync: Subscribing to /home/gpetrov/.cache/lm-studio/extensions/backends [FileWatchingProvider][Watcher-3] Sync: Subscribing to /home/gpetrov/.cache/lm-studio/user-files [FileWatchingProvider][Watcher-4] Sync: Subscribing to /home/gpetrov/.cache/lm-studio/config-presets [FileWatchingProvider][Watcher-5] Sync: Subscribing to /home/gpetrov/.cache/lm-studio/conversations [FileWatchingProvider] Sync completed. 20:26:51.022 › [AppUpdater] Received version info response [SettingsProvider] Reading package.json at /tmp/.mount_LM_StuK60oiU/resources/app/package.json 20:26:51.024 › [AppUpdater] Current version: 0.3.4 (build: 3), new version: 0.3.0 (build: undefined) 20:26:51.024 › No update available: 0.3.0 (build: undefined) <= 0.3.4 (build: 3) 20:26:51.025 › AppUpdater state changed to idle [CachedFileDataProvider] Ignoring file change event due to recent write. Path: /home/gpetrov/.config/LM Studio/settings.json [DelayedInitProvider] Running delayed init: ModelIndexProvider [ModelIndexProvider] Directory added: /home/gpetrov/.cache/lm-studio/models 20:26:51.566 › Checking if LM Studio dev tools exist on the system... [ModelIndexProvider][Op-1] Requested to index directory: /home/gpetrov/.cache/lm-studio/models [ModelIndexProvider][Op-1] Starting indexing operation on directory: /home/gpetrov/.cache/lm-studio/models [ModelIndexProvider] Directory added: /tmp/.mount_LM_StuK60oiU/resources/app/.webpack/main/bundled-models [ModelIndexProvider][Op-2] Requested to index directory: /tmp/.mount_LM_StuK60oiU/resources/app/.webpack/main/bundled-models [ModelIndexProvider][Op-2] Starting indexing operation on directory: /tmp/.mount_LM_StuK60oiU/resources/app/.webpack/main/bundled-models [FileWatchingProvider] Start syncing file watching provider... Changes may be missed during this process. [FileWatchingProvider][Watcher-6] Sync: Subscribing to /home/gpetrov/.cache/lm-studio/models 20:26:51.583 › LM Studio dev tools are not present, copying them over to .cache/lm-studio/bin... [FileWatchingProvider][Watcher-7] Sync: Subscribing to /tmp/.mount_LM_StuK60oiU/resources/app/.webpack/main/bundled-models [GGUFMetadataProvider] Returning cached GGUF metadata for /home/gpetrov/.cache/lm-studio/models/hugging-quants/Llama-3.2-1B-Instruct-Q8_0-GGUF/llama-3.2-1b-instruct-q8_0.gguf [ModelIndexProvider][Op-1] Finished indexing operation on directory: /home/gpetrov/.cache/lm-studio/models [FileWatchingProvider] Sync completed. [GGUFMetadataProvider] Reading GGUF metadata for /tmp/.mount_LM_StuK60oiU/resources/app/.webpack/main/bundled-models/nomic-ai/nomic-embed-text-v1.5-GGUF/nomic-embed-text-v1.5.Q4_K_M.gguf took 87ms [ModelIndexProvider][Op-2] Finished indexing operation on directory: /tmp/.mount_LM_StuK60oiU/resources/app/.webpack/main/bundled-models [CachedFileDataProvider] Watching file at /home/gpetrov/.cache/lm-studio/conversations/1729182685122.conversation.json [CachedFileDataProvider] Watching file at /home/gpetrov/.cache/lm-studio/.internal/user-concrete-model-default-config/.json [CachedFileDataProvider] File at /home/gpetrov/.cache/lm-studio/.internal/gguf-metadata-cache.json is no longer used. Releasing... [CachedFileDataProvider] Watching file at /home/gpetrov/.cache/lm-studio/.internal/user-concrete-model-default-config/hugging-quants/Llama-3.2-1B-Instruct-Q8_0-GGUF/llama-3.2-1b-instruct-q8_0.gguf.json [CachedFileDataProvider] Ignoring file change event due to recent write. Path: /home/gpetrov/.cache/lm-studio/.internal/user-concrete-model-default-config/hugging-quants/Llama-3.2-1B-Instruct-Q8_0-GGUF/llama-3.2-1b-instruct-q8_0.gguf.json [CachedFileDataProvider] Ignoring file change event due to recent write. Path: /home/gpetrov/.cache/lm-studio/.internal/user-concrete-model-default-config/hugging-quants/Llama-3.2-1B-Instruct-Q8_0-GGUF/llama-3.2-1b-instruct-q8_0.gguf.json UNLOADINTERNAL CALLED Error at f.unloadInternal (/tmp/.mount_LM_StuK60oiU/resources/app/.webpack/main/index.js:8:1145478) at f.unload (/tmp/.mount_LM_StuK60oiU/resources/app/.webpack/main/index.js:8:1146237) at /tmp/.mount_LM_StuK60oiU/resources/app/.webpack/main/index.js:8:1145251 at process.processTicksAndRejections (node:internal/process/task_queues:95:5) 20:27:04.430 › [LMSInternal][Client=LM Studio][Endpoint=loadModel] Error in channel handler: Error: Error loading model. at f.d (/tmp/.mount_LM_StuK60oiU/resources/app/.webpack/main/index.js:8:1144727) at f.emit (node:events:513:28) at f.onChildExit (/tmp/.mount_LM_StuK60oiU/resources/app/.webpack/main/index.js:8:1121044) at ForkUtilityProcess. (/tmp/.mount_LM_StuK60oiU/resources/app/.webpack/main/index.js:8:1120650) at ForkUtilityProcess.emit (node:events:513:28) at ForkUtilityProcess.a.emit (node:electron/js2c/browser_init:2:68545) 20:27:05.433 › [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: Error: Model is unloaded. at /tmp/.mount_LM_StuK60oiU/resources/app/.webpack/main/index.js:8:1142606 20:27:05.434 › [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: Error: Model is unloaded. at /tmp/.mount_LM_StuK60oiU/resources/app/.webpack/main/index.js:8:1142606 20:27:05.435 › [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: Error: Model is unloaded. at /tmp/.mount_LM_StuK60oiU/resources/app/.webpack/main/index.js:8:1142606 20:27:05.436 › [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: Error: Model is unloaded. at /tmp/.mount_LM_StuK60oiU/resources/app/.webpack/main/index.js:8:1142606 20:27:05.437 › [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: Error: Model is unloaded. at /tmp/.mount_LM_StuK60oiU/resources/app/.webpack/main/index.js:8:1142606 20:27:05.438 › Unhandled Rejection at: {} reason: Error: Model is unloaded. at /tmp/.mount_LM_StuK60oiU/resources/app/.webpack/main/index.js:8:1142606 20:27:05.443 › Unhandled Rejection at: {} reason: Error: Model is unloaded. at /tmp/.mount_LM_StuK60oiU/resources/app/.webpack/main/index.js:8:1142606 20:27:05.444 › Unhandled Rejection at: {} reason: Error: Model is unloaded. at /tmp/.mount_LM_StuK60oiU/resources/app/.webpack/main/index.js:8:1142606 20:27:05.444 › Unhandled Rejection at: {} reason: Error: Model is unloaded. at /tmp/.mount_LM_StuK60oiU/resources/app/.webpack/main/index.js:8:1142606 20:27:05.445 › Unhandled Rejection at: {} reason: Error: Model is unloaded. at /tmp/.mount_LM_StuK60oiU/resources/app/.webpack/main/index.js:8:1142606 20:27:05.455 › [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: TypeError: Cannot read properties of undefined (reading 'indexedModelRepresentation') at t.ModelLoadingProvider.getInstanceBySpecifierOrThrow (/tmp/.mount_LM_StuK60oiU/resources/app/.webpack/main/index.js:36:6666) at t.ModelLoadingProvider.getLLMModelBySpecifierOrThrow (/tmp/.mount_LM_StuK60oiU/resources/app/.webpack/main/index.js:36:8415) at Object.handler (/tmp/.mount_LM_StuK60oiU/resources/app/.webpack/main/index.js:58:80911) at t.ServerPort.receivedRpcCall (/tmp/.mount_LM_StuK60oiU/resources/app/.webpack/main/index.js:205:76) at a.receivedMessage (/tmp/.mount_LM_StuK60oiU/resources/app/.webpack/main/index.js:178:7825) at MessagePortMain. (/tmp/.mount_LM_StuK60oiU/resources/app/.webpack/main/index.js:178:6782) at MessagePortMain.emit (node:events:513:28) at MessagePortMain._internalPort.emit (node:electron/js2c/browser_init:2:99603) 20:27:05.474 › [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: TypeError: Cannot read properties of undefined (reading 'indexedModelRepresentation') at t.ModelLoadingProvider.getInstanceBySpecifierOrThrow (/tmp/.mount_LM_StuK60oiU/resources/app/.webpack/main/index.js:36:6666) at t.ModelLoadingProvider.getLLMModelBySpecifierOrThrow (/tmp/.mount_LM_StuK60oiU/resources/app/.webpack/main/index.js:36:8415) at Object.handler (/tmp/.mount_LM_StuK60oiU/resources/app/.webpack/main/index.js:58:80911) at t.ServerPort.receivedRpcCall (/tmp/.mount_LM_StuK60oiU/resources/app/.webpack/main/index.js:205:76) at a.receivedMessage (/tmp/.mount_LM_StuK60oiU/resources/app/.webpack/main/index.js:178:7825) at MessagePortMain. (/tmp/.mount_LM_StuK60oiU/resources/app/.webpack/main/index.js:178:6782) at MessagePortMain.emit (node:events:513:28) at MessagePortMain._internalPort.emit (node:electron/js2c/browser_init:2:99603) [CachedFileDataProvider] File at /home/gpetrov/.cache/lm-studio/.internal/user-concrete-model-default-config/hugging-quants/Llama-3.2-1B-Instruct-Q8_0-GGUF/llama-3.2-1b-instruct-q8_0.gguf.json is no longer used. Releasing...

gurusura commented 1 month ago

Screenshot at 2024-10-18 10-22-58 I have been unable to use lmstudio since the 0.3.1 series updates. I get the error when I load any model.

🥲 Failed to load the model

Failed to load model

unable to allocate backend buffer

My system: Distributor ID: Ubuntu Description: Ubuntu 24.04.1 LTS Release: 24.04 Codename: noble

I tried using the more recent 1.3gb sized models such as llama 3.2 1B. How do I solve this issue? Is there any work around? Let me know. Thanks.

noREAVER commented 4 weeks ago

Today LM-Studio 0.3.5 on both of my PCs (windows 10 and Windows 11 up to date updates and drivers for nvidia) stopped working. No models could be loaded anymore, either already downloaded that worked until today without any changes, or fresh installed ones.

🥲 Failed to load the model

Error loading model.

(Exit code: -1073740791). Unknown error. Try a different model and/or config.

or

🥲 Failed to load the model

Error loading model.

(Exit code: 0). Some model operation failed. Try a different model and/or config.

[2024-10-24 13:20:42.906] [info]  App starting...
[2024-10-24 13:20:44.780] [info]  Hardware survey for general system resources through 'vulkan' took 214.35ms
[2024-10-24 13:20:44.988] [info]  [AppUpdater] Checking for updates... (current state: idle)
[2024-10-24 13:20:44.992] [info]  AppUpdater state changed to checking-for-updates-periodic
[2024-10-24 13:20:44.996] [info]  [AppUpdater] Fetching version info from https://versions-prod.lmstudio.ai/win32/x86/0.3.5
[2024-10-24 13:20:45.399] [info]  [AppUpdater] Received version info response
[2024-10-24 13:20:45.405] [info]  [AppUpdater] Current version: 0.3.5 (build: 2), new version: 0.3.5 (build: undefined)
[2024-10-24 13:20:45.472] [info]  No update available: 0.3.5 (build: undefined) <= 0.3.5 (build: 2)
[2024-10-24 13:20:45.478] [info]  AppUpdater state changed to idle
[2024-10-24 13:20:46.053] [info]  Checking if LM Studio dev tools exist on the system...
[2024-10-24 13:20:46.358] [info]  LM Studio dev tools v0.0.27 exist
[2024-10-24 13:20:46.364] [info]  LM Studio dev tools are not present, copying them over to .cache/lm-studio/bin...
[2024-10-24 13:20:46.374] [error] Failed to install LM Studio command line tool (lms) Error: EPERM: operation not permitted, copyfile 'C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\lms.exe' -> 'C:\Users\XXXX\.cache\lm-studio\bin\lms.exe'
[2024-10-24 13:22:24.900] [info]  App starting...
[2024-10-24 13:22:26.860] [info]  Hardware survey for general system resources through 'vulkan' took 249.24ms
[2024-10-24 13:22:27.068] [info]  [AppUpdater] Checking for updates... (current state: idle)
[2024-10-24 13:22:27.074] [info]  AppUpdater state changed to checking-for-updates-periodic
[2024-10-24 13:22:27.079] [info]  [AppUpdater] Fetching version info from https://versions-prod.lmstudio.ai/win32/x86/0.3.5
[2024-10-24 13:22:27.543] [info]  [AppUpdater] Received version info response
[2024-10-24 13:22:27.549] [info]  [AppUpdater] Current version: 0.3.5 (build: 2), new version: 0.3.5 (build: undefined)
[2024-10-24 13:22:27.555] [info]  No update available: 0.3.5 (build: undefined) <= 0.3.5 (build: 2)
[2024-10-24 13:22:27.560] [info]  AppUpdater state changed to idle
[2024-10-24 13:22:28.141] [info]  Checking if LM Studio dev tools exist on the system...
[2024-10-24 13:22:28.446] [info]  LM Studio dev tools v0.0.27 exist
[2024-10-24 13:22:28.452] [info]  LM Studio dev tools are not present, copying them over to .cache/lm-studio/bin...
[2024-10-24 13:23:50.075] [error] [LMSInternal][Client=LM Studio][Endpoint=loadModel] Error in channel handler: Error: Error loading model.
    at f.d (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1148205)
    at f.emit (node:events:513:28)
    at f.onChildExit (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1124523)
    at ForkUtilityProcess.<anonymous> (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1124129)
    at ForkUtilityProcess.emit (node:events:513:28)
    at ForkUtilityProcess.a.emit (node:electron/js2c/browser_init:2:68499)
[2024-10-24 13:23:51.102] [error] [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:23:51.113] [error] [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:23:51.120] [error] [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:23:51.125] [error] [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:23:51.129] [error] [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:23:51.133] [error] [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:23:51.136] [error] Unhandled Rejection at: {} reason: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:23:51.140] [error] Unhandled Rejection at: {} reason: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:23:51.143] [error] Unhandled Rejection at: {} reason: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:23:51.147] [error] Unhandled Rejection at: {} reason: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:23:51.150] [error] Unhandled Rejection at: {} reason: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:23:51.154] [error] Unhandled Rejection at: {} reason: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:23:51.157] [error] [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: TypeError: Cannot read properties of undefined (reading 'indexedModelRepresentation')
    at t.ModelLoadingProvider.getInstanceBySpecifierOrThrow (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:39:6892)
    at t.ModelLoadingProvider.getLLMModelBySpecifierOrThrow (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:39:8641)
    at Object.handler (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:65:82570)
    at t.ServerPort.receivedRpcCall (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:222:76)
    at a.receivedMessage (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:195:7825)
    at MessagePortMain.<anonymous> (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:195:6782)
    at MessagePortMain.emit (node:events:513:28)
    at MessagePortMain._internalPort.emit (node:electron/js2c/browser_init:2:99562)
[2024-10-24 13:23:51.163] [error] [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: TypeError: Cannot read properties of undefined (reading 'indexedModelRepresentation')
    at t.ModelLoadingProvider.getInstanceBySpecifierOrThrow (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:39:6892)
    at t.ModelLoadingProvider.getLLMModelBySpecifierOrThrow (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:39:8641)
    at Object.handler (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:65:82570)
    at t.ServerPort.receivedRpcCall (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:222:76)
    at a.receivedMessage (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:195:7825)
    at MessagePortMain.<anonymous> (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:195:6782)
    at MessagePortMain.emit (node:events:513:28)
    at MessagePortMain._internalPort.emit (node:electron/js2c/browser_init:2:99562)
[2024-10-24 13:35:02.360] [error] [LMSInternal][Client=LM Studio][Endpoint=loadModel] Error in channel handler: Error: Error loading model.
    at f.d (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1148205)
    at f.emit (node:events:513:28)
    at f.onChildExit (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1124523)
    at ForkUtilityProcess.<anonymous> (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1124129)
    at ForkUtilityProcess.emit (node:events:513:28)
    at ForkUtilityProcess.a.emit (node:electron/js2c/browser_init:2:68499)
[2024-10-24 13:35:03.406] [error] [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:35:03.414] [error] [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:35:03.419] [error] [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:35:03.425] [error] [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:35:03.433] [error] [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:35:03.438] [error] Unhandled Rejection at: {} reason: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:35:03.442] [error] Unhandled Rejection at: {} reason: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:35:03.446] [error] Unhandled Rejection at: {} reason: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:35:03.450] [error] Unhandled Rejection at: {} reason: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:35:03.453] [error] Unhandled Rejection at: {} reason: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:35:03.458] [error] [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: TypeError: Cannot read properties of undefined (reading 'indexedModelRepresentation')
    at t.ModelLoadingProvider.getInstanceBySpecifierOrThrow (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:39:6892)
    at t.ModelLoadingProvider.getLLMModelBySpecifierOrThrow (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:39:8641)
    at Object.handler (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:65:82570)
    at t.ServerPort.receivedRpcCall (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:222:76)
    at a.receivedMessage (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:195:7825)
    at MessagePortMain.<anonymous> (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:195:6782)
    at MessagePortMain.emit (node:events:513:28)
    at MessagePortMain._internalPort.emit (node:electron/js2c/browser_init:2:99562)
[2024-10-24 13:35:03.463] [error] [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: TypeError: Cannot read properties of undefined (reading 'indexedModelRepresentation')
    at t.ModelLoadingProvider.getInstanceBySpecifierOrThrow (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:39:6892)
    at t.ModelLoadingProvider.getLLMModelBySpecifierOrThrow (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:39:8641)
    at Object.handler (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:65:82570)
    at t.ServerPort.receivedRpcCall (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:222:76)
    at a.receivedMessage (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:195:7825)
    at MessagePortMain.<anonymous> (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:195:6782)
    at MessagePortMain.emit (node:events:513:28)
    at MessagePortMain._internalPort.emit (node:electron/js2c/browser_init:2:99562)
[2024-10-24 13:38:00.357] [info]  App starting...
[2024-10-24 13:38:02.413] [info]  Hardware survey for general system resources through 'vulkan' took 295.07ms
[2024-10-24 13:38:02.612] [info]  [AppUpdater] Checking for updates... (current state: idle)
[2024-10-24 13:38:02.619] [info]  AppUpdater state changed to checking-for-updates-periodic
[2024-10-24 13:38:02.626] [info]  [AppUpdater] Fetching version info from https://versions-prod.lmstudio.ai/win32/x86/0.3.5
[2024-10-24 13:38:03.327] [info]  [AppUpdater] Received version info response
[2024-10-24 13:38:03.335] [info]  [AppUpdater] Current version: 0.3.5 (build: 2), new version: 0.3.5 (build: undefined)
[2024-10-24 13:38:03.341] [info]  No update available: 0.3.5 (build: undefined) <= 0.3.5 (build: 2)
[2024-10-24 13:38:03.348] [info]  AppUpdater state changed to idle
[2024-10-24 13:38:03.731] [info]  Checking if LM Studio dev tools exist on the system...
[2024-10-24 13:38:04.034] [info]  LM Studio dev tools v0.0.27 exist
[2024-10-24 13:38:04.041] [info]  LM Studio dev tools are not present, copying them over to .cache/lm-studio/bin...
[2024-10-24 13:39:42.464] [error] [LMSInternal][Client=LM Studio][Endpoint=loadModel] Error in channel handler: Error: Error loading model.
    at f.d (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1148205)
    at f.emit (node:events:513:28)
    at f.onChildExit (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1124523)
    at ForkUtilityProcess.<anonymous> (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1124129)
    at ForkUtilityProcess.emit (node:events:513:28)
    at ForkUtilityProcess.a.emit (node:electron/js2c/browser_init:2:68499)
[2024-10-24 13:39:52.524] [error] [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: TypeError: Cannot read properties of undefined (reading 'indexedModelRepresentation')
    at t.ModelLoadingProvider.getInstanceBySpecifierOrThrow (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:39:6892)
    at t.ModelLoadingProvider.getLLMModelBySpecifierOrThrow (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:39:8641)
    at Object.handler (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:65:82570)
    at t.ServerPort.receivedRpcCall (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:222:76)
    at a.receivedMessage (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:195:7825)
    at MessagePortMain.<anonymous> (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:195:6782)
    at MessagePortMain.emit (node:events:513:28)
    at MessagePortMain._internalPort.emit (node:electron/js2c/browser_init:2:99562)
[2024-10-24 13:39:54.722] [error] [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: TypeError: Cannot read properties of undefined (reading 'indexedModelRepresentation')
    at t.ModelLoadingProvider.getInstanceBySpecifierOrThrow (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:39:6892)
    at t.ModelLoadingProvider.getLLMModelBySpecifierOrThrow (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:39:8641)
    at Object.handler (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:65:82570)
    at t.ServerPort.receivedRpcCall (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:222:76)
    at a.receivedMessage (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:195:7825)
    at MessagePortMain.<anonymous> (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:195:6782)
    at MessagePortMain.emit (node:events:513:28)
    at MessagePortMain._internalPort.emit (node:electron/js2c/browser_init:2:99562)
[2024-10-24 13:39:54.729] [error] [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: TypeError: Cannot read properties of undefined (reading 'indexedModelRepresentation')
    at t.ModelLoadingProvider.getInstanceBySpecifierOrThrow (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:39:6892)
    at t.ModelLoadingProvider.getLLMModelBySpecifierOrThrow (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:39:8641)
    at Object.handler (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:65:82570)
    at t.ServerPort.receivedRpcCall (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:222:76)
    at a.receivedMessage (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:195:7825)
    at MessagePortMain.<anonymous> (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:195:6782)
    at MessagePortMain.emit (node:events:513:28)
    at MessagePortMain._internalPort.emit (node:electron/js2c/browser_init:2:99562)
[2024-10-24 13:39:54.734] [error] [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: TypeError: Cannot read properties of undefined (reading 'indexedModelRepresentation')
    at t.ModelLoadingProvider.getInstanceBySpecifierOrThrow (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:39:6892)
    at t.ModelLoadingProvider.getLLMModelBySpecifierOrThrow (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:39:8641)
    at Object.handler (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:65:82570)
    at t.ServerPort.receivedRpcCall (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:222:76)
    at a.receivedMessage (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:195:7825)
    at MessagePortMain.<anonymous> (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:195:6782)
    at MessagePortMain.emit (node:events:513:28)
    at MessagePortMain._internalPort.emit (node:electron/js2c/browser_init:2:99562)
[2024-10-24 13:39:54.742] [error] [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: TypeError: Cannot read properties of undefined (reading 'indexedModelRepresentation')
    at t.ModelLoadingProvider.getInstanceBySpecifierOrThrow (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:39:6892)
    at t.ModelLoadingProvider.getLLMModelBySpecifierOrThrow (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:39:8641)
    at Object.handler (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:65:82570)
    at t.ServerPort.receivedRpcCall (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:222:76)
    at a.receivedMessage (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:195:7825)
    at MessagePortMain.<anonymous> (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:195:6782)
    at MessagePortMain.emit (node:events:513:28)
    at MessagePortMain._internalPort.emit (node:electron/js2c/browser_init:2:99562)
[2024-10-24 13:44:05.119] [error] [LMSInternal][Client=LM Studio][Endpoint=loadModel] Error in channel handler: Error: Error loading model.
    at f.d (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1148205)
    at f.emit (node:events:513:28)
    at f.onChildExit (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1124523)
    at ForkUtilityProcess.<anonymous> (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1124129)
    at ForkUtilityProcess.emit (node:events:513:28)
    at ForkUtilityProcess.a.emit (node:electron/js2c/browser_init:2:68499)
[2024-10-24 13:44:06.135] [error] [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:44:06.151] [error] [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:44:06.156] [error] [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:44:06.161] [error] [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:44:06.165] [error] [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:44:06.170] [error] Unhandled Rejection at: {} reason: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:44:06.174] [error] Unhandled Rejection at: {} reason: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:44:06.178] [error] Unhandled Rejection at: {} reason: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:44:06.182] [error] Unhandled Rejection at: {} reason: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:44:06.186] [error] Unhandled Rejection at: {} reason: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:44:06.192] [error] [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: TypeError: Cannot read properties of undefined (reading 'indexedModelRepresentation')
    at t.ModelLoadingProvider.getInstanceBySpecifierOrThrow (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:39:6892)
    at t.ModelLoadingProvider.getLLMModelBySpecifierOrThrow (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:39:8641)
    at Object.handler (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:65:82570)
    at t.ServerPort.receivedRpcCall (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:222:76)
    at a.receivedMessage (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:195:7825)
    at MessagePortMain.<anonymous> (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:195:6782)
    at MessagePortMain.emit (node:events:513:28)
    at MessagePortMain._internalPort.emit (node:electron/js2c/browser_init:2:99562)
[2024-10-24 13:44:06.197] [error] [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: TypeError: Cannot read properties of undefined (reading 'indexedModelRepresentation')
    at t.ModelLoadingProvider.getInstanceBySpecifierOrThrow (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:39:6892)
    at t.ModelLoadingProvider.getLLMModelBySpecifierOrThrow (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:39:8641)
    at Object.handler (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:65:82570)
    at t.ServerPort.receivedRpcCall (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:222:76)
    at a.receivedMessage (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:195:7825)
    at MessagePortMain.<anonymous> (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:195:6782)
    at MessagePortMain.emit (node:events:513:28)
    at MessagePortMain._internalPort.emit (node:electron/js2c/browser_init:2:99562)
[2024-10-24 13:45:04.258] [error] [LMSInternal][Client=LM Studio][Endpoint=loadModel] Error in channel handler: Error: Error loading model.
    at f.d (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1148205)
    at f.emit (node:events:513:28)
    at f.onChildExit (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1124523)
    at ForkUtilityProcess.<anonymous> (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1124129)
    at ForkUtilityProcess.emit (node:events:513:28)
    at ForkUtilityProcess.a.emit (node:electron/js2c/browser_init:2:68499)
[2024-10-24 13:45:05.286] [error] [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:45:05.295] [error] [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:45:05.302] [error] [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:45:05.309] [error] [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:45:05.313] [error] [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:45:05.317] [error] Unhandled Rejection at: {} reason: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:45:05.325] [error] Unhandled Rejection at: {} reason: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:45:05.331] [error] Unhandled Rejection at: {} reason: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:45:05.337] [error] Unhandled Rejection at: {} reason: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:45:05.345] [error] Unhandled Rejection at: {} reason: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:45:05.352] [error] [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: TypeError: Cannot read properties of undefined (reading 'indexedModelRepresentation')
    at t.ModelLoadingProvider.getInstanceBySpecifierOrThrow (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:39:6892)
    at t.ModelLoadingProvider.getLLMModelBySpecifierOrThrow (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:39:8641)
    at Object.handler (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:65:82570)
    at t.ServerPort.receivedRpcCall (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:222:76)
    at a.receivedMessage (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:195:7825)
    at MessagePortMain.<anonymous> (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:195:6782)
    at MessagePortMain.emit (node:events:513:28)
    at MessagePortMain._internalPort.emit (node:electron/js2c/browser_init:2:99562)
[2024-10-24 13:45:05.360] [error] [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: TypeError: Cannot read properties of undefined (reading 'indexedModelRepresentation')
    at t.ModelLoadingProvider.getInstanceBySpecifierOrThrow (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:39:6892)
    at t.ModelLoadingProvider.getLLMModelBySpecifierOrThrow (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:39:8641)
    at Object.handler (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:65:82570)
    at t.ServerPort.receivedRpcCall (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:222:76)
    at a.receivedMessage (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:195:7825)
    at MessagePortMain.<anonymous> (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:195:6782)
    at MessagePortMain.emit (node:events:513:28)
    at MessagePortMain._internalPort.emit (node:electron/js2c/browser_init:2:99562)
[2024-10-24 13:45:12.005] [error] [LMSInternal][Client=LM Studio][Endpoint=loadModel] Error in channel handler: Error: Error loading model.
    at f.d (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1148205)
    at f.emit (node:events:513:28)
    at f.onChildExit (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1124523)
    at ForkUtilityProcess.<anonymous> (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1124129)
    at ForkUtilityProcess.emit (node:events:513:28)
    at ForkUtilityProcess.a.emit (node:electron/js2c/browser_init:2:68499)
[2024-10-24 13:45:13.034] [error] [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:45:13.042] [error] [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:45:13.051] [error] [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:45:13.056] [error] [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:45:13.060] [error] Unhandled Rejection at: {} reason: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:45:13.064] [error] Unhandled Rejection at: {} reason: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:45:13.068] [error] Unhandled Rejection at: {} reason: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:45:13.071] [error] Unhandled Rejection at: {} reason: Error: Model is unloaded.
    at C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:8:1146084
[2024-10-24 13:45:13.076] [error] [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: TypeError: Cannot read properties of undefined (reading 'indexedModelRepresentation')
    at t.ModelLoadingProvider.getInstanceBySpecifierOrThrow (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:39:6892)
    at t.ModelLoadingProvider.getLLMModelBySpecifierOrThrow (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:39:8641)
    at Object.handler (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:65:82570)
    at t.ServerPort.receivedRpcCall (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:222:76)
    at a.receivedMessage (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:195:7825)
    at MessagePortMain.<anonymous> (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:195:6782)
    at MessagePortMain.emit (node:events:513:28)
    at MessagePortMain._internalPort.emit (node:electron/js2c/browser_init:2:99562)
[2024-10-24 13:45:13.082] [error] [LMSInternal][Client=LM Studio][Endpoint=countTokens] Error in RPC handler: TypeError: Cannot read properties of undefined (reading 'indexedModelRepresentation')
    at t.ModelLoadingProvider.getInstanceBySpecifierOrThrow (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:39:6892)
    at t.ModelLoadingProvider.getLLMModelBySpecifierOrThrow (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:39:8641)
    at Object.handler (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:65:82570)
    at t.ServerPort.receivedRpcCall (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:222:76)
    at a.receivedMessage (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:195:7825)
    at MessagePortMain.<anonymous> (C:\Users\XXXX\AppData\Local\LM-Studio\app-0.3.5\resources\app\.webpack\main\index.js:195:6782)
    at MessagePortMain.emit (node:events:513:28)
    at MessagePortMain._internalPort.emit (node:electron/js2c/browser_init:2:99562)

noREAVER commented 4 weeks ago

{
  "indexedModelIdentifier": "lmstudio-community/Mistral-7B-Instruct-v0.3-GGUF/Mistral-7B-Instruct-v0.3-Q5_K_M.gguf",
  "displayName": "Mistral 7B Instruct v0.3",
  "containingDirSubpath": "lmstudio-community/Mistral-7B-Instruct-v0.3-GGUF",
  "containingDirMtime": 1729770604347,
  "containingDirAbsolutePath": "C:/LLMs/lmstudio-community/Mistral-7B-Instruct-v0.3-GGUF",
  "sourceDirectoryType": "user",
  "format": "gguf",
  "domain": "llm",
  "metadata": {
    "gguf": {
      "arch": "llama",
      "name": "Mistral-7B-Instruct-v0.3",
      "chatTemplate": "{{ bos_token }}{% for message in messages %}{% if (message['role'] == 'user') != (loop.index0 % 2 == 0) %}{{ raise_exception('Conversation roles must alternate user/assistant/user/assistant/...') }}{% endif %}{% if message['role'] == 'user' %}{{ '[INST] ' + message['content'] + ' [/INST]' }}{% elif message['role'] == 'assistant' %}{{ message['content'] + eos_token}}{% else %}{{ raise_exception('Only user and assistant roles are supported!') }}{% endif %}{% endfor %}",
      "parameters": "7B",
      "bosToken": "<s>",
      "eosToken": "</s>",
      "contextLength": 32768,
      "numLayers": 32
    }
  },
  "allFiles": [
    {
      "filename": "Mistral-7B-Instruct-v0.3-Q5_K_M.gguf",
      "ext": "gguf",
      "absPath": "C:/LLMs/lmstudio-community/Mistral-7B-Instruct-v0.3-GGUF/Mistral-7B-Instruct-v0.3-Q5_K_M.gguf",
      "relPath": "lmstudio-community/Mistral-7B-Instruct-v0.3-GGUF/Mistral-7B-Instruct-v0.3-Q5_K_M.gguf",
      "sizeBytes": 5136175328
    }
  ],
  "concreteModelDirAbsolutePath": "C:/LLMs/lmstudio-community/Mistral-7B-Instruct-v0.3-GGUF",
  "entryPoint": {
    "filename": "Mistral-7B-Instruct-v0.3-Q5_K_M.gguf",
    "ext": "gguf",
    "absPath": "C:/LLMs/lmstudio-community/Mistral-7B-Instruct-v0.3-GGUF/Mistral-7B-Instruct-v0.3-Q5_K_M.gguf",
    "relPath": "lmstudio-community/Mistral-7B-Instruct-v0.3-GGUF/Mistral-7B-Instruct-v0.3-Q5_K_M.gguf",
    "sizeBytes": 5136175328
  },
  "quant": {
    "bits": 5,
    "name": "Q5_K_M"
  },
  "sizeBytes": 5136175328,
  "selfFiles": [
    {
      "filename": "Mistral-7B-Instruct-v0.3-Q5_K_M.gguf",
      "ext": "gguf",
      "absPath": "C:/LLMs/lmstudio-community/Mistral-7B-Instruct-v0.3-GGUF/Mistral-7B-Instruct-v0.3-Q5_K_M.gguf",
      "relPath": "lmstudio-community/Mistral-7B-Instruct-v0.3-GGUF/Mistral-7B-Instruct-v0.3-Q5_K_M.gguf",
      "sizeBytes": 5136175328
    }
  ],
  "altIndexedModelIdentifier": "lmstudio-community/Mistral-7B-Instruct-v0.3-GGUF",
  "user": "lmstudio-community",
  "model": "Mistral-7B-Instruct-v0.3-GGUF",
  "file": "Mistral-7B-Instruct-v0.3-Q5_K_M.gguf",
  "autoIdentifiers": [
    "mistral-7b-instruct-v0.3",
    "lmstudio-community/mistral-7b-instruct-v0.3",
    "mistral-7b-instruct-v0.3@q5_k_m",
    "lmstudio-community/mistral-7b-instruct-v0.3@q5_k_m",
    "lmstudio-community/mistral-7b-instruct-v0.3-gguf",
    "lmstudio-community/mistral-7b-instruct-v0.3-gguf/mistral-7b-instruct-v0.3-q5_k_m.gguf"
  ],
  "defaultIdentifier": "mistral-7b-instruct-v0.3"
}
[
  {
    "filename": "Mistral-7B-Instruct-v0.3-Q5_K_M.gguf",
    "ext": "gguf",
    "absPath": "C:/LLMs/lmstudio-community/Mistral-7B-Instruct-v0.3-GGUF/Mistral-7B-Instruct-v0.3-Q5_K_M.gguf",
    "relPath": "lmstudio-community/Mistral-7B-Instruct-v0.3-GGUF/Mistral-7B-Instruct-v0.3-Q5_K_M.gguf",
    "sizeBytes": 5136175328
  }
]

YorkieDev commented 4 weeks ago

For those facing similar issues, the solution to this is to go to the Developer tab -> LM Runtimes and select "Vulkan llama.cpp" from the LM Runtimes drop downs.

gurusura commented 3 weeks ago

For those facing similar issues, the solution to this is to go to the Developer tab -> LM Runtimes and select "Vulkan llama.cpp" from the LM Runtimes drop downs.

Did not work for me.

My system: Distributor ID: Ubuntu Description: Ubuntu 24.04.1 LTS Release: 24.04 Codename: noble

I tried using the more recent 1.3gb sized models such as llama 3.2 1B. Screenshot at 2024-10-25 17-33-10 Screenshot at 2024-10-25 17-30-16

gurusura commented 3 weeks ago

Update: Instead of Vulkan, I tried CPU llama.cpp. It loaded the model. While it was generating, I tried changing the runtimes, but it didnt crash (may be it is not using the changed runtime). It is better than nothing. Still investigating. May be using the CPU version of llama.cpp should be done first in Ubuntu 24.04 version. Mine has NVidia GPU, but really an old one.

More updates: I am finding that the only usable runtime is the CPU Llama.cpp which loads the model. The other runtimes do not work for my Ubuntu Config / Specs.

yagil commented 3 weeks ago

Locking this since there’s a mashup of different issues here. For others running into problems, please create a new issue and include the following details:

operating system version
CPU make and version
GPU make and version
specific models that doesn’t load
screenshot of your app after you press Ctrl + Shift + R

lmstudio-ai / lmstudio-bug-tracker

Can't load any model since 3.x upgrade #164