lmstudio-ai / lmstudio-bug-tracker

Bug tracking for the LM Studio desktop application
2 stars 2 forks source link

ibm-granite models cannot be loaded, although they report StarCoder architecture #24

Open ELigoP opened 1 month ago

ELigoP commented 1 month ago

Copypasted from Failed to load model error modal:


{
  "title": "Failed to load model",
  "cause": "llama.cpp error: 'check_tensor_dims: tensor 'output.weight' not found'",
  "errorData": {
    "n_ctx": 4096,
    "n_batch": 512,
    "n_gpu_layers": 89
  },
  "data": {
    "memory": {
      "ram_capacity": "62.71 GB",
      "ram_unused": "78.71 KB"
    },
    "gpu": {
      "type": "Nvidia CUDA",
      "vram_recommended_capacity": "23.68 GB",
      "vram_unused": "21.81 GB"
    },
    "os": {
      "platform": "linux",
      "version": "6.5.0-35-generic",
      "supports_avx2": true
    },
    "app": {
      "version": "0.2.23",
      "downloadsDir": "path/to/cache/lmstudio_cache"
    },
    "model": {}
  }
}