lmstudio-ai / lms

👾 LM Studio CLI
https://lms.dev
MIT License
1.69k stars 138 forks source link

After branching a conversation and loading, crashes with LLama 3.1 nvidia 12 gb ram #58

Open ridingmower opened 3 months ago

ridingmower commented 3 months ago

After branching a conversation and loading llama 3.1 it crashes on the first run consistently

{
  "data": {
    "memory": {
      "ram_capacity": "31.90 GB",
      "ram_unused": "18.20 GB"
    },
    "gpu": {
      "gpu_names": [
        "NVIDIA GeForce RTX 3060"
      ],
      "vram_recommended_capacity": "12.00 GB",
      "vram_unused": "10.98 GB"
    },
    "os": {
      "platform": "win32",
      "version": "10.0.22621"
    },
    "app": {
      "version": "0.2.31",
      "downloadsDir": "C:\\Users\\jason\\.cache\\lm-studio\\models"
    },
    "model": {}
  }
}