Error - Failed to load model

#2
by PrzemekQ1 - opened

Hi !
Need some help. Just launched the leafspark • Pixtral 2409 hf text only 12B q4_k_l gguf model on LM Studio and had error like that, even lowered context to 100 tokens and still the same, anyone know what the problem might be ? Thx.:

{
  "title": "Failed to load model",
  "cause": "llama.cpp error: 'check_tensor_dims: tensor 'blk.0.ffn_down.weight' has wrong shape; expected 14336,  5120, got  5120, 14336,     1,     1'",
  "errorData": {
    "n_ctx": 100,
    "n_batch": 512,
    "n_gpu_layers": 41
  },
  "data": {
    "memory": {
      "ram_capacity": "31.93 GB",
      "ram_unused": "23.63 GB"
    },
    "gpu": {
      "gpu_names": [
        "NVIDIA GeForce RTX 4070 Ti SUPER"
      ],
      "vram_recommended_capacity": "15.99 GB",
      "vram_unused": "14.74 GB"
    },
    "os": {
      "platform": "win32",
      "version": "10.0.19045"
    },
    "app": {
      "version": "0.2.31",
      "downloadsDir": "C:\\Users\\Admin\\.cache\\lm-studio\\models"
    },
    "model": {}
  }
}```

Sign up or log in to comment