Open brankoradovanovic-mcom opened 1 week ago
When trying to use Solar Pro Preview (Maziyar Panahi's Q5_K_M GGUF), I'm largely getting incoherent responses:
Whether this is a problem with the GGUF or the inference logic is off, I can't tell. Anyone with a similar experience?
When trying to use Solar Pro Preview (Maziyar Panahi's Q5_K_M GGUF), I'm largely getting incoherent responses:
Whether this is a problem with the GGUF or the inference logic is off, I can't tell. Anyone with a similar experience?
Your Environment