Closed natolambert closed 5 months ago
Closes #143, Closes #95, handles llama 3 not wanting to be quantized, adds quantization override.
Closes #143, Closes #95, handles llama 3 not wanting to be quantized, adds quantization override.