safe tensor support for convert weights

fpgaminer / GPTQ-triton

GPTQ inference Triton kernel

Apache License 2.0

284 stars 23 forks source link

Closed DanielWe2 closed 1 year ago

DanielWe2 commented 1 year ago

The quant file already can load safetensor files, the convert script should too

fpgaminer commented 1 year ago

Looks good, thank you.