search

neuralmagic / sparseml

Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models
Apache License 2.0
2.07k stars 148 forks source link

fix group size support for sgpt_wrapper #2280

Closed bfineran closed 6 months ago

bfineran commented 6 months ago

scales and zero points were not accounting for correct groups when iterating over the input channel dimension