search

neuralmagic / sparseml

Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models
Apache License 2.0
2.01k stars 140 forks source link

[GPTQ UX] Add string aliasing support for scheme #2287

Closed rahul-tuli closed 1 month ago

rahul-tuli commented 1 month ago

This PR adds string aliasing for newly added scheme argument, this helps simplify the recipes!

recipe:

test_stage:
    obcq_modifiers:
      GPTQModifier:
          ignore: ["lm_head", "Embedding"]
          sequential_update: True
          dampening_frac: 0.001
          block_size: 128
          scheme:
            W8A8: ["Linear"]