search

neuralmagic / sparseml

Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models
Apache License 2.0
2.07k stars 148 forks source link

Allow torch 2.3 and remove torch ceiling version restriction #2259

Closed mgoin closed 6 months ago

mgoin commented 6 months ago

vLLM now requires torch 2.3.0, so we should try to raise the restriction in SparseML. Going forward, I think we shouldn't be so restrictive to newer versions of pytorch and should raise a warning at most, not an explicit exception.

mgoin commented 6 months ago

@bfineran @robertgshaw2-neuralmagic is this good with you going forward to not restrict pytorch?

dbogunowicz commented 6 months ago

@mgoin should we land this (after the GHA tests have passed?)