search

neuralmagic / sparsezoo

Neural network model repository for highly sparse and sparse-quantized models with matching sparsification recipes
Apache License 2.0
371 stars 25 forks source link

Download deployment dir for llms #435

Closed rahul-tuli closed 9 months ago

rahul-tuli commented 9 months ago

Fixes a bug for ModelAnalysis class, when using LLMs with external data files, using just model.onnx to load the model would fail

Fix is to download the deployment directory with external data files first and then load the model