neuralmagic deepsparse issues

neuralmagic / deepsparse

Sparsity-aware deep learning inference runtime for CPUs

https://neuralmagic.com/deepsparse/

Other

2.93k stars 168 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Failed to import dynamically quantized roberta model in ONNX format.

#1656 tsamiss opened 1 week ago
1
WIP: Extractor dfs performance

#1655 kylesayrs opened 1 week ago
0
Conversion and display of yolov8 rtsp video inference results

#1654 wynshiter opened 2 weeks ago
2
Bump gradio from 3.19.1 to 4.36.0 in /examples/benchmark-ui

#1653 dependabot[bot] opened 3 weeks ago
0
Bump gradio from 3.19.1 to 4.19.2 in /examples/benchmark-ui

#1652 dependabot[bot] closed 3 weeks ago
1
Unknown Pipeline task yolov8. Currently supported tasks are ['text_generation', 'opt', 'llama', 'code_gen', 'code_generation', 'codegen', 'image_classification', 'mpt']

#1651 piaoyaoi closed 1 month ago
2
How can I use deepsparse instead of ultralytics

#1650 piaoyaoi closed 1 month ago
2
Unable to load DeepSparseSentenceTransformer

#1649 Capt4in-Levi opened 1 month ago
2
How can I make proper request to server

#1648 Alex-SSK opened 1 month ago
1
[Question] about converting onnx model with dynamic batch size input to deepsparse model

#1647 phamkhactu opened 1 month ago
2
Support torch 2.3 and remove version ceiling restriction

#1646 mgoin closed 1 month ago
0
Bump pydantic support to v2

#1645 rahul-tuli closed 2 months ago
0
Fix Haystack README typos and wording

#1644 kylesayrs closed 2 months ago
1
Update server docs to use v2 infer endpoints

#1643 mgoin closed 2 months ago
0
Updated Logo in README

#1642 rgreenberg1 closed 2 months ago
0
YOLOv8 - Display bounding boxes and classes names in image using python.

#1641 guiaugustoga987 closed 2 months ago
3
Updates datasets<2.19 and accelerate<0.29 to match transformers

#1640 mgoin closed 3 months ago
0
deepsparse.TextGeneration doesn't accept `trust_remote_code` as an arg anymore

#1639 mgoin opened 3 months ago
1
Update Transformers to support 4.39

#1638 mgoin closed 3 months ago
0
bump up main to 1.8.0

#1637 dhuangnm closed 3 months ago
0
[TextGeneration] Fix llama tokenizer (#1635)

#1636 dhuangnm closed 3 months ago
1
[TextGeneration] Fix llama tokenizer

#1635 dsikka closed 3 months ago
0
Update README.md

#1634 jeanniefinks closed 3 months ago
0
Fix the logic for perplexity evaluation (`Not enough kv_cache capacity to run generation. Please use a larger sequence_length or a shorter prompt`)

#1633 dbogunowicz closed 2 months ago
1
Purpose of exporter.export_onnx(sample_batch=torch.randn(1, 1, 28, 28))

#1632 pradeepdev-1995 closed 2 months ago
4
How to use for the fintuned roberta model for text classification

#1631 pradeepdev-1995 opened 3 months ago
3
Update workflows and Python 3.12

#1630 johnnynunez opened 3 months ago
1
Python3.12?

#1629 johnnynunez closed 3 months ago
3
Retire `flaky` in favour of `pytest-rerunfailures`

#1628 dbogunowicz closed 3 months ago
0
Pin pytest below `8.1.0`

#1627 dbogunowicz closed 4 months ago
0
[cherry-pick] UPDATE src/deepsparse/image_classification/README.md (#1621)

#1626 bfineran closed 4 months ago
0
[Fix] Raise ValueError when llm-eval gets an unknown dataset to evaluate on (instead of failing silently)

#1625 dbogunowicz closed 3 months ago
0
Pass arguments for pipeline creation properly to deepsparse.evaluate

#1624 dbogunowicz closed 3 months ago
0
[Cherry Pick] Use datasets as expected by docs

#1623 rahul-tuli closed 4 months ago
0
[bug] Use datasets as expected by docs

#1622 rahul-tuli closed 4 months ago
0
UPDATE src/deepsparse/image_classification/README.md

#1621 bfineran closed 4 months ago
0
Add test for `deepsparse.yolov8.annotate`

#1620 mgoin closed 4 months ago
1
[Cherry Pick] Upgrade lm-eval to 0.4.1

#1619 rahul-tuli closed 4 months ago
0
[Upgrade] lm-eval to 0.4.1

#1618 rahul-tuli closed 4 months ago
0
Bump gradio from 3.19.1 to 4.19.2 in /examples/benchmark-ui

#1617 dependabot[bot] closed 4 months ago
1
[Cherry pick] evaluate fixes

#1616 rahul-tuli closed 4 months ago
0
[Update] `deepsparse.evaluate` docstring

#1615 rahul-tuli closed 4 months ago
0
[V2 Logger] Feature branch (#1516)

#1614 horheynm closed 4 months ago
0
[Cherry Pick] fix json export to remove middleware

#1613 dsikka closed 4 months ago
0
[benchmark_pipeline] Update the export dict to remove the middleware key

#1612 dsikka closed 4 months ago
0
Damian's Cherry Pick

#1611 Satrat closed 4 months ago
0
[Cherry pick] Propagate legacy sparsezoo analyze name change

#1610 rahul-tuli closed 4 months ago
0
[Bugfix] propagate name change of legacy sparsezoo/analyze analyze_v1

#1609 rahul-tuli closed 4 months ago
0
[DeepSparse Evaluation API] Improve the digestion of the integration_name (robustness)

#1608 dbogunowicz closed 4 months ago
0
fix src. reference

#1607 bfineran closed 4 months ago
0