neuralmagic deepsparse issues

neuralmagic / deepsparse

Sparsity-aware deep learning inference runtime for CPUs

https://neuralmagic.com/deepsparse/

Other

3.03k stars 173 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Add risc-v support

#1669 zinovya opened 4 days ago
0
pruned90_quant-none dataset download results in HTTP 403 Forbidden error

#1668 daveisdigital opened 3 weeks ago
0
Updated Performance Against ONNXRuntime and OpenVINO

#1667 vjsrinivas opened 1 month ago
0
[Question] About CPU performance

#1666 mingfeima opened 2 months ago
3
[QUESTION] Why model is taking so long to load?

#1665 MariGaS opened 2 months ago
0
Add more detail to yolo bounding boxes documentation

#1664 EricPedley opened 3 months ago
0
What is the format of the boxes returned from a YOLO Pipeline?

#1663 EricPedley opened 3 months ago
2
Counting the object in the detection

#1661 AJITKUMAR130012 opened 3 months ago
3
onxx give the wrong inference

#1660 AJITKUMAR130012 closed 3 months ago
1
c++ api

#1659 cbingdu opened 3 months ago
0
relax pydantic version restriction

#1658 dhuangnm closed 4 months ago
0
Add config overrides for protected namespaces to remove warnings for pydantic classes that have model_* params

#1657 markurtz closed 4 months ago
0
Failed to import dynamically quantized roberta model in ONNX format.

#1656 tsamiss closed 4 months ago
2
Extractor dfs performance

#1655 kylesayrs opened 5 months ago
1
Conversion and display of yolov8 rtsp video inference results

#1654 wynshiter opened 5 months ago
2
Bump gradio from 3.19.1 to 4.36.0 in /examples/benchmark-ui

#1653 dependabot[bot] opened 5 months ago
0
Bump gradio from 3.19.1 to 4.19.2 in /examples/benchmark-ui

#1652 dependabot[bot] closed 5 months ago
1
Unknown Pipeline task yolov8. Currently supported tasks are ['text_generation', 'opt', 'llama', 'code_gen', 'code_generation', 'codegen', 'image_classification', 'mpt']

#1651 piaoyaoi closed 6 months ago
2
How can I use deepsparse instead of ultralytics

#1650 piaoyaoi closed 6 months ago
2
Unable to load DeepSparseSentenceTransformer

#1649 Capt4in-Levi opened 6 months ago
2
How can I make proper request to server

#1648 Alex-SSK closed 4 months ago
2
[Question] about converting onnx model with dynamic batch size input to deepsparse model

#1647 phamkhactu opened 6 months ago
2
Support torch 2.3 and remove version ceiling restriction

#1646 mgoin closed 6 months ago
0
Bump pydantic support to v2

#1645 rahul-tuli closed 6 months ago
0
Fix Haystack README typos and wording

#1644 kylesayrs closed 7 months ago
1
Update server docs to use v2 infer endpoints

#1643 mgoin closed 7 months ago
0
Updated Logo in README

#1642 rgreenberg1 closed 7 months ago
0
YOLOv8 - Display bounding boxes and classes names in image using python.

#1641 guiaugustoga987 closed 7 months ago
3
Updates datasets<2.19 and accelerate<0.29 to match transformers

#1640 mgoin closed 7 months ago
0
deepsparse.TextGeneration doesn't accept `trust_remote_code` as an arg anymore

#1639 mgoin opened 8 months ago
1
Update Transformers to support 4.39

#1638 mgoin closed 8 months ago
0
bump up main to 1.8.0

#1637 dhuangnm closed 8 months ago
0
[TextGeneration] Fix llama tokenizer (#1635)

#1636 dhuangnm closed 8 months ago
1
[TextGeneration] Fix llama tokenizer

#1635 dsikka closed 8 months ago
0
Update README.md

#1634 jeanniefinks closed 8 months ago
0
Fix the logic for perplexity evaluation (`Not enough kv_cache capacity to run generation. Please use a larger sequence_length or a shorter prompt`)

#1633 dbogunowicz closed 7 months ago
1
Purpose of exporter.export_onnx(sample_batch=torch.randn(1, 1, 28, 28))

#1632 pradeepdev-1995 closed 7 months ago
4
How to use for the fintuned roberta model for text classification

#1631 pradeepdev-1995 opened 8 months ago
3
Update workflows and Python 3.12

#1630 johnnynunez opened 8 months ago
1
Python3.12?

#1629 johnnynunez closed 8 months ago
3
Retire `flaky` in favour of `pytest-rerunfailures`

#1628 dbogunowicz closed 8 months ago
0
Pin pytest below `8.1.0`

#1627 dbogunowicz closed 8 months ago
0
[cherry-pick] UPDATE src/deepsparse/image_classification/README.md (#1621)

#1626 bfineran closed 9 months ago
0
[Fix] Raise ValueError when llm-eval gets an unknown dataset to evaluate on (instead of failing silently)

#1625 dbogunowicz closed 8 months ago
0
Pass arguments for pipeline creation properly to deepsparse.evaluate

#1624 dbogunowicz closed 8 months ago
0
[Cherry Pick] Use datasets as expected by docs

#1623 rahul-tuli closed 9 months ago
0
[bug] Use datasets as expected by docs

#1622 rahul-tuli closed 9 months ago
0
UPDATE src/deepsparse/image_classification/README.md

#1621 bfineran closed 9 months ago
0
Add test for `deepsparse.yolov8.annotate`

#1620 mgoin closed 9 months ago
1
[Cherry Pick] Upgrade lm-eval to 0.4.1

#1619 rahul-tuli closed 9 months ago
0