issues
search
neuralmagic
/
deepsparse
Sparsity-aware deep learning inference runtime for CPUs
https://neuralmagic.com/deepsparse/
Other
2.97k
stars
171
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
more fixes
#1459
dsikka
closed
8 months ago
0
rebase fixes
#1458
dsikka
closed
8 months ago
0
[Pipeline Refactor] Add `Pipeline.create` method to initialize pipelines
#1457
dsikka
closed
8 months ago
0
bump up version to 1.7.0
#1456
dhuangnm
closed
8 months ago
0
[Fix] Adapt to the newest SparseZoo interface (and get GHA green again)
#1455
dbogunowicz
closed
8 months ago
0
[V2 Pipeline] Middleware Timer
#1454
horheynm
closed
8 months ago
0
[Pipeline Refactor] Fix Operator scheduling to fix issue with slow execution
#1453
dsikka
closed
8 months ago
0
docker access denied error
#1452
krrishdholakia
closed
4 months ago
8
[DeepSparse Evaluator API][UI] Rename the alias for lm-eval
#1451
dbogunowicz
closed
8 months ago
0
Non-invasive middleware implementation for Ops and Pipeline
#1450
horheynm
closed
8 months ago
0
Using output_value as "token_embeddings" is broken for Sentence Transformer
#1448
mikeybellissimo
closed
4 months ago
2
[Cherry-Pick][Text Generation] Terminate the inference when kv cache is full
#1447
dbogunowicz
closed
9 months ago
1
[Text Generation] Terminate the inference when kv cache is full
#1446
dbogunowicz
closed
8 months ago
0
[server] Update OpenAI endpoints
#1445
dsikka
closed
8 months ago
2
Delete LICENSE
#1444
rgreenberg1
closed
8 months ago
0
V2 middleware timer
#1443
horheynm
closed
8 months ago
0
[DeepSparse Evaluator API][UI] `EvaluationRegistry.resolve` implementation
#1442
dbogunowicz
closed
8 months ago
1
[Cherry-Pick] Fix the token_generator behavior for non-kv-cache models
#1441
dbogunowicz
closed
9 months ago
0
[transformers] update text gen server example
#1440
bfineran
closed
9 months ago
0
[Cherry-Pick][Fix] Appropriate whitespace missing in streaming output for Llama2, Mistral models
#1439
dbogunowicz
closed
9 months ago
0
[text generation] fix http server readme update
#1438
bfineran
closed
9 months ago
0
initial middleware manager
#1437
horheynm
closed
8 months ago
0
[DeepSparse Evaluator API][UI] Simplify serialization
#1436
dbogunowicz
closed
8 months ago
0
[text generation] http server readme update
#1435
bfineran
closed
9 months ago
0
[Text Generation][V2] `LinearRouter` to accept SPLIT/JOIN
#1434
dbogunowicz
opened
9 months ago
0
[transformers] update zoo stub in generation section of readme
#1433
bfineran
closed
9 months ago
0
[Cherry Pick] Add python 3.11 to test-check.yaml (#1385)
#1432
rahul-tuli
closed
9 months ago
0
[Fix] Appropriate whitespace missing in streaming output for Llama2, Mistral models
#1431
dbogunowicz
closed
9 months ago
0
NM: error: Node (/model/Add_1) Op (Add) [ShapeInferenceError] Incompatible dimension
#1430
mneedham
closed
9 months ago
5
Question on quantization size
#1429
rajuptvs
closed
9 months ago
1
[cherry-pick] split out docs deps in setup extras (#1427)
#1428
bfineran
closed
9 months ago
0
split out docs deps in setup extras
#1427
bfineran
closed
9 months ago
0
[Cherry-Pick][Fix] deepsparse – tokenizer stride size issue with original transformers
#1426
dbogunowicz
closed
9 months ago
0
[Fix] deepsparse – tokenizer stride size issue with original transformers
#1425
dbogunowicz
closed
9 months ago
5
[yolov8] readme command update
#1424
bfineran
closed
9 months ago
0
README example code updates
#1423
bfineran
closed
9 months ago
0
[Feature Branch] The almighty V2
#1422
dbogunowicz
closed
8 months ago
0
Move TokenGenerator logits copy after deterministic
#1421
mgoin
closed
9 months ago
0
[Pipeline Refactor] Operator Registry
#1420
dsikka
closed
9 months ago
0
Upgrade PyTorch to 2.1
#1419
mgoin
closed
9 months ago
0
[TextGen] Make score and finished_reason fully optional
#1418
mgoin
closed
9 months ago
0
[Text Generation][V2] NonKVCachePipeline
#1417
dbogunowicz
closed
8 months ago
0
[Text Generation][V2] Non-KV cache pipeline
#1416
dbogunowicz
closed
9 months ago
0
[Text Generation][V2] NonKVCachePipeline
#1415
dbogunowicz
closed
9 months ago
0
[Text Generation] Avoid mutating the original logits in-place when mapping from logits to token.
#1414
dbogunowicz
closed
9 months ago
0
[1.6] cherry picking release relevant PRs not yet picked up
#1413
bfineran
closed
9 months ago
0
Update README.md
#1412
rgreenberg1
closed
9 months ago
0
[Evaluator][Feature Branch] Make `llm_evaluation_harness` integration fully functional
#1411
dbogunowicz
closed
9 months ago
0
[Evaluator][Feature Branch] End to end testing and API improvements
#1410
dbogunowicz
closed
9 months ago
0
[Pipeline Refactor][Text Generation][Continuous Batching] Integration
#1409
dsikka
closed
9 months ago
1
Previous
Next