issues
search
neuralmagic
/
deepsparse
Sparsity-aware deep learning inference runtime for CPUs
https://neuralmagic.com/deepsparse/
Other
2.94k
stars
169
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
[V2 Logger] Logger with pipeline tests + prometheus
#1553
horheynm
closed
5 months ago
0
[Text Generation Pipeline] Fix Non KV Cache Pipeline not calling parse_inputs
#1552
dbogunowicz
closed
5 months ago
0
[Cherry-Pick][Text Generation] Consolidate `TextGenerationPipeline` and `TextGener…
#1551
dbogunowicz
closed
5 months ago
0
[Cherry-Picks] for 1.7 as of Fri, Jan 19th, 2024 2:17PM
#1549
rahul-tuli
closed
5 months ago
1
[testing]
#1548
dsikka
closed
5 months ago
0
[text-gen] lock tokenizer call in process inputs
#1547
bfineran
closed
5 months ago
0
[Pipeline] Fix async generator loop
#1546
dsikka
closed
5 months ago
0
[Temporary Fix] Pin binary version to pass prefill tests
#1545
mgoin
closed
5 months ago
0
Remove artifact version restriction
#1544
mgoin
closed
5 months ago
0
[V2 Logger] logger middleware
#1543
horheynm
closed
5 months ago
0
[V2 Logger] root logger
#1542
horheynm
closed
5 months ago
0
[V2 Logger] logger manager
#1541
horheynm
closed
5 months ago
0
[V2 Logger] Filters
#1540
horheynm
closed
5 months ago
0
[V2 Logger] registry for default func/class
#1539
horheynm
closed
5 months ago
0
[V2 Logger] async submitter
#1538
horheynm
closed
5 months ago
0
[V2 Logger] factory
#1537
horheynm
closed
5 months ago
0
[V2 Logger] utils for import
#1536
horheynm
closed
5 months ago
0
[server][Pipeline] fix async future being used by continuous_batching
#1535
dsikka
closed
5 months ago
0
[Pipeline][Server] Fix loop in async generator
#1534
dsikka
closed
5 months ago
0
[V2 Loggers] config file
#1533
horheynm
closed
5 months ago
0
yolo-v8 in onnx-runtime outperforms deepsparse on iMX8
#1532
Fritskee
closed
2 months ago
6
Add support for ultrachat200k
#1531
anmarques
opened
5 months ago
0
[Cherrypick] Add title to server docs page (#1525)
#1530
mgoin
closed
5 months ago
0
Test test
#1529
mgoin
closed
5 months ago
0
[TextGeneration] Update defaults to always start with deepsparse defaults when using the `generation_config` arg
#1528
dsikka
closed
5 months ago
0
Assertion at src/lib/core/topology.cpp:627
#1527
Zorgosto
closed
2 months ago
1
Add support for tokenized prompt input for CompletionRequest
#1526
mgoin
closed
5 months ago
1
Add title to server docs page
#1525
mgoin
closed
5 months ago
0
[Debugging] gha failures
#1524
dsikka
closed
5 months ago
0
[TextGeneration] Fix first token for streaming
#1523
dsikka
closed
5 months ago
1
[OpenAI] Add logprob support
#1522
dsikka
closed
5 months ago
3
Add warning when failing to build v2 pipeline
#1521
mgoin
closed
5 months ago
0
[Move] Common Evaluation Modules to `Sparsezoo``
#1520
rahul-tuli
opened
6 months ago
1
[timer][benchmark_pipeline] Update the `benchmark_pipeline` to work with v1 and v2; clean-up middleware/timer_middleware
#1519
dsikka
closed
5 months ago
0
[Add] sequence length to text gen pipelines
#1518
rahul-tuli
closed
6 months ago
0
[BugFixes] `deepsparse.eval`
#1517
rahul-tuli
closed
6 months ago
0
[V2 Logger] Feature branch
#1516
horheynm
closed
4 months ago
0
V2/loggers config
#1515
horheynm
closed
5 months ago
0
[TextGeneration] Fix internal kv_cache update for batch_size > 1
#1514
dsikka
closed
6 months ago
0
Add `--num-kv-cache-tokens` to benchmarking scripts
#1513
mgoin
closed
6 months ago
1
Use Int KV Cache as default for deepsparse.benchmark
#1512
horheynm
closed
6 months ago
0
[BugFixes] Fix Broken `deepsparse.eval`
#1511
rahul-tuli
closed
6 months ago
0
[Text Generation] Consolidate `TextGenerationPipeline` and `TextGenerationPipelineNoKVCache`
#1510
dbogunowicz
closed
5 months ago
1
[Benchmark] Fix number of iterations reported
#1509
dsikka
closed
6 months ago
0
[Server] Use the integration field when starting a server
#1508
dsikka
closed
6 months ago
0
[BugFix] Remove `src.` from imports
#1507
rahul-tuli
closed
6 months ago
0
[TextGeneration] Use appropriate future within `continuous_batching_scheduler`
#1506
dsikka
closed
6 months ago
1
[TextGeneration] Add `model_path` alias
#1505
dsikka
closed
6 months ago
0
[TextGeneration] Set scary logs to `debug`
#1504
dsikka
closed
6 months ago
0
log warning for batch_size 1
#1503
horheynm
opened
6 months ago
7
Previous
Next