issues
search
neuralmagic
/
deepsparse
Sparsity-aware deep learning inference runtime for CPUs
https://neuralmagic.com/deepsparse/
Other
2.97k
stars
171
forks
source link
[Text Generation][Pipeline Refactor] Add kv_cache session full check
#1473
Closed
dsikka
closed
8 months ago
dsikka
commented
8 months ago
Summary
This commit happened while v2 was being migrated so adding it back to the new pipeline
test_text_generation.py
updated to use the new pipeline; skipping tests which are missing features
Summary
test_text_generation.pyupdated to use the new pipeline; skipping tests which are missing features