issues
search
quic
/
efficient-transformers
This library empowers users to seamlessly port pretrained models and checkpoints on the HuggingFace (HF) hub (developed using HF transformers library) into inference-ready formats that run efficiently on Qualcomm Cloud AI 100 accelerators.
https://quic.github.io/efficient-transformers/
Other
39
stars
26
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
token type ids fix for falcon 180B
#142
quic-mamta
opened
2 days ago
0
Adding Support for Python3.10
#141
abukhoy
opened
2 days ago
0
Fix torch dependency release
#140
ochougul
opened
3 days ago
0
Remove `index_url` dependency and extend python version compatibility
#139
ochougul
opened
3 days ago
0
mpt fix for continous batching
#138
quic-mamta
closed
2 days ago
3
Change codeowners
#137
ochougul
closed
6 days ago
0
Enabled GPTQ test and doc fix
#136
quic-amitraj
closed
6 days ago
0
Updated FBS sample command
#135
quic-rishinr
closed
1 week ago
0
Add Support for Llama3.2 Text Based Models
#134
vbaddi
opened
1 week ago
0
Fixed installation issue in AArch64
#133
quic-amitraj
closed
1 week ago
1
Fix issue with no of prompt less than FBS
#132
quic-rishinr
closed
1 week ago
1
Multi version Documents for gh_pages
#131
quic-amitraj
closed
1 week ago
0
Fix issue with no of prompt less than FBS
#130
quic-rishinr
closed
1 week ago
0
Enabled GPTQ test and doc fix
#129
quic-amitraj
closed
1 week ago
1
Readme update
#128
quic-akuruvil
closed
1 week ago
1
Multi-versions doc support
#127
quic-amitraj
closed
1 week ago
0
Release/v1.18
#126
quic-amitraj
closed
1 week ago
0
Release/v1.18 : Update number of heads in MQA for Falcon
#125
quic-mamta
closed
1 week ago
1
Update number of heads for MQA in Falcon
#124
quic-mamta
closed
1 week ago
0
Gemma, Gemma2 and CodeGemma support
#123
quic-meet
opened
1 week ago
0
Granite and Starcoder1 Model Support with CB mode.
#122
quic-akuruvil
opened
2 weeks ago
0
QNN Compilation Support.
#121
shubhagr-quic
opened
2 weeks ago
1
Release 1.18 Added CB support for Codegen, falcon, gpt2, gpt-j, mpt in
#120
quic-rishinr
closed
2 weeks ago
0
[eplatero] Add support for exporting and compiling models for SpD
#119
quic-agokhale
opened
2 weeks ago
6
add rope scaling to llama mainline and update readme
#118
vbaddi
closed
2 weeks ago
0
Updating sentencepiece version to sentencepiece==0.2.0
#117
abukhoy
closed
1 week ago
0
Caching + API changes
#116
irajagop
opened
2 weeks ago
0
Updated continuous batching command
#115
quic-amitraj
closed
1 week ago
0
Add rope scaling to llama modeling file
#114
vbaddi
closed
2 weeks ago
1
fix for Continuous Batching document
#113
quic-amitraj
closed
2 weeks ago
1
Fixed Continuous Batching command
#112
quic-amitraj
closed
3 weeks ago
0
Fixed Continuous Batching command
#111
quic-amitraj
closed
2 weeks ago
0
Hotfix/Restoring older release functionality for VLLM
#110
ochougul
closed
3 weeks ago
0
track RAM & save measurements during compile and run
#109
quic-morteza
opened
3 weeks ago
1
saving measurements during compile and run time
#108
quic-morteza
opened
3 weeks ago
1
Docker-driven tests with latest SDKs
#107
quic-amitraj
opened
3 weeks ago
0
QNN Compilation Support.
#106
shubhagr-quic
closed
2 weeks ago
1
Updated README.md with latest changes
#105
quic-amitraj
closed
3 weeks ago
1
Update infer.py for logging measurements into a csv file
#104
quic-morteza
closed
3 weeks ago
2
Adding support for GPTQ models
#103
quic-amitraj
closed
3 weeks ago
1
Gemma support
#102
quic-meet
closed
3 weeks ago
0
AWQ+GPTQ
#101
ochougul
closed
3 weeks ago
3
Awq feature
#100
ochougul
closed
1 month ago
0
Added CB support for Codegen, falcon, gpt2, gpt-j, mpt
#99
quic-rishinr
closed
2 weeks ago
1
Replacing assertions
#98
quic-meet
opened
1 month ago
2
Added support for creating model path hash when model card is not pro…
#97
quic-rishinr
closed
1 month ago
0
Add support for new model granite - Starcoder1 arch
#96
quic-akuruvil
closed
1 week ago
2
Initializing rotary_emb only instead of initializing llama_attention
#95
ochougul
closed
1 month ago
1
Adding support for torch==2.0.0
#94
abukhoy
closed
1 month ago
3
Added beautified error for GatedRepoError from HuggingFaceHub
#93
ochougul
opened
1 month ago
0
Next