issues
search
FMInference
/
DejaVu
262
stars
32
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
How to test the sparsity of the model?
#32
lw20191012
opened
1 week ago
0
Training of predictors based on MOE model
#31
mailonghua
opened
1 month ago
0
Question about downsteam tasks accuracy
#30
W-215
opened
1 month ago
0
the issue of parameter settings
#29
W-215
opened
2 months ago
0
How to run on a single GPU?
#28
xbzjsj
opened
4 months ago
7
PyTorch 1.12 and flash-attn==0.2.8 are not compatible.
#27
heheda12345
opened
4 months ago
0
Questions about Attention Sparsity Implementation
#26
czq693497091
closed
4 months ago
0
the code about collect activations while inferencing
#25
mli-tian
opened
4 months ago
0
How to run the code with smaller ckpt like opt-6.7B
#24
czq693497091
opened
4 months ago
11
A question about attention block sparsity
#23
imh966
opened
5 months ago
0
Clarification on Output Neuron Pruning Method in "Deja Vu: Contextual Sparsity for Efficient LLMs at Inference Time"
#22
adamgallas
closed
5 months ago
1
In fp16, the sparse kernel is slower than PyTorch dense gemm
#21
sleepcoo
closed
5 months ago
0
1
#20
sleepcoo
closed
6 months ago
0
Miss csrc folder when building docker images
#19
Mi5sssss
opened
7 months ago
3
Does anyone know if this work is implemented on llama?
#18
wyxscir
opened
7 months ago
3
Please give a instruction to run Hardware-efficient Implementation dejaVu model inferenc,I Can't find the moudle src.models.gpt_sparse
#17
wangzhenyu32
opened
7 months ago
0
Question about OPT-30B
#16
Jimskns
opened
8 months ago
0
Missing full.pt when running latency benchmark
#15
PaulWang0513
opened
8 months ago
0
LLama 2 compatability
#14
yomanFX
opened
10 months ago
0
Some questions about implementation details
#13
SUDA-HLT-ywfang
opened
10 months ago
3
Fix typo in README.md
#12
eltociear
opened
10 months ago
0
Failed to collect training data for sparsity predictor
#11
PaulWang0513
opened
11 months ago
8
Compare the sparse model on downstream tasks
#10
iidsample
opened
11 months ago
2
Missing lm_eval harness for downstream task prediction
#9
iidsample
opened
11 months ago
0
Inconsisten File Names
#8
iidsample
opened
11 months ago
0
Missing Argument and Filtering
#7
iidsample
opened
11 months ago
0
Training MLP layer Issue
#6
iidsample
opened
11 months ago
1
fix file name format as they are named like *_sp_x_*
#5
bilgeacun
opened
11 months ago
0
AttributeError: 'OPTAttention' object has no attribute 'fp_query'
#4
bilgeacun
closed
11 months ago
5
No output in collecting training data
#3
bilgeacun
closed
11 months ago
13
Questions on sparse MLP implementation
#2
neuer93
closed
1 year ago
3
Predictor without activation function?
#1
YixinSong-e
closed
1 year ago
3