FMInference DejaVu issues

FMInference / DejaVu

262 stars 32 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

How to test the sparsity of the model？

#32 lw20191012 opened 1 week ago
0
Training of predictors based on MOE model

#31 mailonghua opened 1 month ago
0
Question about downsteam tasks accuracy

#30 W-215 opened 1 month ago
0
the issue of parameter settings

#29 W-215 opened 2 months ago
0
How to run on a single GPU?

#28 xbzjsj opened 4 months ago
7
PyTorch 1.12 and flash-attn==0.2.8 are not compatible.

#27 heheda12345 opened 4 months ago
0
Questions about Attention Sparsity Implementation

#26 czq693497091 closed 4 months ago
0
the code about collect activations while inferencing

#25 mli-tian opened 4 months ago
0
How to run the code with smaller ckpt like opt-6.7B

#24 czq693497091 opened 4 months ago
11
A question about attention block sparsity

#23 imh966 opened 5 months ago
0
Clarification on Output Neuron Pruning Method in "Deja Vu: Contextual Sparsity for Efficient LLMs at Inference Time"

#22 adamgallas closed 5 months ago
1
In fp16, the sparse kernel is slower than PyTorch dense gemm

#21 sleepcoo closed 5 months ago
0
1

#20 sleepcoo closed 6 months ago
0
Miss csrc folder when building docker images

#19 Mi5sssss opened 7 months ago
3
Does anyone know if this work is implemented on llama?

#18 wyxscir opened 7 months ago
3
Please give a instruction to run Hardware-efficient Implementation dejaVu model inferenc,I Can't find the moudle src.models.gpt_sparse

#17 wangzhenyu32 opened 7 months ago
0
Question about OPT-30B

#16 Jimskns opened 8 months ago
0
Missing full.pt when running latency benchmark

#15 PaulWang0513 opened 8 months ago
0
LLama 2 compatability

#14 yomanFX opened 10 months ago
0
Some questions about implementation details

#13 SUDA-HLT-ywfang opened 10 months ago
3
Fix typo in README.md

#12 eltociear opened 10 months ago
0
Failed to collect training data for sparsity predictor

#11 PaulWang0513 opened 11 months ago
8
Compare the sparse model on downstream tasks

#10 iidsample opened 11 months ago
2
Missing lm_eval harness for downstream task prediction

#9 iidsample opened 11 months ago
0
Inconsisten File Names

#8 iidsample opened 11 months ago
0
Missing Argument and Filtering

#7 iidsample opened 11 months ago
0
Training MLP layer Issue

#6 iidsample opened 11 months ago
1
fix file name format as they are named like *_sp_x_*

#5 bilgeacun opened 11 months ago
0
AttributeError: 'OPTAttention' object has no attribute 'fp_query'

#4 bilgeacun closed 11 months ago
5
No output in collecting training data

#3 bilgeacun closed 11 months ago
13
Questions on sparse MLP implementation

#2 neuer93 closed 1 year ago
3
Predictor without activation function?

#1 YixinSong-e closed 1 year ago
3