search

FMInference / DejaVu

283 stars 36 forks source link

How to test the sparsity of the model？ #32

Open lw20191012 opened 2 months ago

lw20191012 commented 2 months ago

I'm looking for guidance on how to test the sparsity of MLP and Attention layers. Could you provide some advice?

LiuJinzhe-Keepgoing commented 1 month ago

I'm looking for guidance on how to test the sparsity of MLP and Attention layers. Could you provide some advice?

I have encountered the same confusion. Have you found a solution? Can you share the code?

lw20191012 commented 1 month ago

I'm looking for guidance on how to test the sparsity of MLP and Attention layers. Could you provide some advice?

I have encountered the same confusion. Have you found a solution? Can you share the code? I'm sorry! I haven't find a proper way to solve the problem.