CASIA-IVA-Lab / FLAP

[AAAI 2024] Fluctuation-based Adaptive Structured Pruning for Large Language Models
https://arxiv.org/abs/2312.11983
Apache License 2.0
30 stars 4 forks source link

request for the inference speed test script #8

Open JCDemon opened 3 months ago

JCDemon commented 3 months ago

image I saw the evaluation results of the inference speed before and after pruning in the paper, I'm wondering if I can ask for a copy of the test script, I wanna reproduce the result. thank you!