search

arcee-ai / PruneMe

Automated Identification of Redundant Layer Blocks for Pruning in Large Language Models
177 stars 21 forks source link

script availability #11

Closed snapo closed 16 hours ago

snapo commented 1 month ago

Do you maybe have the script available with which you created this graph:

image

Would love to do create that graph for a small 1.2B model of mine that i am working on. (this would allow me to lock specific layers, so that all layers provide the same ammount of information)

shamanez commented 16 hours ago

I just converted the output CSV to a graph :D