GATECH-EIC / Edge-LLM

[DAC 2024] EDGE-LLM: Enabling Efficient Large Language Model Adaptation on Edge Devices via Layerwise Unified Compression and Adaptive Layer Tuning and Voting
29 stars 4 forks source link

error #2

Open SSSLuckyStar opened 2 months ago

SSSLuckyStar commented 2 months ago

Has anyone successfully run this project? I encountered a lot of errors during the process. What is the minimum GPU VRAM configuration required to run this project successfully?