search

mit-han-lab / llm-awq

[MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration
MIT License
2.08k stars 150 forks source link

Rocm support request #194

Open Wintoplay opened 1 month ago

Wintoplay commented 1 month ago

please consider adding Rocm support for AMD RDNA3 + other amd gpu