search

PygmalionAI / aphrodite-engine

PygmalionAI's large-scale inference engine
https://pygmalion.chat
GNU Affero General Public License v3.0
721 stars 85 forks source link

Fix Navi support #466

Closed Naomiusearch closed 1 month ago

Naomiusearch commented 1 month ago

Fixed naive attention and made exl2 work on amd :3

AlpinDale commented 1 month ago

Thanks for the PR. There's been some quantization refactors following #454, but there won't be much work needed for this PR. I'll resolve the conflicts myself.