Glavin001
commented
1 year ago - https://github.com/turboderp/exllama
- https://github.com/oobabooga/text-generation-webui/blob/c7058afb402bd381d1983837b779c106217120b3/modules/exllama.py
Open Glavin001 opened 1 year ago
Glavin001
commented
1 year ago Glavin001
commented
1 year ago Use https://github.com/hommayushi3/exllama-runpod-serverless by @hommayushi3 🎉