search

henk717 / KoboldAI

KoboldAI is generative AI software optimized for fictional use, but capable of much more!
http://koboldai.com
GNU Affero General Public License v3.0
371 stars 134 forks source link

Feature request: more ExLlamav2 customizations #510

Open scavru opened 8 months ago

scavru commented 8 months ago

need to enable the 8-bit cache, and the number of contexts can be expanded and the context window itself holds 4 digits, the rest is cut off. Thank you for your work.