32k context model - Githubissues

Sebby37 / Dead-Internet

Y'all thought the dead internet theory wasn't real, but HERE IT IS

143 stars 15 forks source link

32k context model #5

Open Zetaphor opened 2 months ago

Zetaphor commented 2 months ago

Just wanted to bring this to your attention as I saw some of the code comments about context limitations:

https://huggingface.co/MaziyarPanahi/Llama-3-8B-Instruct-32k-v0.1-GGUF

Sebby37 commented 2 months ago

Thanks! Yeah I've heard about that model but never got around to testing it, might give it a shot and see how well works compared to the regular 8k version