Add support for using Llama 3-8B in AutoContext

D-Star-AI / dsRAG

High-performance retrieval engine for unstructured data

MIT License

853 stars 61 forks source link

Add support for using Llama 3-8B in AutoContext #5

Closed zmccormick7 closed 5 months ago

zmccormick7 commented 6 months ago

I'm not sure what the best way to do this is, because there are many ways to run LLMs locally, but Llama 3-8B should be a great choice for AutoContext.