search

sobelio / llm-chain

`llm-chain` is a powerful rust crate for building chains in large language models allowing you to summarise text and complete complex tasks
https://llm-chain.xyz
MIT License
1.31k stars 128 forks source link

Local LLM Backend #116

Closed danforbes closed 1 year ago

danforbes commented 1 year ago

This seems to work in simple cases, but it's a very naive implementation and I'm happy to accept any suggestions to improve it.

Note that this is using a feature branch of the llm crate https://github.com/rustformers/llm/compare/main...danforbes:llama-rs:dfo/chore/llm-chain

cc: @philpax