search

rustformers / llm

[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models
https://docs.rs/llm/latest/llm/
Apache License 2.0
6.07k stars 355 forks source link

Out of context answers #453

Open DravidVaishnav opened 6 months ago

DravidVaishnav commented 6 months ago

Screenshot from 2024-03-15 19-03-23 tried using llama (6.9 gb) model with cli, as well as code, but it is generating out of context answers, and often even giving questions as output, is there any way to solve this ?