-
Trying to reproduce evaluation numbers but not able to.
Ex : For gemma-2-9b, the technical report mentions 68.2 on BBH 3 shot CoT while the open llm [leaderboard](https://huggingface.co/spaces/ope…
-
### System Info
CPU Architecture x86
A100 40GB
### Who can help?
_No response_
### Information
- [X] The official example scripts
- [ ] My own modified scripts
### Tasks
- [X] An officially…
jlewi updated
1 month ago
-
### Prerequisites
- [X] I am running the latest code. Mention the version if possible as well.
- [X] I carefully followed the [README.md](https://github.com/ggerganov/llama.cpp/blob/master/README.…
-
title says it all
-
There is one great open source project on GitHub called LiteLLM.
https://github.com/BerriAI/litellm
If that project is integrated to this project then this task of todo check list can be easily fu…
-
### Checked other resources
- [X] I added a very descriptive title to this issue.
- [X] I searched the LangChain documentation with the integrated search.
- [X] I used the GitHub search to find a…
-
Is there a possibility that this could use open source LLM?
OpenAi costs money and there are open source LLM's out there
-
A have a local LLM or better said, I am working with Llama.cpp, the thing is that I open the file I will be making my prompts, but since I am working with the server, each prompt is taken as if it wer…
-
I have followed the steps of the "How-To-Guide" about Automatic Language Adaptation (https://docs.ragas.io/en/v0.1.9/howtos/applications/use_prompt_adaptation.html) and tried to modify the already im…
-
Remember, an issue is not the place to ask questions. You can use our [Slack channel](https://github.com/OWASP/www-project-top-10-for-large-language-model-applications/wiki) for that, or you may want …