-
This is not a feature/bug, just a question, since there is no discussion board I'll leave it here.
I have multiple hugging face models hosted and running OpenAI compatible endpoints.
After hookin…
-
## Goals
- collect data on HyDE effectiveness with open source LLMs
## Tested LLMs
- [x] Mistral 7B instruct v0.2
- [x] Llama2 7B chat hf
- [x] Zepyher-7B beta
## Benchmark Results
##…
-
### Contact Details
rpchastain@proton.me
### What happened?
I'm attempting to use `mixtral-8x7b-instruct-v0.1.Q5_K_M.gguf` weights on an AWS ec2 instance with an AMD EPYC 7R13 and 4 NVidia L4 gpus.…
-
Hello, FlexFlow team!
Thank you for your outstanding work! I am attempting to reproduce the experimental results from the paper "SpecInfer: Accelerating Generative Large Language Model Serving with…
-
Hi, I am learning Lean4 for the purpose of LLM accelerated proof writing, thank you so so much for writing this book and posting it online open sourced. This book is easier than the other several book…
-
# Prerequisites
Please answer the following questions for yourself before submitting an issue.
- [x ] I am running the latest code. Development is very rapid so there are no tagged versions as o…
-
Hi, i tried the example code to see if the scraper works but it always return a validation error for attribute `top` which is supposed ton be an array.
here are my example code, a bit tweaked to u…
-
**What problem or use case are you trying to solve?**
THis would be ideal to solve any installation issues.
**Describe the UX of the solution you'd like**
Just a working docker-compose.yaml file…
-
### What version of Music Assistant has the issue?
2.2.1
### What version of the Home Assistant Integration have you got installed?
2024.8.2
### Have you tried everything in the Troubleshooting FA…
-
Trying to reproduce evaluation numbers but not able to.
Ex : For gemma-2-9b, the technical report mentions 68.2 on BBH 3 shot CoT while the open llm [leaderboard](https://huggingface.co/spaces/ope…