-
I'd like to run it locally.
Thanks in advance,
-
## 🐛 Bug
Hello team,
Thanks for creating such an amazing engine. I ran Llama-3-8B-Instruct-q4f16_1-MLC in server mode with different batch sizes (2-128) but I still see my requests are being run …
-
Due to some financial problems, I can only use a intermediate interface instead of the original openai one. How can I configure a different model? I followed instructions from [here](https://llm.data…
-
Hi,
you are doing a great thing to make the whisper available on android in the future.
Recently, I hope to deployed the llm on SA8295 and 8775 NPU 🌵, but there few tutorial about this, and I …
-
### System Info
H100, Llama 70B
### Who can help?
_No response_
### Information
- [ ] The official example scripts
- [ ] My own modified scripts
### Tasks
- [ ] An officially supported task in …
-
[ ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug.
**Describe the bug**
I am able to calculate 4 metrics {'faithfulness': 1.0000, 'an…
-
Hello you all keep scratching my head why sometimes I can deploy all on list but stuff I find having issues
anyways this is my logs just trying to use this repo https://huggingface.co/mistralai/Mis…
-
**LocalAI version:**
v2.4.1
**Environment, CPU architecture, OS, and Version:**
MBP 14 M1 PRO
**Describe the bug**
Not working make build and make BUILD_TYPE=metal build
**To Reproduce…
-
Hi, thank you for this project. While trying to set it up, I get this error:
`FileNotFoundError: Table test does not exist.Please first call db.create_table(test, data)`
I installed all required m…
-
[ ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug.
**Describe the bug**
```
openai.BadRequestError: Error code: 400 - {'detail': 'In…