-
Need to modify [Gemma model implementation](https://github.com/EricLBuehler/mistral.rs/blob/master/mistralrs-core/src/models/gemma.rs) with:
## Changelist over original Gemma and status:
- [x] S…
-
### System Info
- `transformers` version: 4.44.0.dev0
- Platform: Linux-5.4.0-166-generic-x86_64-with-glibc2.31 …
-
## 🐛 Bug
## To Reproduce
Steps to reproduce the behavior:
1. I convert model weights and package libraries and weights on my macOS
1. So my mlc-package-config.json in ./android/MLCChat i…
-
### What is the issue?
I followed the below document to run the ollama model in GPU using Intel IPEX
https://github.com/intel-analytics/ipex-llm/blob/main/docs/mddocs/Quickstart/ollama_quickstart.…
-
**Issue Description**:
The endpoint `http://localhost:8000/v1/chat/completions` is failing to return a proper response when integrated with third-party AI chat frontends such as Chatbox and OpenCat…
-
### What happened?
### Goal
I want to use a custom hosted OpenAI LLM model instead of the one hosted by OpenAI.
Therefore I want to change OPENAI_API_BASE_URL.
### What happened
Using `fabric -…
-
### URL
https://python.langchain.com/v0.2/docs/integrations/vectorstores/chroma/
### Checklist
- [x] I added a very descriptive title to this issue.
- [X] I included a link to the documentation pag…
-
## ⚙️ Request New Models
- Link to an existing implementation (e.g. Hugging Face/Github):
-
gemma 2 cant be downloaded in alpaca where as i can download it in ollama directly
-
### Before submitting your bug report
- [ ] I believe this is a bug. I'll try to join the [Continue Discord](https://discord.gg/NWtdYexhMs) for questions
- [X] I'm not able to find an [open issue](ht…