-
### Model description
Lorax's official supported models does not list any vision model. This is a big gap for a very successful product.
Having lorax a critical component in our tech stack without …
-
**The bug**
Received the following error when using gen() with phi-3.5-mini
```Error
RuntimeError: Bad response to Guidance request
Request: https://model_name.region.models.ai.azure.com/guidance …
-
OpenAI 3.5 and 4o are included.
However, many open-source alternative LLMs exist too.
**TODO: decide which open-source alternatives to use.**
-
### Describe the issue
I am running phi3-mini-int4 using the usual onnxruntime c# API and it is 2x as slow as when I use the [genai code](https://github.com/microsoft/onnxruntime-genai). I am using…
-
## 🐛 Bug
When testing HF phi3 the gradients differ by several order of magnitudes from reference:
```shell
> torch.testing.assert_close(grads_ref, grads_compiled, rtol=1e-2, atol=1e-2)
E…
-
These are some notes for the [JOSS paper review](https://github.com/openjournals/joss-reviews/issues/6971). In general, I think it's a nice paper and potentially useful package.
Comments regarding …
-
https://huggingface.co/microsoft/Phi-3-medium-128k-instruct
https://huggingface.co/microsoft/Phi-3-medium-4k-instruct
https://huggingface.co/microsoft/Phi-3-small-8k-instruct
https://huggingf…
-
llava-phi-3-mini uses the Phi-3-instruct chat template. I think is similar with current llava-1-5, but with Phi3 instruct template instead of llama 2.
format:
`\nQuestion \n`
stop word is
for…
-
I'm not sure if this is stated in the docs, but currently running one agent with a specific model that has a tool which calls another agent(with a different model) will fail to do so and ends up in an…
-
### What is the issue?
When I start the Conversation in German Language, Phi-3 Mini and Medium working fine. But after some Conversations, the Models starting producing slowly Gibberish and Nonsens a…