-
### Please check that this issue hasn't been reported before.
- [X] I searched previous [Bug Reports](https://github.com/axolotl-ai-cloud/axolotl/labels/bug) didn't find any similar reports.
###…
-
### The model to consider.
```python
from typing import List
from fastapi import FastAPI, HTTPException
from pydantic import BaseModel
from PIL import Image
from vllm import LLM, SamplingParam…
-
**Describe the bug**
I've tried to copy the HelloPhi example for loading and calling phi-3.5 in DirectML for my application. When I get to the [generator.ComputeLogits()](https://github.com/microsoft…
-
Hi, really awesome work.
I am working on panorama and perspective 3D vision, and recently we are organizing a huge panorama dataset from scratch, we also try to transform panorama to perspective ima…
-
[MiniCPM3-4B](https://huggingface.co/openbmb/MiniCPM3-4B) is the 3rd generation of MiniCPM series. The overall performance of MiniCPM3-4B surpasses Phi-3.5-mini-Instruct and GPT-3.5-Turbo-0125, being …
-
When I was building the Android SDK according to the official documentation, the 'mlc_llm package' command had difficulty downloading the model and always timed out for the connection, hoping to get…
-
### Content Type
Article
### Article Description
This article will guide readers through the process of setting up and running Phi-3 Labs samples inside a Daytona environment using a .NET setup w…
nkkko updated
2 months ago
-
### What is the issue?
In a relatively simple prompt, one of the Phi models went off track and ranted for several thousand words. After, all future responses produced (mostly) garbage output, even in…
-
### bug描述 Describe the Bug
I encountered an issue when using `paddle.nn.functional.ctc_loss` with Python 3.12. The following code crashed and raised a `Segmentation fault` :
```python
import padd…
-
### Your current environment
> No module named 'vllm._version'
> from vllm.version import __version__ as VLLM_VERSION
> Collecting environment information...
> PyTorch version: 2.4.0+cu121
> Is…