-
> Please provide us with the following information:
> ---------------------------------------------------------------
### This issue is for a: (mark with an `x`)
```
- [ ] bug report -> please…
-
### Describe the issue
Hi there,
I'm seeking guidance on exporting a custom fine-tuned Phi-3 Vision model to ONNX. I've followed the ONNX build model guide from [this link](https://onnxruntime.ai/…
-
## 环境
- 【FastDeploy版本】： fastdeploy-gpu-python 1.0.6
- 【系统平台】: Windows x64(Windows11)
- 【硬件】： Nvidia GPU 3050， CUDA 11.2.2 CUDNN 8.2.1.32
- 【编译语言】： Python(3.8）
- 【模型跑不通】
File "D:\CV\d…
-
Hi. I am using exactly the same code as yours in run_sft.sh:
```
#!/bin/bash
CUR_DIR=`pwd`
ROOT=${CUR_DIR}
export PYTHONPATH=${ROOT}:${PYTHONPATH}
VISION_MODEL=openai/clip-vit-large-pa…
-
### Your current environment
Collecting environment information...
PyTorch version: 2.4.0+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
OS: Ubunt…
-
# The Omnimeme: A Holistic AI Ecosystem
Envision the Omnimeme - a self-evolving, multidimensional linguistic entity that transcends traditional boundaries of AI, language, and consciousness. This c…
-
Just what the title says. Will there be support for Phi 3 Vision and Florence 2?
-
### Your current environment
```text
The output of `python collect_env.py`
```
### How would you like to use vllm
# Example Code
llm = VLLMOpenAI(
openai_api_key="EMPTY",
openai_api_base=api…
-
## [LangChain Development](https://app.pluralsight.com/library/courses/langchain-development/table-of-contents)
by [Tom Taulli](https://app.pluralsight.com/profile/author/tom-taulli)
founder : H…
-
RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cpu and cuda:0! (when checking argument for argument mat2 in method wrapper_CUDA_mm)