-
Hey unsloth team, beautiful work being done here.
I am the author of [MachinaScript for Robots](https://github.com/babycommando/machinascript-for-robots) - a framework for building LLM-powered robo…
-
Hi,
I am running the phi3.5 vision model using the below command on Apple M2 macbook:
'cargo run --release --features metal -- --port 1234 vision-plain -m microsoft/Phi-3.5-vision-instruct -a phi3v'…
-
Thanks for the conversion code for phi3-vision.
I'm making a app for concurrent requests that need continuous batching. Can I inference phi3-vision with batchsize larger than 1 ( I mean in onnx mode…
-
Hi there, is it possible to add this interesting model for the captionning ?
Infos : https://huggingface.co/microsoft/Phi-3-vision-128k-instruct
( I guess finetune like https://huggingface.co/D…
-
### Your current environment
```text
PyTorch version: 2.3.1+cu118
Is debug build: False
CUDA used to build PyTorch: 11.8
ROCM used to build PyTorch: N/A
OS: Ubuntu 22.04.3 LTS (x86_64)
GCC ve…
-
while running inference after **merging lora weights** with the following script
`
!python -m src.serve.cli \
--model-path /kaggle/working/Phi3-Vision-Finetune/output \
--image-file /kaggle/work…
-
Occasionally if I wait for a couple minutes between running a pyniryo2 script on a separate Ubuntu 18.04 machine, I will get this error.
```
Traceback (most recent call last):
File "basic_movemen…
-
As per the instructions, we were able to merge the base model and finetuned model. But on running eval we get this error:
![image](https://github.com/DLCV-BUAA/TinyLLaVABench/assets/45352897/88ed82…
-
### Describe the issue
I am running phi3-mini-int4 using the usual onnxruntime c# API and it is 2x as slow as when I use the [genai code](https://github.com/microsoft/onnxruntime-genai). I am using…
-
1、下载了Phi-3-Vision数据
2、设置example_image.sh中的参数PER_DEVICE_BATCH_SIZE=1,NUM_EPOCHS=5,训练集选择了celeba_image_train.json中的87条,测试集选择celeba_image_eval.json,训练的时候到87步出错:
20%|█████████████████████████████▊ …