-
环境:debian 11, gcc 10.2, cuda 12.0, cudnn 8.8
### 运行结果:
```shell
[INFO] fastdeploy/runtime/runtime.cc(264)::CreatePaddleBackend Runtime initialized with Backend::PDINFER in Device::GPU.
be…
-
Seems that microsoft/Phi-3.5-vision-instruct not working with below config
```
torchrun --nproc_per_node=1 \
src/training/train.py \
--lora_enable True \
--vision_lora True \
-…
-
This is an issue to collect requests for model abliterations.
No one is required to abliterate your request, but it does make for a good place to check if someone else has used this process on the…
-
### Your current environment
I'm not able to run `collect_env.py` on this workstation
vllm == 0.5.1
vllm-flash-attn == 2.5.9
torch == 2.3.0
Tested on a single A100-80GB
The following mes…
-
step1
pretrain_projector_image_encoder.sh
step2
pretrain_projector_video_encoder.sh
step3
finetune_dual_encoder.sh
step4
eval/vcgbench/inference/run_ddp_inference.sh
step5
eval/vcgbench/gpt_e…
-
HI, I am trying to add the LLM functionality to the android compatible devices. Can anyone tell me how to build for the android? Also, is any help on the front of Multimodal LLM deployment on mobile w…
-
### Prerequisites
- [X] I am running the latest code. Mention the version if possible as well.
- [X] I carefully followed the [README.md](https://github.com/ggerganov/llama.cpp/blob/master/README.md)…
-
Dear all,
I have fine-tuned TinyLLaVA-Phi-2-SigLIP-3.1B for 1 epoch and then continued the fine-tuning for another epoch starting from trained models saved after the first epoch. Both training runs w…
-
### This issue is for a: (mark with an `x`)
```
- [ ] bug report -> please search issues before submitting
- [ x ] feature request
- [ x ] documentation issue or request
- [ ] regression (a behav…
-
### Feature request
I encountered a KeyError while loading the phi3-v vision model into Optimum Huggingface. The error message states:
```
KeyError: 'phi3-v model type is not supported yet in Nor…