-
I found a workaround to fix it.
By adding a custom port here:
```python
runtime = sgl.Runtime(
model_path="lmms-lab/llama3-llava-next-8b",
tokenizer_path="lmms-lab/llama3-llava-next-8b…
-
Hello
Are there any plans to add [LLaVA-NeXT-Video-34B](https://huggingface.co/lmms-lab/LLaVA-NeXT-Video-34B) to llamacpp?
-
**LocalAI version:**
96a7a3b59ff73f71bfcbd080bc49094d3f30d101
**Environment, CPU architecture, OS, and Version:**
macOS 14.5
Apple M1 Pro
Environment prepared according to [build guide](http…
-
A couple of days ago I was testing Supir online running in "[replicate](https://replicate.com/cjwbw/supir)". At the end of the trial period and after the good results I decided to install it on my PC.…
-
### System Info
To the best of my understanding, https://github.com/huggingface/transformers/blob/12b1620e615592fbf099d4ec44af7b9f2d1b48aa/src/transformers/models/llava_next/modeling_llava_next.py#…
-
### Your current environment
```text
The output of `python collect_env.py`
```
### 🐛 Describe the bug
run LLaVA-NeXT | llava-hf/llava-v1.6-mistral-7b-hf
python -m vllm.entrypoints.…
-
nVidia Jetson Orin AGX, Respeaker 4.0 USB Mic Array
[LlamaSpeak Tutorial](https://github.com/dusty-nv/jetson-containers/tree/master/packages/llm/llamaspeak)
Installed Riva and Python Client no pro…
-
Hello guys,
I just followed your precess to prepare my own dataset as described [here](https://github.com/hpcaitech/Open-Sora/blob/main/docs/data_processing.md) and I must admit it went impressivel…
-
InternVL-1.1 中的结果
![image](https://github.com/user-attachments/assets/a617738c-5e45-41e6-8593-15cf0760e3c5)
InternVL-1.2 中的结果
![image](https://github.com/user-attachments/assets/dbe22e74-7998-4b6…
-
Is there a plan to support this new version of the LlaVA model: [here](https://github.com/LLaVA-VL/LLaVA-NeXT/tree/inference)?