-
Hello,
I am trying to run the VILA model for inference, but I have encountered a couple of issues that I need help with.
(1)FlashAttention Issue: Initially, I faced a problem related to FlashAttenti…
-
I followed your installation protocol:
```
git clone https://github.com/mbzuai-oryx/LLaVA-pp.git
cd LLaVA-pp
git submodule update --init --recursive
# Copy necessary files
cp LLaMA-3-V/train…
-
# Prerequisites
Please answer the following questions for yourself before submitting an issue.
- [x] I am running the latest code. Development is very rapid so there are no tagged versions as of…
-
when i use IF_AI_tools.json to test. In IF_Chat_Prompt, engine is 'lmstudio' and tool is 'None'.
but server log show
` [2024-08-04 00:03:05.289] [ERROR] [Server Error] {"title":'"messages' array m…
-
Dear Experts,
I am trying to install llama-cpp-python in rhel 7.
I am getting following error:
*** CMake build failed
[end of output]
note: This error originates from a subpro…
-
I'm trying to get fine-tuning working through the 3_sft.sh script but am encountering an error:
```
Traceback (most recent call last):
File "/root/VILA/llava/train/train_mem.py", line 36, in
…
lyluh updated
2 weeks ago
-
Hi,
I am running llama-cpp-python on surface book 2 having i7 with nvidea geforce gtx 1060.
I installed vc++, cuda drivers 12.4
Running on Python 3.11.3
Compiled llama using below command on Min…
-
Hi there, I am able to download model from HF using VideoLlavaForConditionalGeneration.from_pretrained and optimize the model using ipex-llm.optimize_model(). But the process fails on generate() with …
-
Hi I just saw in redis that there is a llava model based on llama-3, can be added it to the library? Thanks
Source:https://www.reddit.com/r/LocalLLaMA/comments/1ca8uxo/llavallama38b_is_released/
-
I have never been able to correctly quantify awq for llava-llama3 in the official format of llava。
Can anyone help me?