-
I'm running the inference speed [script](https://github.com/AutoGPTQ/AutoGPTQ/blob/main/examples/benchmark/generation_speed.py) to compare the performance between fp16 and 4-bit of llama-7b (in fact, …
-
Thank you for such work!
I have been trying to use the Library for image captioning. by follwoing the instructions in @ouhenio comment on this thread: https://github.com/salesforce/LAVIS/issues/313…
-
Thanks for your great work! I'm wondering if u can share the loss curve for training llava-next-llama3? I've observed some different behaviour compared to training llava-next-vicuna-7b. I'm wondering …
-
In the given examples axoltol [exmaples/medusa](https://github.com/ctlllll/axolotl/tree/main/examples/medusa),
I follow the `vicuna_7b_qlora_stage1.yml` and `vicuna_7b_qlora_stage2.yml` to write my …
-
### System Info
`text-generation-launcher --env:`
```
2024-08-28T05:17:36.254761Z INFO text_generation_launcher: Runtime environment:
Target: x86_64-unknown-linux-gnu
Cargo version: 1.79.0
Comm…
-
Dear Authors,
In `src/generation/run.py`, there are many places requiring data from `tool/test_data` or `tool/new_test_res`.
But these data are neither provided in the repository nor generated aft…
-
Hello,
If I understand the process from the paper correctly, we are using the 2017 images with their corresponding questions from the test set of [Science QA](https://drive.google.com/drive/folder…
-
大佬您好,我看到stage1,不太理解set pretrained in stage1_config该怎么设置,点进去后是404 Not Found。在.sh文件中看到一些设置后,请问用bash命令行的意思是只能在服务器上运行,不能在个人电脑上运行吗?
-
As a reminder, I find that the config of [eachadea/vicuna-7b-1.1](https://huggingface.co/eachadea/vicuna-7b-1.1/tree/main) and [lmsys-vicuna-7b-v1.1](https://huggingface.co/lmsys/vicuna-7b-v1.1) are d…
-
**LocalAI version:**
LocalAI version v1.20.1-57-gd0e67cc (d0e67cce7550389b657d37bc5956ce4a9e925321)
(compiled with Metal flag)
**Environment, CPU architecture, OS, and Version:**
Local…