-
我们如何针对扩展区块微调?
-
Dear @salman-h-khan ,
Thanks for your fantastic work GeoChat, I am really interested in it. And the ckpt provided by you works for me.
However, when I tried to reproduce it as a beginner of the …
-
### Question
Thank you for your work.I used 8xv100 32gb,94 cpu and 364gb memory.
#!/bin/bash
################## VICUNA ##################
PROMPT_VERSION=v1
MODEL_VERSION="vicuna-v1-3-7b"
#####…
-
Hi the team, great work!
QDoRA seems to be better than QLoRA, refer to [Efficient finetuning of Llama 3 with FSDP QDoRA](https://www.answer.ai/posts/2024-04-26-fsdp-qdora-llama3.html)
I wonder w…
-
### What happened?
I can't use docker + SYCL when using -ngl >0
With -ngl 0 it's ok
message error :
No kernel named _ZTSZZL17rms_norm_f32_syclPKfPfiifPN4sycl3_V15queueEiENKUlRNS3_7handlerEE0_c…
-
### What happened?
It seems llama-cli version 3952 doesn't generate any text response when the "--log-disable" parameter is set.
llama-cli version 3541 returns a text response regardless of the t…
-
Thanks for the wonderful work!
I am running the falcon-7b-instruct model with `falcon_main`, I generated the appropriate model with the conversion script and from warning messages, I can tell it is…
-
Hey there,
firstly, thanks for the nice work!
I am attempting to reproduce the results from the paper. I re-ran the experiments with 10 seeds (averaging the results). However, I am only reproduc…
-
### Prerequisites
- [X] I am running the latest code. Mention the version if possible as well.
- [X] I carefully followed the [README.md](https://github.com/ggerganov/llama.cpp/blob/master/README.md)…
-
Please comment here any model requests for:
- Models to be added to https://huggingface.co/neuralmagic
- Example scripts within `llm-compressor`