-
nvcc --version
```
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2023 NVIDIA Corporation
Built on Fri_Jan__6_16:45:21_PST_2023
Cuda compilation tools, release 12.0, V12.0.140
Build cu…
-
### System Info
- This was tested o na tp=4 4xH100 SXM setup
- I tested these 2 releases: https://github.com/NVIDIA/TensorRT-LLM/pull/1763 and https://github.com/NVIDIA/TensorRT-LLM/pull/1725
#…
-
Hi,
I am DPO training a checkpoint of Mixtral-8x7B-Instruct, from the previous supervised finetune.
I mainly followed this script https://github.com/huggingface/trl/blob/main/examples/research…
-
Lora+base is working good
:
raise ValueError(
ValueError: Targe…
-
I have fine-tuned the model with LoRA implementation, and after model saving, I and only the adapter_config.json file.
Is this correct way to evaluate the fine-tuned model?
I got some result but…
-
LLM to hook the RAG up to: