-
Here's the call I'm using to run the script:
```
ACCELERATE_LOG_LEVEL=info accelerate launch --config_file examples/hf-alignment-handbook/configs/accelerate_configs/deepspeed_zero3.yaml --num_proces…
-
The growth in size of open-source models is outpacing the growth of memory capacity of Mac computers. The latest 70B version of Llama 3 is already pushing the limits of a fully loaded Mac Pro. The upc…
-
![微信截图_20240713161048](https://github.com/user-attachments/assets/179a13fc-1dce-45d5-b803-69151cab8e56)
转换后的文件和说明中的不同
-
hope can use llama3.1 soon on ollama
-
My environment seems to be installed successfully and I can open the chat website, but I'm unsure where to set the path for the large model?"
![image](https://github.com/user-attachments/assets/1ab…
-
### Is there an existing issue for this?
- [X] I have searched the existing issues
### Current Behavior
各位大佬有没有碰到过这个问题,官方代码没改动执行碰到的,网上的解决方案不work
File "/home/work/LLM/chatglm/ptuning/main.py", li…
-
Is there any way to save intermediate checkpoints during training?
Sometimes my training may fail during the middle due to external reasons, it will be helpful to save every N steps so I can contin…
-
Hi,
i m sorry, i don't find how unload model. like i load a model, i delete the object and i call the garbage collector but it does nothing.
How we are suppose to unload model?
I want to load a mo…
-
1*8H100 DGX BOX
Torch version: 2.1.1
CUDA version: 12.1
VLLM: 0.2.3
The inference works just fine in tensor parallel 1 but when using **tp > 1** I am getting this error below:
WARNING 12-0…
-
### 先决条件
- [X] 我已经搜索过 [问题](https://github.com/open-compass/opencompass/issues/) 和 [讨论](https://github.com/open-compass/opencompass/discussions) 但未得到预期的帮助。
- [X] 错误在 [最新版本](https://github.com/open-com…