-
`nvcc -V`
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2022 NVIDIA Corporation
Built on Wed_Jun__8_16:59:34_Pacific_Daylight_Time_2022
Cuda compilation tools, release 11.7, V11.7.99
B…
-
### Is there an existing issue for this?
- [X] I have searched the existing issues
### Description of the Bug
model = BloomForCausalLM.from_pretrained(path)
model = bmt.BMTrainModelWrapper(model)
…
-
I'd like to know if bitsandbytes can be decoupled from huggingface, or if they have to be used together. In addition, is the int4 quantization process completed during the get_accelerate_model phase a…
-
GPU:V100
torch version:1.10.0+cu113
Python 3.7.13
bmtrain:0.2.1
![image](https://user-images.githubusercontent.com/29090584/217821166-a8692c8d-8ebf-4324-8189-1809fc4692fb.png)
![image](https://us…
-
If I wanna use CPU Offloading in my model, which API should I call in BMTrain?
-
Hi,
When using BMCOOK with BMTrain I encountered a bug that the second bmtrain.synchronize() is always stuck. Do you probably have any ideas?
Below is the code:
```
import os
import json
i…
-
### Description
一张卡不足加载glm-10b的模型,如何进行多卡训练
### Alternatives
_No response_
-
^MLoading checkpoint shards: 0%| | 0/3 [00:00
-
When using bmtrain to train my model, the code successfullt run to the last line but give me a segment fault.
![image](https://user-images.githubusercontent.com/72364657/215935249-ce9dcb43-d0aa-4ce5-…
-
Allowing ninja to set a default number of workers... (overridable by setting the environment variable MAX_JOBS=N)
[1/3] c++ -MMD -MF /tmp/pip-install-c6m09ftc/bmtrain_85cbac71a04c4746abbb40699…