OpenMOSS CoLLiE issues - Githubissues

OpenMOSS / CoLLiE

Collaborative Training of Large Language Models in an Efficient Way

https://openlmlab-collie.readthedocs.io

Apache License 2.0

400 stars 57 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

fix(dataset.py): fix wrong tokenization

#190 Anti-Entrophic opened 14 hours ago
0
feat(trainer)：added the dummy_train_loop function to check if the current configuration can run properly

#189 Zhyw0 opened 2 months ago
0
[example] an init train example for colo

#188 KaiLv69 closed 2 months ago
0
[example] an init train example for colo

#187 KaiLv69 closed 2 months ago
0
perf(trainer)：optimize the save logic of the trainer

#186 Zhyw0 closed 3 months ago
1
modify decodemetric class

#185 LinqiY closed 3 months ago
0
fix: fix dataset w/o labels

#184 KaiLv69 closed 3 months ago
0
refactor：change eval_steps when training

#183 yyyx-w closed 3 months ago
0
fix(model.py): align_preciion_in_norm_layer

#182 gyt1145028706 opened 3 months ago
0
如果想应用更多的模型，例如InstructBLIP，请问应该怎么修改呢？

#181 Listever opened 3 months ago
1
feat: Add MOSS2 tp&pp model and sparse attention kernel(in triton)

#180 Li-dongyang opened 3 months ago
1
perf(trainer): add save config and tokenizer when save model

#179 zsj555 closed 3 months ago
2
fix(dist_utils): fix port conflict in setup_distribution

#178 gyt1145028706 closed 3 months ago
3
fix(model): add load for safetensor

#177 ti-mm closed 3 months ago
1
refactor(example): refactor examples

#176 KaiLv69 closed 4 months ago
0
perf(config): set ds bs for hf models

#175 KaiLv69 closed 4 months ago
0
Add Mistral tp&pp model

#174 LinqiY opened 4 months ago
2
fix:CollieDatasetForTraining class not support list when loading data

#173 Zhyw0 closed 4 months ago
0
fix:CollieDatasetForTraining class not support list when loading data

#172 Zhyw0 closed 4 months ago
0
fix:CollieDatasetForTraining class not supporting list when loading data

#171 Zhyw0 closed 4 months ago
0
perf(monitor): add init mode for monitor

#170 KaiLv69 closed 4 months ago
0
Add an example for chat fine-tuning

#169 KYLN24 closed 4 months ago
0
fix: ColliePipelineEngine has no attribute using_bf16_optimizer

#168 KYLN24 closed 4 months ago
1
fix(dist_utils): fix port conflict in setup_distribution

#167 gyt1145028706 closed 4 months ago
0
fix(trainer): fix peft config save

#166 KaiLv69 closed 4 months ago
0
Update README.md

#165 xpqiu closed 4 months ago
1
fix(adalomo): fix adalomo without zero3

#164 KaiLv69 closed 4 months ago
0
No log information

#163 BeastyZ closed 4 months ago
2
feat(dataset): add multi-turn dataset with template

#162 KaiLv69 closed 4 months ago
1
Add Qwen2 tp&pp model

#161 Anti-Entrophic opened 4 months ago
1
add load Internlm2 with safetensors

#160 KaiLv69 closed 4 months ago
0
trainer.py文件中保存peft_config时会出错

#159 Mr-nnng closed 4 months ago
2
Add qwen2 tp&pp model

#158 Anti-Entrophic closed 4 months ago
2
希望能支持 safetensors 格式的权重

#157 WillQvQ closed 3 months ago
1
Add Internlm2

#156 KaiLv69 closed 5 months ago
0
add: Makefile support for 'build' and 'clean'

#155 WillQvQ closed 5 months ago
0
The interpetation about the transposition operation when spliting weight to tensor parallel group

#154 SparkJiao closed 5 months ago
2
关于增加千问模型的支持

#153 Jieni05 closed 6 months ago
11
lomo训练65b llama实测 Lomo is incompatible with pipeline parallelism

#152 zlh1992 opened 6 months ago
1
能否增加一个从头预训练的例子？

#151 liujuncn opened 7 months ago
1
LOMO优化器使用梯度裁剪导致训练时间翻倍？

#150 Jieni05 closed 7 months ago
2
Zero 2 gets stuck when initializing optimizer states

#149 tengxiaoliu closed 3 months ago
1
version 1.0.5, fix resume checkpoint, model save and generation

#148 KaiLv69 closed 7 months ago
0
update kv cache for generation and fix chatglm2

#147 KaiLv69 closed 7 months ago
0
Kv cache resume checkpoint

#146 MorningForest closed 8 months ago
0
支持 RLHF

#145 KYLN24 opened 8 months ago
0
在加载模型的时候，没有self.folder这个会报错

#144 459737087 closed 7 months ago
2
你好，怎么让保存的模型能够分片，而不是保存一个几十G的大模型

#143 459737087 opened 8 months ago
2
关于模型中断，重启的问题，怎么让模型继续训练

#142 459737087 closed 7 months ago
6
RendezvousConnectionError，跑着跑着就有这个报错

#141 459737087 closed 8 months ago
5