issues
search
OpenMOSS
/
CoLLiE
Collaborative Training of Large Language Models in an Efficient Way
https://openlmlab-collie.readthedocs.io
Apache License 2.0
400
stars
57
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
fix(dataset.py): fix wrong tokenization
#190
Anti-Entrophic
opened
14 hours ago
0
feat(trainer):added the dummy_train_loop function to check if the current configuration can run properly
#189
Zhyw0
opened
2 months ago
0
[example] an init train example for colo
#188
KaiLv69
closed
2 months ago
0
[example] an init train example for colo
#187
KaiLv69
closed
2 months ago
0
perf(trainer):optimize the save logic of the trainer
#186
Zhyw0
closed
3 months ago
1
modify decodemetric class
#185
LinqiY
closed
3 months ago
0
fix: fix dataset w/o labels
#184
KaiLv69
closed
3 months ago
0
refactor:change eval_steps when training
#183
yyyx-w
closed
3 months ago
0
fix(model.py): align_preciion_in_norm_layer
#182
gyt1145028706
opened
3 months ago
0
如果想应用更多的模型,例如InstructBLIP,请问应该怎么修改呢?
#181
Listever
opened
3 months ago
1
feat: Add MOSS2 tp&pp model and sparse attention kernel(in triton)
#180
Li-dongyang
opened
3 months ago
1
perf(trainer): add save config and tokenizer when save model
#179
zsj555
closed
3 months ago
2
fix(dist_utils): fix port conflict in setup_distribution
#178
gyt1145028706
closed
3 months ago
3
fix(model): add load for safetensor
#177
ti-mm
closed
3 months ago
1
refactor(example): refactor examples
#176
KaiLv69
closed
4 months ago
0
perf(config): set ds bs for hf models
#175
KaiLv69
closed
4 months ago
0
Add Mistral tp&pp model
#174
LinqiY
opened
4 months ago
2
fix:CollieDatasetForTraining class not support list when loading data
#173
Zhyw0
closed
4 months ago
0
fix:CollieDatasetForTraining class not support list when loading data
#172
Zhyw0
closed
4 months ago
0
fix:CollieDatasetForTraining class not supporting list when loading data
#171
Zhyw0
closed
4 months ago
0
perf(monitor): add init mode for monitor
#170
KaiLv69
closed
4 months ago
0
Add an example for chat fine-tuning
#169
KYLN24
closed
4 months ago
0
fix: ColliePipelineEngine has no attribute using_bf16_optimizer
#168
KYLN24
closed
4 months ago
1
fix(dist_utils): fix port conflict in setup_distribution
#167
gyt1145028706
closed
4 months ago
0
fix(trainer): fix peft config save
#166
KaiLv69
closed
4 months ago
0
Update README.md
#165
xpqiu
closed
4 months ago
1
fix(adalomo): fix adalomo without zero3
#164
KaiLv69
closed
4 months ago
0
No log information
#163
BeastyZ
closed
4 months ago
2
feat(dataset): add multi-turn dataset with template
#162
KaiLv69
closed
4 months ago
1
Add Qwen2 tp&pp model
#161
Anti-Entrophic
opened
4 months ago
1
add load Internlm2 with safetensors
#160
KaiLv69
closed
4 months ago
0
trainer.py文件中保存peft_config时会出错
#159
Mr-nnng
closed
4 months ago
2
Add qwen2 tp&pp model
#158
Anti-Entrophic
closed
4 months ago
2
希望能支持 safetensors 格式的权重
#157
WillQvQ
closed
3 months ago
1
Add Internlm2
#156
KaiLv69
closed
5 months ago
0
add: Makefile support for 'build' and 'clean'
#155
WillQvQ
closed
5 months ago
0
The interpetation about the transposition operation when spliting weight to tensor parallel group
#154
SparkJiao
closed
5 months ago
2
关于增加千问模型的支持
#153
Jieni05
closed
6 months ago
11
lomo训练65b llama实测 Lomo is incompatible with pipeline parallelism
#152
zlh1992
opened
6 months ago
1
能否增加一个从头预训练的例子?
#151
liujuncn
opened
7 months ago
1
LOMO优化器使用梯度裁剪导致训练时间翻倍?
#150
Jieni05
closed
7 months ago
2
Zero 2 gets stuck when initializing optimizer states
#149
tengxiaoliu
closed
3 months ago
1
version 1.0.5, fix resume checkpoint, model save and generation
#148
KaiLv69
closed
7 months ago
0
update kv cache for generation and fix chatglm2
#147
KaiLv69
closed
7 months ago
0
Kv cache resume checkpoint
#146
MorningForest
closed
8 months ago
0
支持 RLHF
#145
KYLN24
opened
8 months ago
0
在加载模型的时候,没有self.folder这个会报错
#144
459737087
closed
7 months ago
2
你好,怎么让保存的模型能够分片,而不是保存一个几十G的大模型
#143
459737087
opened
8 months ago
2
关于模型中断,重启的问题,怎么让模型继续训练
#142
459737087
closed
7 months ago
6
RendezvousConnectionError,跑着跑着就有这个报错
#141
459737087
closed
8 months ago
5
Next