issues
search
OpenMOSS
/
CoLLiE
Collaborative Training of Large Language Models in an Efficient Way
https://openlmlab-collie.readthedocs.io
Apache License 2.0
410
stars
58
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Sync main -> dev
#90
00INDEX
closed
1 year ago
0
请教 DEV分支的这个改动 ：support llama2 ，llama-2和llama-1可以同时都支持么？
#89
hijeffwu
closed
1 year ago
2
是否可以增加 LLAMA2的支持？谢谢
#88
hijeffwu
closed
1 year ago
3
llama-2-7b拓展词表报错
#87
skepsun
opened
1 year ago
4
Dev
#86
x54-729
closed
1 year ago
0
deep_speed initialization for models in the transformers library
#85
DesperateExplorer
opened
1 year ago
6
save_16bit_model does not save the proper state_dict
#84
DesperateExplorer
closed
1 year ago
11
feat: add more shields🤗
#83
00INDEX
closed
1 year ago
0
Fix: incorrect syntax in requirements.txt
#82
00INDEX
closed
1 year ago
0
feat: create python-publish.yml
#81
00INDEX
closed
1 year ago
0
预训练模型为何是从不同路径获取的，这是有其他考虑么？
#80
hijeffwu
closed
1 year ago
2
请问 Collie 的开源协议是什么？可否添加一个协议文件
#79
hijeffwu
closed
1 year ago
0
add memory profile and fix lomo
#78
KaiLv69
closed
1 year ago
0
llama在张量并行模式下的attention score计算是否有问题？
#77
ZRayZzz
closed
1 year ago
2
在3090上使用collie微调moss7B，flash_attn报错
#76
ShacklesLay
closed
1 year ago
2
Dev
#75
00INDEX
closed
1 year ago
0
fix bf16+zero3
#74
KaiLv69
closed
1 year ago
0
Update CLI
#73
KaiLv69
closed
1 year ago
0
Resolve conflicts
#72
KaiLv69
closed
1 year ago
0
save_checkpoint
#71
lw3259111
closed
1 year ago
4
bf16是否支持？
#70
lw3259111
closed
1 year ago
5
megatron是哪个版本
#69
skepsun
closed
1 year ago
4
fix: bugs in pp+tp generation
#68
00INDEX
closed
1 year ago
0
Dev
#67
00INDEX
closed
1 year ago
0
项目readme里面说的A100是多少G版本的。
#66
ArtificialZeng
closed
1 year ago
3
Feature: CLI improvement
#65
KYLN24
closed
1 year ago
0
除了设置checkpointing之外，dp+tp+pp下，还有什么方式可以降低显存消耗？
#64
ZRayZzz
closed
1 year ago
3
Dev
#63
00INDEX
closed
1 year ago
0
跑3D并行时，如果节点数大于1，会卡住
#62
ZRayZzz
closed
1 year ago
3
Update lomo.py
#61
KaiLv69
closed
1 year ago
1
Feature: add a simple CLI tool to generate config file for CoLLiE
#60
KYLN24
closed
1 year ago
2
Dev
#59
00INDEX
closed
1 year ago
0
UnboundLocalError: local variable 'master_addr' referenced before assignment
#58
breadbrowser
closed
1 year ago
6
Dev
#57
00INDEX
closed
1 year ago
0
Dev
#56
00INDEX
closed
1 year ago
0
Dev
#55
00INDEX
closed
1 year ago
0
Integrate peft
#54
KaiLv69
closed
1 year ago
0
Dev
#53
00INDEX
closed
1 year ago
0
Dev
#52
00INDEX
closed
1 year ago
0
Delete examples/one_sentence_overfitting/flagged directory
#51
00INDEX
closed
1 year ago
0
Set ds log's default log to ERROR
#50
KaiLv69
closed
1 year ago
0
Dev
#49
KaiLv69
closed
1 year ago
0
Update features.svg
#48
KaiLv69
closed
1 year ago
0
Update readme
#47
KaiLv69
closed
1 year ago
0
add inplace_sgd and fix some typo
#46
KaiLv69
closed
1 year ago
0
Add lora with zero-3 and slightly modify train_fn in trainer
#45
KaiLv69
closed
1 year ago
0
fix bug: missing range
#44
jlhe2000
closed
1 year ago
0
add grad_norm in zero trainer & all reduce gradient before update
#43
KaiLv69
closed
1 year ago
0
add offload
#42
00INDEX
closed
1 year ago
0
fix bug when use torchrun
#41
00INDEX
closed
1 year ago
0
Previous
Next