issues
search
OpenMOSS
/
CoLLiE
Collaborative Training of Large Language Models in an Efficient Way
https://openlmlab-collie.readthedocs.io
Apache License 2.0
405
stars
58
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
AttributeError: 'PeftModelForCausalLM' object has no attribute 'set_cache'
#140
JiafeiSun
closed
9 months ago
2
关于 adalomo 没有 loss_scaler 只有 loss_scale 的问题
#139
HappyLynn
opened
9 months ago
1
A100单卡跑llama2 finetune lora报错oom
#138
JiafeiSun
closed
9 months ago
2
No module named 'collie.callbacks.pefts'
#137
JiafeiSun
closed
9 months ago
2
chatGLM2 好像目前不支持ptuning训练，有计划什么时候支持么
#136
BlueSkyyyyyy
opened
10 months ago
2
chatGLM2 使用张量并行报错
#135
BlueSkyyyyyy
closed
8 months ago
6
是否可以新增chatglm3 支持？
#134
hijeffwu
closed
9 months ago
3
__init__() missing 'init_method' and 'config'
#133
yueg-security
closed
10 months ago
1
AdaLomo optimizer step method
#132
winglian
opened
10 months ago
3
张量并行流水并行可以和lora一起使用么？报错ValueError: Target module ColumnParallelLinearWithoutBias() is not supported. Currently, only `torch.nn.Linear` and `Conv1D` are supported.
#131
BlueSkyyyyyy
closed
10 months ago
3
是否可以增加baichuan-2 的fine-tuning支持? 或者 是否可以给一个 如何 新增微调模型的guide？ 谢谢
#130
wuchangping
closed
11 months ago
3
重构ChatGLM2并增加对应测试用例
#129
MorningForest
closed
10 months ago
0
add adalomo
#128
KaiLv69
closed
11 months ago
0
能不能重新训练啊？
#127
459737087
closed
9 months ago
3
使用的Megatron-LM的版本
#126
liaosnow
closed
11 months ago
11
move load_peft to peft_utils and some peft examples
#125
KYLN24
closed
11 months ago
2
[Feature] examples 里是否可以新增一个 internLM的用例？
#124
wuchangping
closed
11 months ago
1
使用数据类_ShardContainer遇到错误
#123
xuguohai
opened
11 months ago
1
How to convert parallel state_dict to normal state_dict?
#122
JinchaoLove
opened
12 months ago
3
Evaluating is too slow
#121
JinchaoLove
closed
8 months ago
2
该项目能否用于对模型进行二次预训练
#120
Zheng-Jay
closed
11 months ago
3
[BUG] Evaluation 时使用并行可能不会完整地遍历一遍数据
#119
KYLN24
opened
1 year ago
1
[BUG] 使用 CollieDatasetForClassification 在 helm 风格下进行分类评测时，max new token 截取存在问题
#118
KYLN24
closed
12 months ago
0
Could Lomo class support `param_groups`?
#117
JinchaoLove
opened
1 year ago
0
ColumnParallelLinearWithoutBias is not supported by peft
#116
JinchaoLove
closed
1 year ago
5
ImportError: cannot import name 'PeftConfig' from 'peft.utils'
#115
lisherlock
closed
11 months ago
7
基于CoLLie训练7B Moss模型，无法使用Huggingface的AutoModelForCausalLM加载吗？
#114
xuguohai
closed
11 months ago
3
[问题]有关训练可视化
#113
RickMeow
closed
1 year ago
2
修复、重构collie加载/初始化模型Bug
#112
Kausal-Lei
closed
1 year ago
0
修复模型初始化Bug，重构模型初始化
#111
Kausal-Lei
closed
1 year ago
0
[QUESTION]Multi-node multi-gpu training
#110
RickMeow
closed
1 year ago
2
[BUG] ImportError: cannot import name 'PeftConfig' from 'peft.utils'
#109
RickMeow
closed
1 year ago
2
修复模型初始化的Bug
#108
Kausal-Lei
closed
1 year ago
2
训练loss为NaN
#107
fuqianya
closed
9 months ago
6
lr_scheduler设置的问题
#106
YuxiangZhang0114
closed
1 year ago
1
替换tokenizer后载入报错
#105
2793145003
closed
1 year ago
12
Llama2 70B 训练报错
#104
xiaopqr
opened
1 year ago
3
Update lomo
#103
KaiLv69
closed
1 year ago
0
训练出错但没有报错信息
#102
2793145003
closed
1 year ago
2
fix lomo with tp
#101
KaiLv69
closed
1 year ago
0
collie和lomo不兼容
#100
LZY-the-boys
closed
11 months ago
3
tensor parallel + zero3 error
#99
LZY-the-boys
opened
1 year ago
1
Error： llama2 70B LlamaForCausalLM.from_pretrained 开启Zero3，会消耗大量内存导致 OOM
#98
xiaopqr
opened
1 year ago
5
fix lomo with lr_scheduler
#97
KaiLv69
closed
1 year ago
0
Add more shields
#96
Carol-gutianle
closed
1 year ago
0
Adapt models to Flash Attention 2
#95
KYLN24
closed
1 year ago
2
V100上执行examples/alpaca/train.py碰到错误No module named 'petrel_client，请问有人知道怎么解决吗
#94
JiafeiSun
closed
1 year ago
2
Whether lr_scheduler for Lomo is implemented now?
#93
DesperateExplorer
opened
1 year ago
4
Multinode training
#92
dittops
closed
1 year ago
3
Support for LLaMA-2 70B with Grouped-Query Attention
#91
kaiwang13
opened
1 year ago
18
Previous
Next