issues
search
THUDM
/
SwissArmyTransformer
SwissArmyTransformer is a flexible and powerful library to develop your own Transformer variants.
https://THUDM.github.io/SwissArmyTransformer
Apache License 2.0
951
stars
90
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
请教一个问题,使用mp_size=2时的loss应该怎么写
#131
kunden0612
opened
1 year ago
1
模型并行的方式进行lora方式的finetuning要怎么设置呢
#130
kunden0612
opened
1 year ago
5
During BERT decoding, past_key_values is used to accelerate calculation. Do we have a similar implementation?
#129
etrigger
opened
1 year ago
1
Window 安装错误
#128
mai1015
opened
1 year ago
2
使用0.2.x版本时报错
#127
Yuziyi1117
opened
1 year ago
1
fix a slightly inappropriate default value.
#126
hhnqqq
closed
1 year ago
0
测试源码中给的qlora.py报错
#125
shituo123456
opened
1 year ago
7
sat.arguments.get_args failed to handle the "-h" option
#124
limjcst
opened
1 year ago
1
chatglm model parallel
#123
1049451037
closed
1 year ago
0
reframe mp_split
#122
1049451037
closed
1 year ago
0
llama-30b & -65b
#121
1049451037
closed
1 year ago
0
Kv cache
#120
leizhao1234
opened
1 year ago
0
change model-parallel-size online
#119
1049451037
closed
1 year ago
0
SAT Tokenizer 地址挂了
#118
youngstu
opened
1 year ago
1
chatglm2 release
#117
1049451037
closed
1 year ago
0
ChatGLM2-6B
#116
1049451037
closed
1 year ago
0
save ema parameters
#115
leizhao1234
closed
1 year ago
1
stream_filling_sequence function
#114
wenyihong
closed
1 year ago
0
请问dataloader能shuffle吗?
#113
XaviLv
closed
1 year ago
2
0.2.12 release版本的源码在哪个分支?
#112
guohuanliang1
closed
1 year ago
1
huggingface版本的visualglm在前向传播报错,Exception: cuda rng state model-parallel-rng is not added
#111
zhangyuanscall
opened
1 year ago
1
fix webds import
#110
1049451037
closed
1 year ago
0
fix prefatch typo
#109
Sleepychord
closed
1 year ago
0
merge meta info
#108
Sleepychord
closed
1 year ago
0
add llama 13b & generation example
#107
1049451037
closed
1 year ago
0
add llama inference
#106
1049451037
closed
1 year ago
0
add llama
#105
1049451037
closed
1 year ago
0
add ema-adam
#104
leizhao1234
closed
1 year ago
0
Request for documentation: the relationship between "Swing Army Transformer" and Nvidia's "FasterTransformer"
#103
Oukaishen
closed
1 year ago
1
在镜像中安装报错
#102
xinyubai1209
opened
1 year ago
2
fix lora merge
#101
1049451037
closed
1 year ago
0
sat 和 transformers & huggingface hub 可以无缝集成吗?
#100
SwordFaith
opened
1 year ago
1
Qlora
#99
1049451037
closed
1 year ago
0
preserve linear parallel lora
#98
1049451037
closed
1 year ago
0
remove redundant argument
#97
1049451037
closed
1 year ago
0
add qlora support
#96
1049451037
closed
1 year ago
0
怎样使用DeepSpeed的offload功能降低显存占用?
#95
yt7589
opened
1 year ago
0
add lora merging interface
#94
1049451037
closed
1 year ago
0
adapt vit to new version
#93
1049451037
closed
1 year ago
0
安装时报错
#92
ge90114b
opened
1 year ago
1
pypl 清华源,没有swissarmytransformer
#91
yhyu13
closed
1 year ago
2
fix base_strategy
#90
lykeven
closed
1 year ago
0
可以在win或mac本地进行吗?
#89
ReefJones
opened
1 year ago
1
Fix BaseModel reinit
#88
dynamicheart
closed
1 year ago
3
fix save & modify vit
#87
1049451037
closed
1 year ago
0
Optional arch args save
#86
1049451037
closed
1 year ago
0
try & support cross_attn_hidden_size
#85
Sleepychord
closed
1 year ago
0
support file with non-ascii characters
#84
DarrenYing
closed
1 year ago
1
dynamic loading
#83
1049451037
closed
1 year ago
0
AssertionError: data parallel group is not initialized
#82
victorup
closed
1 year ago
3
Previous
Next