issues
search
lassl
/
lassl
Easy Language Model Pretraining leveraging Huggingface's Transformers and Datasets
Apache License 2.0
127
stars
14
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Can you give some examples or benchmarks, that use this pretrain framework make downstream task better ?
#106
svjack
opened
2 years ago
1
[mixed] refactor: Refactor ul2 collator for denoiser
#105
wavy-jung
closed
1 year ago
0
Refactor collator, tokenizer-training for ul2, t5
#104
wavy-jung
opened
2 years ago
0
Change default save format to parquet
#103
seopbo
opened
2 years ago
0
[mixed] refactor: Refactor for v1.0.0
#102
seopbo
closed
2 years ago
0
Refactor for v1.0.0
#101
seopbo
closed
2 years ago
0
[python] refactor: Ready to v0.2.0
#100
seopbo
closed
2 years ago
0
중간에 학습이 끊어졌을 때 이어서 학습하는 feature
#99
DaehanKim
closed
2 years ago
2
Add UL2 Language Modeling
#98
DaehanKim
closed
2 years ago
0
Ready to release v0.2.0
#97
seopbo
closed
2 years ago
0
Refactor the project
#96
seopbo
closed
2 years ago
0
[etc] fix: add tf dependency ver.
#95
wavy-jung
closed
2 years ago
2
Add UL2 Language Modeling
#94
DaehanKim
closed
2 years ago
4
Single-stage Electra collator refactored
#93
wavy-jung
closed
2 years ago
1
Add tests codes and refactor processors, collators
#92
seopbo
closed
2 years ago
0
Support Electra pretrain
#91
wavy-jung
closed
2 years ago
1
Support training Electra model
#90
wavy-jung
closed
2 years ago
0
Make a standard of special tokens for processor-collator
#89
wavy-jung
closed
2 years ago
1
Add config files #82
#88
wavy-jung
closed
2 years ago
1
Support training T5 model
#87
DaehanKim
closed
2 years ago
2
Support training T5 model
#86
DaehanKim
closed
2 years ago
1
T5/BART 사전학습을 위한 processor/collator 추가
#85
DaehanKim
closed
2 years ago
0
Fix bugs in training BART
#84
seopbo
closed
2 years ago
0
Support training T5 model
#83
seopbo
closed
2 years ago
0
Add examples configs
#82
seopbo
closed
2 years ago
0
Support training BART
#81
seopbo
closed
2 years ago
0
[python] chore: Update requirements.txt
#80
seopbo
closed
2 years ago
0
Update requirements
#79
seopbo
closed
2 years ago
0
[python] fix: Fix location of __init__.py
#78
seopbo
closed
2 years ago
0
Fix packaging subpackage of lassl
#77
seopbo
closed
2 years ago
0
Remove poetry dependencies
#76
seopbo
closed
2 years ago
1
Remove poetry
#75
seopbo
closed
2 years ago
0
Refactor a training script for supporting Blender
#74
seopbo
closed
2 years ago
1
Add dataset blender
#73
hyunwoongko
closed
2 years ago
0
[python] fix: Fix importing a invalid module
#72
seopbo
closed
2 years ago
0
Hotfix for importing invalid module
#71
seopbo
closed
2 years ago
0
Update README.md
#70
bzantium
closed
2 years ago
0
[python] fix: debug GPT2 processor and collator
#69
bzantium
closed
2 years ago
1
Hotfix/#67
#68
bzantium
closed
2 years ago
0
Fix bugs in GPT2 processor, collator
#67
bzantium
closed
2 years ago
0
[etc] docs: Add English version of README
#66
bzantium
closed
2 years ago
2
Add example configs for gpu, tpu
#65
seopbo
closed
2 years ago
0
[docs] fix: Change a license
#64
seopbo
closed
2 years ago
0
Translate `README.md` into english
#63
seopbo
closed
2 years ago
0
Add `CITATION.ctf`
#62
seopbo
closed
2 years ago
0
Fix a license in `pyproject.toml`
#61
seopbo
closed
2 years ago
0
Upload default configs
#60
seopbo
closed
2 years ago
0
[etc] docs: Add additional information to doc
#59
seopbo
closed
2 years ago
0
Add a link for hugginface model hub
#58
seopbo
closed
2 years ago
0
[python] fix: GPT2 Collator CollatorForLM 상속하기
#57
bzantium
closed
2 years ago
0
Next