issues
search
llm-jp
/
scripts
Apache License 2.0
1
stars
1
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Add tokenize shell scripts
#61
YumaTsuta
closed
2 weeks ago
0
Make installed llm-jp-eval editable
#60
odashi
closed
4 weeks ago
0
Add converter script for 13B CPT
#59
odashi
opened
1 month ago
0
Update high qulaity cpt scripts (fix scripts and add exp C, D and E)
#58
YumaTsuta
closed
3 weeks ago
1
Add installer of model pre-taing with Megatron-LM for llm-jp cluster
#57
YumaTsuta
opened
1 month ago
0
Add 13B CPT configs: exp2 and exp5.
#56
odashi
closed
1 month ago
1
Add hf2megatron converter
#55
YumaTsuta
opened
1 month ago
2
Update wandb version (>=0.18.0)
#54
YumaTsuta
closed
1 month ago
1
Add scripts to install v3 pre-training environment for llm-jp-nvlink cluster
#53
YumaTsuta
closed
1 month ago
0
Change SLURM option in model parameter convert
#52
YumaTsuta
closed
1 month ago
0
Update vllm version in llm-jp-eval v1.4.1 scripts
#51
YumaTsuta
closed
1 month ago
0
add llm-jp-3 152M scripts
#50
odashi
closed
1 month ago
0
Add moe pretrain
#49
Taishi-N324
opened
1 month ago
0
Add 1.7B script with batch size 1024 for CPT with high quality data
#48
YumaTsuta
closed
1 month ago
0
Add high quality cpt 13b (AB)
#47
YumaTsuta
closed
1 month ago
0
Dump raw training data for the LLM-jp-3 series
#46
hkiyomaru
opened
1 month ago
1
Fix typo of loading path in scripts of high-quality-cpt
#45
YumaTsuta
closed
1 month ago
0
Add high quality cpt 3.7b 123ab
#44
YumaTsuta
closed
1 month ago
0
Fix paths and minor bugs
#43
YumaTsuta
closed
1 month ago
2
add v3-1.8b-exp2 for sakura
#42
Taka008
closed
2 months ago
0
Fix links between Readmes
#41
YumaTsuta
closed
1 month ago
1
Cpt lr scheduling
#40
Taka008
opened
2 months ago
0
Add v3-7.3B-exp1 scripts
#39
odashi
closed
1 month ago
1
Upload final training script for v3 13B
#38
odashi
closed
2 months ago
0
Add scripts for FP8 behavior check
#37
odashi
opened
2 months ago
0
add training scripts for v3-1.7b-exp2-cpt-2epoch
#36
Taka008
opened
2 months ago
0
Add setup script for mdx
#35
YumaTsuta
closed
2 months ago
8
Add evaluation scripts (llm-jp-eval v1.4.1 with vllm)
#34
YumaTsuta
closed
2 months ago
0
v3 high quality CPT (setting A and B)
#33
YumaTsuta
closed
1 month ago
8
Add p2p test
#32
k141303
closed
2 months ago
0
Add scripts for g-leaderboard (GENIAC official evaluation)
#31
hkiyomaru
closed
2 months ago
15
Add evaluation scripts (llm-jp-eval v1.4.1 with vllm)
#30
YumaTsuta
closed
1 month ago
6
Add scripts for g-leaderboard
#29
hkiyomaru
closed
1 month ago
0
scripts for llm-jp-eval v1.4
#28
YumaTsuta
opened
3 months ago
1
Remove exclusive option in SLURM job submission
#27
YumaTsuta
closed
2 months ago
6
Add script to move unnecessary checkpoints of 172B
#26
k141303
closed
3 months ago
4
Use mktemp to create temporal working directory
#25
YumaTsuta
closed
3 months ago
0
Add scripts to automate evaluation on llm-jp-eval v1.3.1
#24
hkiyomaru
opened
3 months ago
4
Training script of v3 3.8B exp1
#23
odashi
closed
3 months ago
2
Automate evaluation (llm-jp-eval)
#22
YumaTsuta
opened
3 months ago
25
Add inference script for HF models
#21
hkiyomaru
closed
3 months ago
1
Add scripts for LLM-jp model inference
#20
hkiyomaru
closed
3 months ago
0
Fix base number of integer conversion in v3 converter
#19
odashi
closed
3 months ago
2
Fix v3 converter to treat iter=0
#18
odashi
closed
3 months ago
0
Add scripts to measure all_reduce benchmark
#17
k141303
closed
2 months ago
1
Specify number of CPUs/RAM for installer jobs
#16
odashi
closed
3 months ago
0
Fix Fused Attention Error
#15
k141303
opened
3 months ago
2
Add evaluation scripts
#14
YumaTsuta
closed
3 months ago
6
[sakura]Add v3 172B exp2 scripts
#13
k141303
closed
3 months ago
3
Update llm-jp-tokenizer tag to the latest for cloning
#12
YumaTsuta
closed
3 months ago
0
Next