add 7B 34B 70B yaml - Githubissues

FlagOpen / FlagScale

FlagScale is a large model toolkit based on open-sourced projects.

Other

168 stars 42 forks source link

add 7B 34B 70B yaml #70

Closed phoenixdong closed 7 months ago

phoenixdong commented 7 months ago

Description

Add train_aquila_7b.yaml
Add train_aquila_34b.yaml
Add train_aquila_70b.yaml
Update readme, add description about YAML.

Experiment

[x] aquila/7B/pretrain
[x] aquila/34B/pretrain
[x] aquila/70B/pretrain

TODO

megatron/tests -> FlagScale/tests