search

gclouduniverse / reproducibility

Apache License 2.0
12 stars 12 forks source link

update instruction to achieve 60 sample/s #39

Closed zpcore closed 1 month ago

zpcore commented 1 month ago

Update config to handle larger batch size with flash attention.