hassonlab / 247-pickling

Contains code to create pickles from raw/processed data
1 stars 9 forks source link

Optimal batch size for each LM #93

Closed hvgazula closed 1 year ago

hvgazula commented 1 year ago

@zkokaja https://huggingface.co/docs/accelerate/usage_guides/memory

zkokaja commented 1 year ago

Ready to merge