added explicit support for tfrecord creation from single file.

kingoflolz / mesh-transformer-jax

Model parallel transformers in JAX and Haiku

Apache License 2.0

6.29k stars 892 forks source link

Closed ablacklama closed 3 years ago

ablacklama commented 3 years ago

Also added a bit of validation on the input file/directory, fixed a bit of formatting, and added descriptions to progress bars.

kingoflolz commented 3 years ago

Thanks!