Default merging strat for tfrecord

ecmwf / climetlab

Python package for easy access to weather and climate data

Apache License 2.0

374 stars 58 forks source link

Closed mchantry closed 3 years ago

mchantry commented 3 years ago

Minimal solution for merging tfrecord datasets. Enables multithreading with kwargs num_parallel_reads e.g. to_tfrecord(num_parallel_reads=4) See https://www.tensorflow.org/api_docs/python/tf/data/TFRecordDataset for more information.

FussyDuck commented 3 years ago

All committers have signed the CLA.