Translation of control dataset shards to TFDS is a very RAM intensive process, especially due to tf.data.Dataset.save(). This wrapper script checks RAM util when running the translation script and restarts the program everytime the RAM util goes above 80%.
Translation of control dataset shards to TFDS is a very RAM intensive process, especially due to tf.data.Dataset.save(). This wrapper script checks RAM util when running the translation script and restarts the program everytime the RAM util goes above 80%.