search

deep-diver / semantic-segmentation-ml-pipeline

Machine Learning Pipeline for Semantic Segmentation with TensorFlow Extended (TFX) and various GCP products
https://blog.tensorflow.org/2023/01/end-to-end-pipeline-for-segmentation-tfx-google-cloud-hugging-face.html
Apache License 2.0
93 stars 20 forks source link

Support for larger TFRecords #24

Closed sayakpaul closed 2 years ago

sayakpaul commented 2 years ago

Closes https://github.com/deep-diver/semantic-segmentation-ml-pipeline/issues/23.

TFRecord shards will be available here: gs://sidewalks-tfx-fullres.

You'd also need to modify the TFRecord parsing utilities accordingly. This can be recovered from the earlier versions of the current TFRecord parsing notebook we have.