deep-diver / semantic-segmentation-ml-pipeline

Machine Learning Pipeline for Semantic Segmentation with TensorFlow Extended (TFX) and various GCP products
https://blog.tensorflow.org/2023/01/end-to-end-pipeline-for-segmentation-tfx-google-cloud-hugging-face.html
Apache License 2.0
93 stars 20 forks source link

Re-generate low-resolution image dataset in TFRecord #27

Closed deep-diver closed 2 years ago

deep-diver commented 2 years ago

Regenerate low-resolution image datasets in TFRecord. It should follow the same format as the full-resolution datasets:

feature_description = {
    "image": tf.io.VarLenFeature(tf.float32),
    "image_shape": tf.io.VarLenFeature(tf.int64),
    "label": tf.io.VarLenFeature(tf.float32),
    "label_shape": tf.io.VarLenFeature(tf.int64),
}
sayakpaul commented 2 years ago

Related to #26.

deep-diver commented 2 years ago

maybe I will handle this issue to practice how to generate / host TFRecords myself since you have done this many times :) WDYT?

sayakpaul commented 2 years ago

Sure thing. Please assign me as a reviewer then.