deep-diver / semantic-segmentation-ml-pipeline

Machine Learning Pipeline for Semantic Segmentation with TensorFlow Extended (TFX) and various GCP products
https://blog.tensorflow.org/2023/01/end-to-end-pipeline-for-segmentation-tfx-google-cloud-hugging-face.html
Apache License 2.0
93 stars 20 forks source link

Add Transform component to the pipeline #29

Closed deep-diver closed 2 years ago

deep-diver commented 2 years ago

This PR includes the following changes:

Note: In order to use Transform, we need StatisticsGen and SchemaGen, so they are added to the pipeline as well.

Note: This code changes are verified to work on local and Vertex environment.

review-notebook-app[bot] commented 2 years ago

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

sayakpaul commented 2 years ago

@deep-diver the low-res PR is a dependency of this PR, right? Let's please hold off until it gets resolved.

deep-diver commented 2 years ago

@sayakpaul

this is up for the review as well!

deep-diver commented 2 years ago

@sayakpaul

addressed your comments! thanks for the great comments. I really like them 👍🏼

deep-diver commented 2 years ago

@sayakpaul

fixed the broken parts, and it is verified to be working properly.

Screen Shot 2022-09-26 at 9 47 23 PM