deep-diver / semantic-segmentation-ml-pipeline

Machine Learning Pipeline for Semantic Segmentation with TensorFlow Extended (TFX) and various GCP products
https://blog.tensorflow.org/2023/01/end-to-end-pipeline-for-segmentation-tfx-google-cloud-hugging-face.html
Apache License 2.0
93 stars 20 forks source link

Add model evaluation GitHub Action #54

Open deep-diver opened 1 year ago

deep-diver commented 1 year ago

This issue is to discuss if it is worth trying to add an additional GitHub Action to evaluate the latest trained model when we have more fresh data. It assumes the following scenario:

  1. We have collected/sampled more fresh data
  2. We manually run the model evaluation GitHub Action
    • The latest deployed model's performance is lower than expected on the fresh data
    • The model evaluation is done in a GitHub Action itself
  3. Then we manually run the model training pipeline GitHub Action including the fresh data