GoogleCloudPlatform / mlops-with-vertex-ai

An end-to-end example of MLOps on Google Cloud using TensorFlow, TFX, and Vertex AI
Apache License 2.0
348 stars 120 forks source link

A doubt regarding the TFX pipeline associated with Continuous Training #1

Closed sayakpaul closed 3 years ago

sayakpaul commented 3 years ago

Hi @ksalama.

Thank you very much for this amazing resource. It's a mini-book in itself.

I am referring to the statement written just below the continuous training section:

The end-to-end TFX training pipeline implementation is in the src/pipelines directory, which covers the following steps:

Are these pipelines demonstrated in any of the notebooks?

ksalama commented 3 years ago

Yes, the components of the pipeline are executed individually in the 03-training-formalization.ipynb notebook, and the pipeline is executed using a local runner in the 04-pipeline-deployment.ipynb notebook: !py.test src/tests/pipeline_deployment_tests.py::test_e2e_pipeline -s