starostka / 02476-mlops

Project work in 02476 Machine Learning Operations at the Technical University of Denmark (DTU)

https://starostka.github.io/02476-mlops/

Other

2 stars 1 forks source link

Implement Vertex AI support with GCS bucket #37

Closed philgzl closed 1 year ago

philgzl commented 1 year ago

Merged both hydra config files into a single one. One had a single option which was the dataset path and which can actually be used in both the make data script and the train script.

Now that this is a CLI argument in the train script it is possible to point to a GCS bucket when running Vertex jobs.

Also removed DVC pull command from dockerfile in favor of mounting a GCS bucket when running Vertex jobs.

Added Vertex job configuration file. The Vertex job can be ran using

gcloud ai custom-jobs create --region=europe-west1 --display-name=training_job --config=vertex_jobspec.yaml

codecov-commenter commented 1 year ago

Codecov Report

:exclamation: No coverage uploaded for pull request base (main@71d7117). Click here to learn what that means. The diff coverage is n/a.

@@           Coverage Diff           @@
##             main      #37   +/-   ##
=======================================
  Coverage        ?   13.00%           
=======================================
  Files           ?        4           
  Lines           ?      123           
  Branches        ?        0           
=======================================
  Hits            ?       16           
  Misses          ?      107           
  Partials        ?        0

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more