search

avast / wanna-ml

Complete MLOps framework for Vertex-AI
MIT License
17 stars 3 forks source link

[Bug]: custom job state printed as number instead of string #123

Open racinmat opened 3 months ago

racinmat commented 3 months ago

Contact Details

No response

What happened?

When I run a job, I see

INFO:google.cloud.aiplatform.training_jobs:CustomContainerTrainingJob projects/132000707471/locations/europe-west1/trainingPipelines/301533504775127040 current state:
3
INFO:google.cloud.aiplatform.training_jobs:View backing custom job:
https://console.cloud.google.com/ai/platform/locations/europe-west1/training/8955270557511712768?project=132000707471
INFO:google.cloud.aiplatform.training_jobs:CustomContainerTrainingJob projects/132000707471/locations/europe-west1/trainingPipelines/301533504775127040 current state:
3
INFO:google.cloud.aiplatform.training_jobs:CustomContainerTrainingJob projects/132000707471/locations/europe-west1/trainingPipelines/301533504775127040 current state:
3
INFO:google.cloud.aiplatform.training_jobs:CustomContainerTrainingJob projects/132000707471/locations/europe-west1/trainingPipelines/301533504775127040 current state:
3
INFO:google.cloud.aiplatform.training_jobs:CustomContainerTrainingJob projects/132000707471/locations/europe-west1/trainingPipelines/301533504775127040 current state:
3
INFO:google.cloud.aiplatform.training_jobs:CustomContainerTrainingJob projects/132000707471/locations/europe-west1/trainingPipelines/301533504775127040 current state:
3

while before there was something like CustomJob.RUNNING or something silmilar. I guess it was caused by #119 or #118 . Maybe returning the specific protobuf import would be useful and I hope it would not slow down the loading that much.

wanna.yaml file

-

wanna-ml CLI command

wanna job run ...

Relevant log output

No response