com.google.cloud.ai.platform.common.errors.AiPlatformException: code=RESOURCE_EXHAUSTED, message=The following quota metrics exceed quota limits: aiplatform.googleapis.com/custom_model_training_cpus, cause=null; Failed to create custom job for the task.

GoogleCloudPlatform / vertex-ai-samples

Notebooks, code samples, sample apps, and other resources that demonstrate how to use, develop and manage machine learning and generative AI workflows using Google Cloud Vertex AI.

https://cloud.google.com/vertex-ai

Apache License 2.0

1.63k stars 806 forks source link

com.google.cloud.ai.platform.common.errors.AiPlatformException: code=RESOURCE_EXHAUSTED, message=The following quota metrics exceed quota limits: aiplatform.googleapis.com/custom_model_training_cpus, cause=null; Failed to create custom job for the task. #3479

Open dkml-123 opened 3 weeks ago

dkml-123 commented 3 weeks ago

Expected Behavior

Vertex AI Scheduler gives error when performed on workbench notebooks.

gericdong commented 1 week ago

@dkml-123: was there a specific notebook failing on this error?

dkml-123 commented 1 week ago

Yes. https://codelabs.developers.google.com/vertex-p2p-training#0