dataform-co / dataform

Dataform is a framework for managing SQL based data operations in BigQuery
https://cloud.google.com/dataform/docs
Apache License 2.0
858 stars 166 forks source link

Strange projects are being generated and keep giving us errors. #1326

Closed wtnVenga closed 2 years ago

wtnVenga commented 2 years ago

I'd appreciate any suggestions on how to resolve this.

We are using the web version of Dataform and have recently started getting job notifications sent to slack for both successes and failures.

success:

Schedule xxx in environment production completed successfully.
All actions completed successfully.

failure:

Schedule xxx in environment production failed!
Fatal errors:
- Cannot start run, warehouse connection details missing.

For those notified of success, the "View run logs" button will take us to a web page where we can check the logs. On the other hand, the failure notification will show an error as shown in the image below.

スクリーンショット 2022-03-15 15 08 36

From our research, we already know that if the URL structure of the "view run logs" button link is as follows, the numbers in the {project_id} part are different. Therefore, we hypothesize that another project has been created.

https://app.dataform.co/#/{project_id}/run/{job}
BenBirt commented 2 years ago

Can you share an example link that you don't have access to? (Project IDs are opaque, you don't need to worry about sharing them here.)

wtnVenga commented 2 years ago

@BenBirt Thanks for your comment! Here is the URL for the example. https://app.dataform.co/#/6085516096176128/run/3917883878173501

BenBirt commented 2 years ago

That project is indeed configured to send Slack notifications, I just suspect somebody set this up on your side without giving you access.

Can you email me directly (benbirt@google.com) so that I can explain some details?

wtnVenga commented 2 years ago

@BenBirt Thank you for your kindness. I just sent you an email, please check it.

BenBirt commented 2 years ago

Moving conversation to email.