airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
https://airbyte.com
Other
15.49k stars 3.99k forks source link

Enable Google chat notifications again #42843

Open ayasse-l opened 1 month ago

ayasse-l commented 1 month ago

Topic

Notifications

Relevant information

Tell us about the problem you're trying to solve

I work on a project in which we use 2 different versions of Airbyte :

In both versions we added google chat webhooks to receive notifications for failed or successful syncs. With the old version, there's no problem. However with the newest version, the tests work but we do not receive any notification when a sync fails or succeeds

Describe the solution you’d like

Receive notifications in Google chat for failed or successful syncs when a google chat webhook url is given in the "Notification Settings" section.

nataliekwong commented 1 month ago

Earlier this year, we modified the format of the notifications which you can view by testing through a webhook site like webhook.site. The notification output contains the text we traditionally always sent, but now also includes blocks specific to Slack notification webhooks, as well as the sync job metadata.

It could be that the Google chat webhook does not work well with outputs that have this format type - I recommend trying to utilize a different webhook service that can ingest this new data format.

cc @malikdiarra

brianbolt commented 2 weeks ago

Same thing occured for us. The test button succesfully showed Hello World! This is a test from Airbyte to try slack notification settings for sync failures. so we accepted the upgrade thinking that notifications were working. Later we had a failure and did not get a notification in our gchat channel with the following error in the airbyte server logs:

INFO 2024-08-16T06:28:05.406768608Z “message”: “Invalid JSON payload received. Unknown name \“blocks\” at ‘message’: Cannot find field.\nInvalid JSON payload received. Unknown name \“data\” at ‘message’: Cannot find field.“,
INFO 2024-08-16T06:28:05.406774899Z “status”: “INVALID_ARGUMENT”,
INFO 2024-08-16T06:28:05.406795145Z “details”: [
INFO 2024-08-16T06:28:05.406800443Z {
INFO 2024-08-16T06:28:05.406805685Z “@type”: “[type.googleapis.com/google.rpc.BadRequest](http://type.googleapis.com/google.rpc.BadRequest)”, (edited)

Would be nice to have a dropdown in airbyte that let you choose gchat over slack webhook formatting.