DostEducation / whatsapp-webhook-analytics

Handling and processing of Incoming webhook request configured at Glific.
GNU Affero General Public License v3.0
0 stars 0 forks source link

[Diagnosis] Data Transformation for the onboarding data source is not working properly. #54

Closed Sachinbisht27 closed 6 months ago

Sachinbisht27 commented 6 months ago

Describe the bug We have encountered the error logs on the DBT production transformation. This issue caused us to stop the data pipeline in a production environment.

Diagnosis details: As we have some custom fields containing dashes (-). This case is causing an error in the DBT while transforming the data from the user_attribute table to the onboarding data source.

Environment (please complete the following information):

Screenshot: image

We have 2 ways to fix the issue:

Acceptance Criteria

Documentation Add whatever documentation will be required here.

Sachinbisht27 commented 6 months ago

We will be going with the Approach 1: To rename the custom fields at the Glific level and start using underscores (_) instead of dashes (-).

Sachinbisht27 commented 6 months ago

Closing as completed