search

DostEducation / whatsapp-webhook-analytics

Handling and processing of Incoming webhook request configured at Glific.
GNU Affero General Public License v3.0
0 stars 0 forks source link

[Onboarding Data source] Setup development environment on DBT cloud #28

Closed Sachinbisht27 closed 6 months ago

Sachinbisht27 commented 6 months ago

Parent issue - https://github.com/DostEducation/whatsapp-webhook-analytics/issues/25

Is your feature request related to a problem? Please describe. We need to set up the DBT project for the webhook service which will be responsible for transforming the data stored at the BigQuery level. Therefore we wanted to set up the DBT project for development.

There are two ways to achieve it -

  1. Setting up the DBT core on our local machine and using it
  2. Setting up the DBT cloud and configuring WhatsApp analytics GitHub repo for development.

As the Cloud is quick to set and easy to use, let's go with the DBT cloud - it gives one project setup free per GitHub user.

Describe the solution you'd like

Describe alternatives you've considered NA

Additional context

Acceptance Criteria

Documentation Add whatever documentation will be required here.

Sachinbisht27 commented 6 months ago

Closing as completed.

Satendra-SR commented 5 months ago

Database <> BigQuery column mapping issues causing DBT runtime errors

image image

Collaboration with Goalkeep team for the root cause

image
image

Tracking of Errors separately while running dbt run - These items got deprioritized as these data sources are not being used for now

  1. https://github.com/DostEducation/dbt-whatsapp-analytics/issues/48
  2. https://github.com/DostEducation/dbt-whatsapp-analytics/issues/47