search

DalgoT4D / dbt_stir

This repo is to maintain transformations for SurveyCTO data. We have used Airbyte to pull data from SyrveyCTO. Checkout our Airbyte Repo
0 stars 1 forks source link

readme

Welcome to your new dbt project!

Getting Started

  1. clone and pull repo
  2. Install dbt normally (make sure to install with dbt-postgres) in virtual env
  3. dbt --version to check dbt-core and postgres adapter are installed and working
  4. add profiles.yml in ~/.dbt/ and complete the login creds for dev

  stir:
   outputs:

    dev:
      type: postgres
      threads: 4
      host: [host]
      port: [port]
      user: [dev_username]
      pass: [dev_password]
      dbname: [dbname]
      schema: [dev_schema]

    prod:
      type: postgres
      threads: [1 or more]
      host: [host]
      port: [port]
      user: [prod_username]
      pass: [prod_password]
      dbname: [dbname]
      schema: [prod_schema]

  target: dev

  1. enter repo folder

  2. dbt deps - installs dbt_utils package

  3. dbt run - should run as long as schema and table specified in input model - extract_forms_params model exists

  4. dbt test - run tests

  5. Model viewer dbt docs - browser based viewer to see details of models and compiled column list of each table/view 

    dbt docs generate
dbt docs serve

Resources: