search

DalgoT4D / dbt_stir

This repo is to maintain transformations for SurveyCTO data. We have used Airbyte to pull data from SyrveyCTO. Checkout our Airbyte Repo
0 stars 1 forks source link

Incorrect unnesting of fields #10

Closed vinod-rajasekaran closed 1 year ago

vinod-rajasekaran commented 1 year ago

Array elements cc1-cc5 have scores of 5 in normalised table but only 1s or 0s in flat table. Isolated issue in non matching of unnesting array designators and values:

unnest(array['s1','s2','s3','s4', 'c1','c2','c3', 'e1','e2', 'se1','se2','se3','se4','se5', 'cc1','cc2', 'cc3', 'cc4', 'cc5',

 unnest(array[s1,s2,s3,s4,
                **c1,c2,**
                e1,e2,
                se1,se2,se3,se4,se5,
                cc1,cc2,cc3, cc4,cc5,
                ad1, ad2, ad3, ad4, ad5,ad7, ad8, ad9,
                sr1, sr2, sr3, sr4, sr5, sr6,

Please also verify the exact order with both the category and the score. expectation for cc1-5 it should be only between 0 and 1

vinod-rajasekaran commented 1 year ago

fixed in PR#11: unnesting fix #11