search

mjirv / dbt-datamocktool

A dbt package for unit testing your SQL analytics models
Apache License 2.0
166 stars 20 forks source link

Integration tests fail on compare columns test #84

Closed pettersoderlund closed 1 year ago

pettersoderlund commented 1 year ago

Describe the bug

Integration tests of dbt-datamocktool does not run with success at the moment.

Steps to reproduce

Run integration tests 

cd integration_tests
./run_integration_tests.sh

or more specifically run

dbt test -s stg_customers

in integration_tests folder.

Expected results

Integration tests to run successfully.

Actual results

Failed test.

Screenshots and log output

(venv) petter@Petters-iMac integration_tests % dbt test -s stg_customers                                                                                                                                          
18:10:07  Running with dbt=1.5.2
18:10:07  Registered adapter: postgres=1.5.2
18:10:07  Found 6 models, 25 tests, 0 snapshots, 0 analyses, 458 macros, 0 operations, 10 seed files, 1 source, 0 exposures, 0 metrics, 0 groups
18:10:07  
18:10:07  Concurrency: 1 threads (target='dev')
18:10:07  
18:10:07  1 of 5 START test Raw Customers 2 .............................................. [RUN]
18:10:08  1 of 5 PASS Raw Customers 2 .................................................... [PASS in 0.20s]
18:10:08  2 of 5 START test dbt_datamocktool_unit_test_stg_customers_customer_id__first_name__last_name__ref_dmt__expected_stg_customers_1___ref_dmt__raw_customers_1_  [RUN]
18:10:08  2 of 5 ERROR dbt_datamocktool_unit_test_stg_customers_customer_id__first_name__last_name__ref_dmt__expected_stg_customers_1___ref_dmt__raw_customers_1_  [ERROR in 0.07s]
18:10:08  3 of 5 START test dbt_datamocktool_unit_test_stg_customers_description__ref_dmt__expected_stg_customers_1___ref_dmt__raw_customers_1_  [RUN]
18:10:08  3 of 5 PASS dbt_datamocktool_unit_test_stg_customers_description__ref_dmt__expected_stg_customers_1___ref_dmt__raw_customers_1_  [PASS in 0.10s]
18:10:08  4 of 5 START test not_null_stg_customers_customer_id ........................... [RUN]
18:10:08  4 of 5 PASS not_null_stg_customers_customer_id ................................. [PASS in 0.03s]
18:10:08  5 of 5 START test unique_stg_customers_customer_id ............................. [RUN]
18:10:08  5 of 5 PASS unique_stg_customers_customer_id ................................... [PASS in 0.04s]
18:10:08  
18:10:08  Finished running 5 tests in 0 hours 0 minutes and 0.57 seconds (0.57s).
18:10:08  
18:10:08  Completed with 1 error and 0 warnings:
18:10:08  
18:10:08  Database Error in test dbt_datamocktool_unit_test_stg_customers_customer_id__first_name__last_name__ref_dmt__expected_stg_customers_1___ref_dmt__raw_customers_1_ (models/staging/schema.yml)
18:10:08    column "description" does not exist
18:10:08    LINE 72:     "description" 
18:10:08                 ^
18:10:08  
18:10:08  Done. PASS=4 WARN=0 ERROR=1 SKIP=0 TOTAL=5
(venv) petter@Petters-iMac integration_tests %

System information

The contents of your packages.yml file: packages:

Which database are you using dbt with?

The output of dbt --version:

Core:
  - installed: 1.5.2
  - latest:    1.5.2 - Up to date!

Plugins:
  - postgres: 1.5.2 - Up to date!

Additional context

Something with compare_columns seems to be the problem.

Are you interested in contributing the fix?

Yes

pettersoderlund commented 1 year ago

see bugfix https://github.com/mjirv/dbt-datamocktool/pull/85