FDA Cleanup

[lprzychodzien]

Explanation

• Cleans up the dbt for some of the FDA DAGs
  • Removes the SELECT * from the SQL which makes it hard to understand what tables are being captured
  • Moves some of the complicated SQL logic into CTEs to make it more understandable and maintainable
• replaces tests to data_tests as is recommended by dbt now
• adds airflow exception to the transform task capturing errors and incomplete runs

Rationale

Making the SQL understandable and maintainable is important

Tests

1. What testing did you do?
   • ran each DAG and then queries a staged table