this PR removes all of the functions from the spark_session file. Additionally, it removes dq checks for tables that do not exist anymore and the orchestration files for big parts of the tables.
Within the same approach as the deletion of tables, only the code is cleaned and none of the actual underlying data.
The final tests to generate the tables are running right now, I will comment once successful.
Hi,
this PR removes all of the functions from the spark_session file. Additionally, it removes dq checks for tables that do not exist anymore and the orchestration files for big parts of the tables.
Within the same approach as the deletion of tables, only the code is cleaned and none of the actual underlying data.
The final tests to generate the tables are running right now, I will comment once successful.
Cheers, Sven