Closed LavMatt closed 2 months ago
I had a working cadet ingestion to dev - took 2.5 hours, with the recipe as is now.
I changed two things though so one of them (or maybe both) has fixed it:
strip_user_ids_from_email
in recipe. Doesn't seem like we'll need this enabled as we're are using a custom meta mapping to get the data owner names.0.13.3
We should still isolate the cause to know if it's something that could emerge again due to how cadet is structured or it's size/complexity
datahub cli 0.13.3
i believe causes sql definitions for dbt models to not appear - Although i'm not 100% on this
has couple updates to cadet.yaml ingestion recipe.
test_results_path
depreciated in favour ofrun_result_paths
. The value has also changed from str to listingestion is currently failing with
RecursionError: maximum recursion depth exceeded
and it's not immediately obvious why. Logs are not too helpful. So could be something wrong within the dbt manifest or configuration of our recipe. It's also true that at time of writing the cadet action that builds docs had broken again so we have an empty catalog file although don;t know if that would cause this error