ministryofjustice / data-catalogue

Data catalogue • This repository is defined and managed in Terraform
MIT License
2 stars 0 forks source link

rename depreciated path and update owner meta tag #169

Closed LavMatt closed 2 months ago

LavMatt commented 3 months ago

has couple updates to cadet.yaml ingestion recipe.

ingestion is currently failing with RecursionError: maximum recursion depth exceeded and it's not immediately obvious why. Logs are not too helpful. So could be something wrong within the dbt manifest or configuration of our recipe. It's also true that at time of writing the cadet action that builds docs had broken again so we have an empty catalog file although don;t know if that would cause this error

LavMatt commented 3 months ago

I had a working cadet ingestion to dev - took 2.5 hours, with the recipe as is now.

I changed two things though so one of them (or maybe both) has fixed it:

We should still isolate the cause to know if it's something that could emerge again due to how cadet is structured or it's size/complexity

LavMatt commented 2 months ago

datahub cli 0.13.3 i believe causes sql definitions for dbt models to not appear - Although i'm not 100% on this