Closed tom-webber closed 1 month ago
This is working on dev, and output confirms our hypothesis that AssignCadetDomains
is what is slowing things down. Pretty sure we can significantly optimise this!
__init__
0sget_workunits
2m 37s
get_cadet_mainfest
2m 37s_get_databases_with_domains_and_display_tags
0s__init__
0sget_workunits
2m 27s
_get_cadet_manifest
2m 36s_get_domain_mapping
0sAssignCadetDomains
transformer 2h 32m 10sget_cadet_manifest
2m 41s_get_table_database_mappings
0s@hjribeiro-moj would you mind rereviewing? I had to push up a small fix yesterday
time
unix command todatahub ingest
callsinput
var for environment