search

opendatadiscovery / odd-platform

First open-source data discovery and observability platform. We make a life for data practitioners easy so you can focus on your business.
https://opendatadiscovery.org
Apache License 2.0
1.2k stars 100 forks source link

Redshift: Failed to load metadata for tables: 1 validation error for DataEntity owner #1676

Closed snexuz closed 4 months ago

snexuz commented 4 months ago

Describe the bug odd_collector.adapters.redshift.adapter:get_data_entity_list:74 - Failed to load metadata for tables: 1 validation error for DataEntity owner

Set up From this repo, and ran by docker-compose on AWS EC2.

Steps to Reproduce

  1. Everything looks fine, until I try to collect metadata from our own Redshift data warehouse.
  2. collector_config.yaml is fine, and we can see odd platform extract metadata out of Redshift.
  3. I'd try to add try, except to get_data_entity_list(), and notice most errors were on view tables.

Expected behavior Extract metadata from Redshift

Screenshots (If applicable, add screenshots to help explain your problem) image

snexuz commented 4 months ago

Thanks for your beautiful works, it works fine now.

ValeriyWorld commented 4 months ago

closed and merged in main with PR: https://github.com/opendatadiscovery/odd-collectors/pull/75