datacleaner / DataCleaner

The premier open source Data Quality solution
GNU Lesser General Public License v3.0
595 stars 180 forks source link

How do I view/select/profile external tables in Redshift? #1930

Open KKostroski opened 2 years ago

KKostroski commented 2 years ago

Hi, I successfully connected to Redshift using the jdbc driver. However, the external tables are not loading or expandable to view from "Database Objects/external schemas/ba_*". Anyone know of a config that will allow me to select "external tables" in my Redshift connection and profile columns?

When I right click and "add all schema tables to source" I get the error: "Job error status: No source columns in job".

From command prompt: 13:16:00.516 [AWT-EventQueue-0] INFO o.a.m.jdbc.JdbcMetadataLoader - No table metadata records returned for schema 'ba_...'

You can see that you cannot expand ba_* external schemas to view the associated "external tables" and "columns". image

This is what I'm trying to select, seen in PyCharm: image

kaspersorensen commented 2 years ago

Hi there,

As the log mentions - No table metadata records returned for schema - there is no metadata delivered to DataCleaner to build up the data structure from. So although you made the JDBC driver "work", it still doesn't work, because the JDBC driver doesn't seem to offer any metadata. I don't know anything about RedShift so I can't help you further than that.