Database connector feature parity

[shaunagm]

We're hoping to help other connectors (especially the BigQuery connector) get closer to feature parity with the RedShift connector. Here's a list of features RedShift has that we'd like other connectors to have, ordered by priority.

High Priority

• [ ] table_exists()
• [ ] get_tables()
  • NOTE: the columns surfaced in the Redshift connector are based on the pg_tables table in Redshift. Functionally, I think we only need schemaname and tablename, but BigQuery may want to also surface project name.
• [ ] get_views()
  • NOTE: the columns surfaced in the Redshift connector are based on the pg_views table in Redshift. Functionally, I think we only need schemanam, viewname, and view definition, but BigQuery may want to also surface project name.

Medium Priority

• [ ] get_row_count()
• [ ] populate_table_from_query()
• [ ] get_columns()
  • Similar to get_tables() - this output is based on a standard Redshift system table, but I think the real need is column name, type, max length, which is likely doable in all databases
• [ ] get_columns_list()

Low Priority

• [ ] rename_table()
• [ ] move_table()
• [ ] duplicate_table()
• [ ] get_table_definition()
• [ ] get_table_definitions()
• [ ] get_view_definition()
• [ ] get_view_definitions()

PRs addressing this issue will likely only add a feature or two at a time. That's totally ok. :) Also feel free to comment if you have a different prioritization. This list comes via @elyse-weiss and represents internal TMC priorities but we are happy to accommodate community needs as well.

[shaunagm]

Per this thread, we want to add padding as an argument to the copy method in our connectors, not sure the priority of it though. @elyse-weiss, thoughts on priority?

[elyse-weiss]

Per this thread, we want to add padding as an argument to the copy method in our connectors, not sure the priority of it though. @elyse-weiss, thoughts on priority?

I have found it to be very helpful to ensuring you don't get errors on future runs that column widths are not wide enough. I don't have enough of an idea around capacity though, and if it has to be pushed down the road, I think we'll all survive.