GoogleCloudPlatform / datacatalog-connectors-bi

Sample code with integration between Data Catalog and BI data sources.
Apache License 2.0
32 stars 16 forks source link

Make column schema for fields #94

Closed ricardolsmendes closed 3 years ago

ricardolsmendes commented 3 years ago

- What I did Added a feature that allows the Sisense Connector to synchronize Widget fields as schema columns in Google Data Catalog.

- How I did it

  1. Refactored the __make_schema_for_widget() method of scrape.DataCatalogEntryFactory so it delegates fields and filters columns generation.
  2. Created the DataCatalogEntryFactory.__make_fields_column_for_widget() method.
  3. Created the DataCatalogEntryFactory.__make_filters_column_for_widget() method.
  4. Added the prepare.SisenseConnectorStringsHelper temporary class (instructions on how to remove it in the future are available in the class docs).
  5. Add unit tests to fully cover the above changes.

- How to verify it Run the unit tests.

- Description for the changelog Added a feature that allows the Sisense Connector to synchronize Widget fields as schema columns in Google Data Catalog.

PS: This PR is part of the effort to deliver #70.