search

open-metadata / OpenMetadata

OpenMetadata is a unified metadata platform for data discovery, data observability, and data governance powered by a central metadata repository, in-depth column level lineage, and seamless team collaboration.
https://open-metadata.org
Apache License 2.0
4.87k stars 933 forks source link

IBM Db2 ingestion #14627

Open elguero6 opened 6 months ago

elguero6 commented 6 months ago

Affected module Ingestion Framework

Describe the bug When the DB2 Profiler Ingestion runs this error shows in the logs : String data right truncation. SQLSTATE=22001 SQLCODE=-99999 I believe the columnNames parameter is too long, if I run the query in a Database Client, it will run fine with fewer characters in the parameter

To Reproduce

Create a IBM DB2 Connection, run the profiler ingestion.

Expected behavior

sqlalchemy.exc.DataError: (ibm_db_dbi.DataError) ibm_db_dbi::DataError: Statement Execute Failed: [IBM][CLI Driver] CLI0109E String data right truncation. SQLSTATE=22001 SQLCODE=-99999 [SQL: / {"app": "OpenMetadata", "version": "1.2.3.2"} / SELECT count(*) AS "rowCount", CAST(? AS BIGINT) AS "columnCount", CAST(? AS VARCHAR) AS "columnNames" FROM example_Schema.example_table FETCH FIRST 1 ROWS ONLY]

Version:

Additional context Add any other context about the problem here.

ayush-shah commented 6 months ago

Hello @elguero6, I will take a look on the issue, you can track the progress here itself. You can check the project part to see which release it will be a part of, based on the bandwidth and priorities 🙏

TeddyCr commented 5 months ago

@elguero6 how many columns does your table have? The columnNames parameter will be replaced by a string of all your column (comma separated). We might need to specify a greater VARCHAR length.

elguero6 commented 5 months ago

Yea can be numerous, 20-50 column table