search

open-metadata / OpenMetadata

OpenMetadata is a unified metadata platform for data discovery, data observability, and data governance powered by a central metadata repository, in-depth column level lineage, and seamless team collaboration.
https://open-metadata.org
Apache License 2.0
5.55k stars 1.05k forks source link

IBM Db2 ingestion #14627

Open elguero6 opened 10 months ago

elguero6 commented 10 months ago

Affected module Ingestion Framework

Describe the bug When the DB2 Profiler Ingestion runs this error shows in the logs : String data right truncation. SQLSTATE=22001 SQLCODE=-99999 I believe the columnNames parameter is too long, if I run the query in a Database Client, it will run fine with fewer characters in the parameter

To Reproduce

Create a IBM DB2 Connection, run the profiler ingestion.

Expected behavior

sqlalchemy.exc.DataError: (ibm_db_dbi.DataError) ibm_db_dbi::DataError: Statement Execute Failed: [IBM][CLI Driver] CLI0109E String data right truncation. SQLSTATE=22001 SQLCODE=-99999 [SQL: / {"app": "OpenMetadata", "version": "1.2.3.2"} / SELECT count(*) AS "rowCount", CAST(? AS BIGINT) AS "columnCount", CAST(? AS VARCHAR) AS "columnNames" FROM example_Schema.example_table FETCH FIRST 1 ROWS ONLY]

Version:

Additional context Add any other context about the problem here.

ayush-shah commented 10 months ago

Hello @elguero6, I will take a look on the issue, you can track the progress here itself. You can check the project part to see which release it will be a part of, based on the bandwidth and priorities 🙏

TeddyCr commented 9 months ago

@elguero6 how many columns does your table have? The columnNames parameter will be replaced by a string of all your column (comma separated). We might need to specify a greater VARCHAR length.

elguero6 commented 9 months ago

Yea can be numerous, 20-50 column table