Closed Bennyjoseph07 closed 4 months ago
github-actions[bot]
commented
5 months ago This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.
github-actions[bot]
commented
4 months ago This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.
Search before asking
What happened
Issue with PostgreSQL source (Column names created with double quotes to maintain mixed-case style) When attempting to read data from PostgreSQL and load it into MySQL, the operation fails if the columns were created using double quotes.
CREATE TABLE STATEMENT
CREATE TABLE IF NOT EXISTS public.cricket_data_15 ( index bigint, "Team" text COLLATE pg_catalog."default", "Player_ID" bigint, "PLAYER" text COLLATE pg_catalog."default", matches bigint, runs bigint, wickets bigint, "Hundreds" bigint, fifties bigint, speciality text COLLATE pg_catalog."default" )
CONNECTOR CONFIG
source { jdbc { url= "jdbc:postgresql://hostname:5432/postgres" driver= "org.postgresql.Driver" user= "postgres" password= "" query= "SELECT min(CASE WHEN Player_ID IS NOT NULL THEN Player_ID END) AS Player_ID_min, min(CASE WHEN Matches IS NOT NULL THEN Matches END) AS Matches_min, min(CASE WHEN Runs IS NOT NULL THEN Runs END) AS Runs_min, min(CASE WHEN Wickets IS NOT NULL THEN Wickets END) AS Wickets_min, min(CASE WHEN Hundreds IS NOT NULL THEN Hundreds END) AS Hundreds_min, min(CASE WHEN Fifties IS NOT NULL THEN Fifties END) AS Fifties_min, max(CASE WHEN Player_ID IS NOT NULL THEN Player_ID END) AS Player_ID_max, max(CASE WHEN Matches IS NOT NULL THEN Matches END) AS Matches_max, max(CASE WHEN Runs IS NOT NULL THEN Runs END) AS Runs_max, max(CASE WHEN Wickets IS NOT NULL THEN Wickets END) AS Wickets_max, max(CASE WHEN Hundreds IS NOT NULL THEN Hundreds END) AS Hundreds_max, max(CASE WHEN Fifties IS NOT NULL THEN Fifties END) AS Fifties_max, count(CASE WHEN Team IS NULL THEN 1 ELSE 0 END) AS Team_null, count(CASE WHEN Player_ID IS NULL THEN 1 ELSE 0 END) AS Player_ID_null, count(CASE WHEN Player IS NULL THEN 1 ELSE 0 END) AS Player_null, count(CASE WHEN Matches IS NULL THEN 1 ELSE 0 END) AS Matches_null, count(CASE WHEN Runs IS NULL THEN 1 ELSE 0 END) AS Runs_null, count(CASE WHEN Wickets IS NULL THEN 1 ELSE 0 END) AS Wickets_null, count(CASE WHEN Hundreds IS NULL THEN 1 ELSE 0 END) AS Hundreds_null, count(CASE WHEN Fifties IS NULL THEN 1 ELSE 0 END) AS Fifties_null, count(CASE WHEN Speciality IS NULL THEN 1 ELSE 0 END) AS Speciality_null, count(distinct(CASE WHEN Team IS NOT NULL THEN Team END)) AS Team_distinct, count(distinct(CASE WHEN Player_ID IS NOT NULL THEN Player_ID END)) AS Player_ID_distinct, count(distinct(CASE WHEN Player IS NOT NULL THEN Player END)) AS Player_distinct, count(distinct(CASE WHEN Matches IS NOT NULL THEN Matches END)) AS Matches_distinct, count(distinct(CASE WHEN Runs IS NOT NULL THEN Runs END)) AS Runs_distinct, count(distinct(CASE WHEN Wickets IS NOT NULL THEN Wickets END)) AS Wickets_distinct, count(distinct(CASE WHEN Hundreds IS NOT NULL THEN Hundreds END)) AS Hundreds_distinct, count(distinct(CASE WHEN Fifties IS NOT NULL THEN Fifties END)) AS Fifties_distinct, count(distinct(CASE WHEN Speciality IS NOT NULL THEN Speciality END)) AS Speciality_distinct, count(*) as count_check FROM public.cricket_data;" } }
SeaTunnel Version
2.3.4
SeaTunnel Config
Running Command
Error Exception
Zeta or Flink or Spark Version
No response
Java or Scala Version
No response
Screenshots
No response
Are you willing to submit PR?
Code of Conduct