search

averemee-si / oracdc

Oracle database CDC (Change Data Capture)
http://a2-solutions.eu/
Apache License 2.0
105 stars 36 forks source link

Invalid value: null used for required field - FOR COLUMNS WITH DEFAULT VALUE #1

Closed sonnguyen-dba closed 3 years ago

sonnguyen-dba commented 3 years ago

Hi Aleksej, I have issue with datatypes NUMBER from oracle (STATUSLOCKQUANTITY NUMBER,) org.apache.kafka.connect.errors.DataException: Invalid value: null used for required field: "STATUSLOCKQUANTITY", schema type: FLOAT64 at org.apache.kafka.connect.data.ConnectSchema.validateValue(ConnectSchema.java:220) at org.apache.kafka.connect.data.Struct.put(Struct.java:216) at org.apache.kafka.connect.data.Struct.put(Struct.java:203) at eu.solutions.a2.cdc.oracle.OraTable4LogMiner.parseRedoRecord(OraTable4LogMiner.java:328) at eu.solutions.a2.cdc.oracle.OraCdcLogMinerTask.poll(OraCdcLogMinerTask.java:536) at org.apache.kafka.connect.runtime.WorkerSourceTask.poll(WorkerSourceTask.java:272) at org.apache.kafka.connect.runtime.WorkerSourceTask.execute(WorkerSourceTask.java:239) at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:184) at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:234) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) [2020-09-30 21:15:26,258] ERROR WorkerSourceTask{id=oracdc-oracle-oracle-0} Task is being killed and will not recover until manually restarted (org.apache.kafka.connect.runtime.WorkerTask:187)

Regards, Son

averemee-si commented 3 years ago

Hi Son,

Could you please update issue with DDL for table which contains STATUSLOCKQUANTITY column. Thank you!

sonnguyen-dba commented 3 years ago

Hi Aleksej, This is DDL for table which contains STATUSLOCKQUANTITY column CREATE TABLE PM_CURRENTINSTOCK ( STOREID NUMBER, PRODUCTID CHAR(20 BYTE), INVENTORYSTATUSID NUMBER(10, 0), QUANTITY NUMBER(20, 4) NOT NULL, LOCKQUANTITY NUMBER DEFAULT 0 NOT NULL, STORECHANGEQUANTITY NUMBER DEFAULT 0 NOT NULL, SCORDERLOCKQUANTITY NUMBER DEFAULT 0 NOT NULL, PCORDERLOCKQUANTITY NUMBER DEFAULT 0 NOT NULL, STATUSLOCKQUANTITY NUMBER DEFAULT 0 NOT NULL, WARRANTYDEACTIVEQUANTITY NUMBER(10, 0) DEFAULT 0 NOT NULL, RECORDID NUMBER(38, 0), BRANDID NUMBER(10, 0), PROVINCEID NUMBER(10, 0), DISTRICTID NUMBER(10, 0), CONSTRAINT PK_CURRENTINSTOCK PRIMARY KEY (STOREID, PRODUCTID, INVENTORYSTATUSID) USING INDEX TABLESPACE DATAINDX ) TABLESPACE DATA;

averemee-si commented 3 years ago

Issue with columns with DEFAULT value

averemee-si commented 3 years ago

Hi Son,

Really strange issue - according to DDL value of STATUSLOCKQUANTITY in redo record must be 0 but it null. Could you please provide dump of redo record (Ref.: How to Dump Redo Log File Information (Doc ID 1031381.6)) and value of SQL_REDO from V$LOGMNR_CONTENTS mined with and without option DBMS_LOGMNR.DICT_FROM_ONLINE_CATALOG

Regards, Alexei

sonnguyen-dba commented 3 years ago

Hi Aleksej, Now issue don't appear from latest code. Regards, Son

averemee-si commented 3 years ago

Hi Son,

Thank you for update! I'll just add more diagnostic output to parsing code

Regards, Alexey

sonnguyen-dba commented 3 years ago

Thanks Alexey.

sonnguyen-dba commented 3 years ago

Hi Alexey, issue was appeared with diagnostic

[2020-10-01 20:44:18,219] INFO Initial load completed (eu.solutions.a2.cdc.oracle.OraCdcLogMinerTask:463) [2020-10-01 20:44:18,266] ERROR NULL value for NON NULL column STATUSLOCKQUANTITY, table PM_CURRENTINSTOCK (eu.solutions.a2.cdc.oracle.OraTable4LogMiner:332) [2020-10-01 20:44:18,266] ERROR Redo record information: (eu.solutions.a2.cdc.oracle.OraTable4LogMiner:334) [2020-10-01 20:44:18,266] ERROR SCN = 657834766230 (eu.solutions.a2.cdc.oracle.OraTable4LogMiner:335) [2020-10-01 20:44:18,266] ERROR TIMESTAMP = 1601311223000 (eu.solutions.a2.cdc.oracle.OraTable4LogMiner:336) [2020-10-01 20:44:18,267] ERROR RS_ID = 0x025685.0000198b.0234 (eu.solutions.a2.cdc.oracle.OraTable4LogMiner:337) [2020-10-01 20:44:18,267] ERROR SSN = 0 (eu.solutions.a2.cdc.oracle.OraTable4LogMiner:338) [2020-10-01 20:44:18,267] ERROR ROW_ID = AACd+3APGAAL58BAAO (eu.solutions.a2.cdc.oracle.OraTable4LogMiner:339) [2020-10-01 20:44:18,267] ERROR OPERATION_CODE = 3 (eu.solutions.a2.cdc.oracle.OraTable4LogMiner:340) [2020-10-01 20:44:18,267] ERROR SQL_REDO = update "UNKNOWN"."OBJ# 647095" set "COL 4" = 'c3052e', "COL 6" = '80', "COL 9" = NULL, "COL 10" = NULL where "COL 1" = 'c13d' and "COL 2" = '3131393336363830303033393220202020202020' and "COL 3" = 'c102' and "COL 4" = 'c3042e' and "COL 5" = '80' and "COL 6" = '80' and "COL 7" = '80' and "COL 8" = '80' and "COL 9" = '80' and "COL 10" = '80' (eu.solutions.a2.cdc.oracle.OraTable4LogMiner:341)

Regards, Son

averemee-si commented 3 years ago

Hi Son,

Please follow these steps and send me output of SQL queries below: 1) Detect archived redo log file name: select NAME, FIRST_CHABGE#, NEXT_CHANGE# from V$ARCHIVED_LOG where 657834766230 between FIRST_CHANGE# and NEXT_CHANGE#; 2) Start LogMiner using returned values from step 1) begin DBMS_LOGMNR.ADD_LOGFILE(LOGFILENAME => , OPTIONS => DBMS_LOGMNR.NEW); DBMS_LOGMNR.START_LOGMNR( STARTSCN => <VALUE_OF_FIRST_CHANGE#_FROM_STEP1>, ENDSCN => <VALUE_OF_NEXT_CHANGE#_FROM_STEP2>, OPTIONS => DBMS_LOGMNR.SKIP_CORRUPTION + DBMS_LOGMNR.NO_SQL_DELIMITER + DBMS_LOGMNR.NO_ROWID_IN_STMT + DBMS_LOGMNR.DICT_FROM_ONLINE_CATALOG); end; / 3) Run select SQL_REDO from V$LOGMNR_CONTENTS where RS_ID = ' 0x025685.0000198b.0234 ' and SSN=0;

sonnguyen-dba commented 3 years ago

update "PM_CURRENTINSTOCK" set "QUANTITY" = '11', "STORECHANGEQUANTITY" = '11' where "STOREID" = '7208' and "PRODUCTID" = '1033263000011 ' and "INVENTORYSTATUSID" = '1' and "QUANTITY" = '2' and "LOCKQUANTITY" = '0' and "STORECHANGEQUANTITY" = '2' and "SCORDERLOCKQUANTITY" = '0' and "PCORDERLOCKQUANTITY" = '0' and "STATUSLOCKQUANTITY" = '0' and "WARRANTYDEACTIVEQUANTITY" = '0'

averemee-si commented 3 years ago

Thank you! Working on it!

sonnguyen-dba commented 3 years ago

Thanks Alexey!

averemee-si commented 3 years ago

Hi Son,

Please clone latest code and retest issue

Regards, Aleksei

sonnguyen-dba commented 3 years ago

Ok Aleksei. Thanks

sonnguyen-dba commented 3 years ago

Hi Aleksei, Thank you so much for your fixed. Regards, Son

sonnguyen-dba commented 3 years ago

Hi Aleksei, Issue still appearing [2020-10-06 21:51:28,965] ERROR NULL value for NON NULL column STATUSLOCKQUANTITY, table PM_CURRENTINSTOCK (eu.solutions.a2.cdc.oracle.OraTable4LogMiner:609) [2020-10-06 21:51:28,965] ERROR Redo record information: (eu.solutions.a2.cdc.oracle.OraTable4LogMiner:611) [2020-10-06 21:51:28,966] ERROR SCN = 659512575734 (eu.solutions.a2.cdc.oracle.OraTable4LogMiner:612) [2020-10-06 21:51:28,966] ERROR TIMESTAMP = 1601744172000 (eu.solutions.a2.cdc.oracle.OraTable4LogMiner:613) [2020-10-06 21:51:28,966] ERROR RS_ID = 0x0258cc.0000ea89.0d70 (eu.solutions.a2.cdc.oracle.OraTable4LogMiner:614) [2020-10-06 21:51:28,966] ERROR SSN = 0 (eu.solutions.a2.cdc.oracle.OraTable4LogMiner:615) [2020-10-06 21:51:28,966] ERROR ROW_ID = AACd+3AFPAABLuUAB5 (eu.solutions.a2.cdc.oracle.OraTable4LogMiner:616) [2020-10-06 21:51:28,966] ERROR OPERATION_CODE = 3 (eu.solutions.a2.cdc.oracle.OraTable4LogMiner:617) [2020-10-06 21:51:28,966] ERROR SQL_REDO = update "UNKNOWN"."OBJ# 647095" set "COL 4" = '80', "COL 5" = '80', "COL 9" = NULL, "COL 10" = NULL where "COL 1" = 'c20f56' and "COL 2" = '3237323731323238333333303020202020202020' and "COL 3" = 'c106' and "COL 4" = 'c102' and "COL 5" = '80' and "COL 6" = '80' and "COL 7" = '80' and "COL 8" = '80' and "COL 9" = '80' and "COL 10" = '80' (eu.solutions.a2.cdc.oracle.OraTable4LogMiner:618) [2020-10-06 21:51:28,967] INFO WorkerSourceTask{id=oracdc-oracle-oracle-0} Committing offsets (org.apache.kafka.connect.runtime.WorkerSourceTask:426) [2020-10-06 21:51:28,967] INFO WorkerSourceTask{id=oracdc-oracle-oracle-0} flushing 0 outstanding messages for offset commit (org.apache.kafka.connect.runtime.WorkerSourceTask:443) [2020-10-06 21:51:28,968] ERROR WorkerSourceTask{id=oracdc-oracle-oracle-0} Task threw an uncaught and unrecoverable exception (org.apache.kafka.connect.runtime.WorkerTask:186) org.apache.kafka.connect.errors.DataException: org.apache.kafka.connect.errors.DataException: Invalid value: null used for required field: "STATUSLOCKQUANTITY", schema type: FLOAT64 at eu.solutions.a2.cdc.oracle.OraTable4LogMiner.parseRedoRecord(OraTable4LogMiner.java:338) at eu.solutions.a2.cdc.oracle.OraCdcLogMinerTask.poll(OraCdcLogMinerTask.java:536) at org.apache.kafka.connect.runtime.WorkerSourceTask.poll(WorkerSourceTask.java:272) at org.apache.kafka.connect.runtime.WorkerSourceTask.execute(WorkerSourceTask.java:239) at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:184) at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:234) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: org.apache.kafka.connect.errors.DataException: Invalid value: null used for required field: "STATUSLOCKQUANTITY", schema type: FLOAT64 at org.apache.kafka.connect.data.ConnectSchema.validateValue(ConnectSchema.java:220) at org.apache.kafka.connect.data.Struct.put(Struct.java:216) at org.apache.kafka.connect.data.Struct.put(Struct.java:203) at eu.solutions.a2.cdc.oracle.OraTable4LogMiner.parseRedoRecord(OraTable4LogMiner.java:329) ... 10 more [2020-10-06 21:51:28,969] ERROR WorkerSourceTask{id=oracdc-oracle-oracle-erp-0} Task is being killed and will not recover until manually restarted (org.apache.kafka.connect.runtime.WorkerTask:187)

averemee-si commented 3 years ago

Hi Son,

Please follow these steps and send me output of SQL queries below:

Detect archived redo log file name: select NAME, FIRST_CHABGE#, NEXT_CHANGE# from V$ARCHIVED_LOG where 659512575734 between FIRST_CHANGE# and NEXT_CHANGE#; Start LogMiner using returned values from step 1) begin DBMS_LOGMNR.ADD_LOGFILE(LOGFILENAME => , OPTIONS => DBMS_LOGMNR.NEW); DBMS_LOGMNR.START_LOGMNR( STARTSCN => <VALUE_OF_FIRST_CHANGE#_FROM_STEP1>, ENDSCN => <VALUE_OF_NEXT_CHANGE#_FROM_STEP2>, OPTIONS => DBMS_LOGMNR.SKIP_CORRUPTION + DBMS_LOGMNR.NO_SQL_DELIMITER + DBMS_LOGMNR.NO_ROWID_IN_STMT + DBMS_LOGMNR.DICT_FROM_ONLINE_CATALOG); end; / Run select SQL_REDO from V$LOGMNR_CONTENTS where RS_ID = ' 0x0258cc.0000ea89.0d70 ' and SSN=0;

Regards, Aleksei

averemee-si commented 3 years ago

Hi Son,

It seems to me that we found error in code - Mea culpa! Could you please clone latest code which includes commit fix wrong detection of DEFAULT value for column

Regards, Aleksei

sonnguyen-dba commented 3 years ago

Hi Aleksei, Thank you. I'll try... Regards, Son

sonnguyen-dba commented 3 years ago

Hi Aleksei, Now issue still appearing [2020-10-10 16:36:18,872] ERROR NULL value for NON NULL column ISHAVETEMPIMAGE, table PRODUCT_LANGUAGE (eu.solutions.a2.cdc.oracle.OraTable4LogMiner:609) [2020-10-10 16:36:18,872] ERROR Redo record information: (eu.solutions.a2.cdc.oracle.OraTable4LogMiner:611) [2020-10-10 16:36:18,872] ERROR SCN = 661102309349 (eu.solutions.a2.cdc.oracle.OraTable4LogMiner:612) [2020-10-10 16:36:18,873] ERROR TIMESTAMP = 1602210586000 (eu.solutions.a2.cdc.oracle.OraTable4LogMiner:613) [2020-10-10 16:36:18,873] ERROR RS_ID = 0x00239e.0008d60c.0010 (eu.solutions.a2.cdc.oracle.OraTable4LogMiner:614) [2020-10-10 16:36:18,873] ERROR SSN = 0 (eu.solutions.a2.cdc.oracle.OraTable4LogMiner:615) [2020-10-10 16:36:18,873] ERROR ROW_ID = AAAy+0AF2AAC7mdAAM (eu.solutions.a2.cdc.oracle.OraTable4LogMiner:616) [2020-10-10 16:36:18,873] ERROR OPERATION_CODE = 3 (eu.solutions.a2.cdc.oracle.OraTable4LogMiner:617) [2020-10-10 16:36:18,873] ERROR SQL_REDO = update "UNKNOWN"."OBJ# 208820" set "COL 36" = NULL where "COL 1" = 'c3176132' and "COL 2" = '76692d564e' and "COL 3" = '003c0075006c003e003c006c0069003e004d00e0006e0020006800ec006e0068003a00200041004d004f004c00450044002c00200031002e0033003900200069006e00630068003c002f006c0069003e003c006c0069003e005401b001a1006e006700200074006800ed00630068003a00200041006e00640072006f0069006400200034002e00340020007400721edf0020006c00ea006e002c00200069004f0053002000390020007400721edf0020006c00ea006e003c002f006c0069003e003c006c0069003e005400681edd00690020006700690061006e002000731eed002000641ee5006e0067002000700069006e003a0020004b0068006f1ea3006e00670020003300300020006700691edd0020006b00680069002000731eed002000641ee5006e00670020004700500053002c0020004b0068006f1ea3006e00670020003100340020006e006700e00079003c002f006c0069003e003c006c0069003e0110006f0020006e1ed3006e0067002001111ed90020006f00780079002000740072006f006e00670020006d00e100750020002800530070004f00320029002c00200110006f0020006c01b01ee3006e006700200074006900ea00750020007400681ee50020006f00780079002000741ed10069002001110061002000280056004f00320020006d006100780029002c0020005400680065006f0020006400f500690020006d1ee90063002001111ed90020007300740072006500730073002c00200110006f0020006e00681ecb0070002000740069006d002c0020005400680065006f0020006400f500690020006700691ea500630020006e00671ee7002c0020005400ed006e00680020006c01b01ee3006e0067002000630061006c006f007200690065007300200074006900ea00750020007400681ee5002c002001101ebf006d002000731ed10020006201b01edb006300200063006800e2006e002c0020004300681ebf002001111ed90020006c007500791ec7006e002000741ead0070002c0020005400ed006e006800200071007500e3006e00670020011101b01edd006e00670020006300681ea10079003c002f006c0069003e003c002f0075006c003e' and "COL 4" = 'c2474e' and "COL 5" = '01101ed3006e0067002000681ed300200074006800f4006e00670020006d0069006e006800200048007500610077006500690020005700610074006300680020004700540032002000500072006f002000340036006d006d0020006400e20079002000640061002c01101ed3006e0067002000681ed300200074006800f4006e00670020006d0069006e00680020004800750061007700650069002c00200048007500610077006500690020005700610074006300680020004700540032' and "COL 6" = '0048007500610077006500690020005700610074006300680020004700540032002000500072006f002000340036006d006d0020006400e20079002000640061002c002001101ed3006e0067002000681ed300200074006800f4006e00670020006d0069006e006800200048007500610077006500690020005700610074006300680020004700540032002000500072006f002000340036006d006d0020006400e20079002000640061002c01101ed3006e0067002000681ed300200074006800f4006e00670020006d0069006e00680020004800750061007700650069002c00200048007500610077006500690020005700610074006300680020004700540032002c0020002c002001101ed3006e0067002000681ed300200074006800f4006e00670020006d0069006e006800200048007500610077006500690020005700610074006300680020004700540032002000500072006f002000340036006d006d0020006400e20079002000640061002c00200067006900e100200048007500610077006500690020005700610074006300680020004700540032002000500072006f002000340036006d006d0020006400e20079002000640061002c00200074006800f4006e0067002000740069006e00200048007500610077006500690020005700610074006300680020004700540032002000500072006f002000340036006d006d0020006400e20079002000640061' and "COL 7" = '01101ed3006e0067002000681ed300200074006800f4006e00670020006d0069006e006800200048007500610077006500690020005700610074006300680020004700540032002000500072006f002000340036006d006d0020006400e20079002000640061002c01101ed3006e0067002000681ed300200074006800f4006e00670020006d0069006e00680020004800750061007700650069002c0020004800750061007700650069002000570061007400630068002000470054003200200063006800ed006e00680020006800e3006e006700200067006900e1002000721ebb002e0020005400721ea30020006700f300700020006c00e300690020007300751ea500740020007400681ea50070002e0020004c1ed7006900200031002001111ed5006900200031002000740072006f006e00670020003100200074006800e1006e0067002e0020004700690061006f0020006800e0006e00670020006e00680061006e0068002e' and "COL 8" = '01101ed3006e0067002000681ed300200074006800f4006e00670020006d0069006e006800200048007500610077006500690020005700610074006300680020004700540032002000500072006f002000340036006d006d0020006400e200790020006400610020002d00200047006900e1002000721ebb' and "COL9" = '00770061007400630068002d006700740032002d00700072006f002d00340036006d006d002d006400610079002d00640061' and "COL 14" = '487561776569205761746368204754322050726f2034366d6d2064c3a279206461' and "COL 15" = '487561776569205761746368204754322050726f2034366d6d2064c3a279206461' and "COL 16" IS NULL and "COL 19" = 'c102' and "COL 20" = '487561776569205761746368204754322050726f2034366d6d20646179206461' and "COL 21" IS NULL and "COL 22" = '80' and "COL 23" = 'c102' and "COL 24" = '80' and "COL 25" = '80' and "COL 26" IS NULL and "COL 27" IS NULL and "COL 28" IS NULL and "COL 29" IS NULL and "COL 30" IS NULL and "COL 31" = '80' and "COL 32" = '80' and "COL 33" = '80' and "COL 34" = '80' and "COL 35" = '80' and "COL 37" = 'c102' and "COL39" = '80' and "COL 40" = '80' and "COL 41" = '73735f63616f' and "COL 42" = '63616f' and "COL 43" IS NULL and "COL 44" IS NULL and "COL 45" = '80' and "COL 46" IS NULL and "COL 47" IS NULL and "COL 49" IS NULL and "COL 50" IS NULL and "COL 51" IS NULL and "COL 52" IS NULL and "COL 53" = '80' and "COL 54" IS NULL and "COL 55" IS NULL and "COL 56" IS NULL and "COL 57" IS NULL and "COL 58" IS NULL and "COL 59" = '444f4e4720484f2054484f4e47204d494e4820485541574549205741544348204754322050524f2034364d4d20444159204441202d20474941205245' and "COL 60" = '80' and "COL 61" = '80' and "COL 62" = '80' and "COL 63" = 'c490e1bb936e672068e1bb93207468c3b46e67206d696e6820487561776569205761746368204754322050726f2034366d6d2064c3a279206461' and "COL 64" IS NULL and "COL 65" IS NULL and "COL 66" IS NULL and "COL 67" IS NULL and "COL 68" IS NULL and "COL 69" IS NULL and "COL 70" IS NULL and "COL 71" = '80' and "COL 72" = '80' and "COL 73" IS NULL and "COL 74" IS NULL and "COL 75" IS NULL and "COL 76" IS NULL and "COL 77" IS NULL and "COL 78" = '80' and "COL 79" = '80' and "COL 80" IS NULL and "COL 81" IS NULL and "COL 82" IS NULL and "COL 83" = '80' and "COL 84" IS NULL and "COL 85" = '80' and "COL 86" = '78780a06010101' and "COL 87" = '78780a12180101' and "COL 88" = '487561776569205761746368204754322050726f2034366d6d2064c3a279206461' and "COL 89" IS NULL and "COL 90" = '77617463682d6774322d70726f2d34366d6d2d6461792d64612d6176612d323030783230302e6a7067' and "COL 91" = '77617463682d6774322d70726f2d34366d6d2d6461792d64612d6176612d343030783430302e6a7067' and "COL 92" = '77617463682d6774322d70726f2d34366d6d2d6461792d64612d6176612d363030783630302e6a7067' and "COL 93" = '78780a06102d1f' and "COL 94" = '3235323436' and "COL 95" = '3132' and "COL 96" = '80' and "COL 97" = '80' and "COL 98" IS NULL and "COL 99" IS NULL and "COL 100" IS NULL and "COL 101" IS NULL and "COL 102" IS NULL and "COL 103" IS NULL and "COL 104" = '80' and "COL 105" = '485541574549205741544348204754322050524f2034364d4d20444159204441' and "COL 106" IS NULL and "COL 107" IS NULL and "COL 108" IS NULL and "COL 109" IS NULL and "COL 110" IS NULL and "COL 111" = '80' and "COL 112" = '80' and "COL 113" = '80' and "COL 114" IS NULL and "COL 117" = '80' and "COL 118" IS NULL and "COL 119" = '80' and "COL 120" = 'c3176133' and "COL 121" = '80' and "COL 122" IS NULL and "COL 123" IS NULL and "COL 124" IS NULL and "COL 127" IS NULL and "COL 128" IS NULL and "COL 129" IS NULL and "COL 130" IS NULL and "COL 131" = '80' and "COL 132" IS NULL and "COL 133" = '80' and "COL 134" = '80' and "COL 135" = '80' and "COL 137" IS NULL and "COL 139" = '80' and "COL 140" IS NULL and "COL 141" IS NULL and "COL 142" IS NULL and "COL 143" IS NULL and "COL 144" IS NULL and "COL 145" IS NULL and "COL 146" IS NULL and "COL 147" IS NULL and "COL 148" = '80' and "COL 149" IS NULL and "COL 150" = '80' and "COL 151" IS NULL and "COL 152" = 'c102' and "COL 153" IS NULL and "COL 154" IS NULL and "COL 155" IS NULL and "COL 156" IS NULL and "COL 157" IS NULL and "COL 158" = '80' and "COL 159" = 'c3564528' and "COL 160" IS NULL and "COL 161" IS NULL and "COL 162" IS NULL and "COL 163" IS NULL and "COL 164" IS NULL and "COL 165" = '80' and "COL 166" IS NULL and "COL 167" IS NULL and "COL 168" IS NULL and "COL 169" IS NULL and "COL 170" IS NULL and "COL 171" IS NULL and "COL 172" IS NULL (eu.solutions.a2.cdc.oracle.OraTable4LogMiner:618) [2020-10-10 16:36:18,874] INFO WorkerSourceTask{id=oracdc-oracle-oracle-webcap-0} Committing offsets (org.apache.kafka.connect.runtime.WorkerSourceTask:426) [2020-10-10 16:36:18,874] INFO WorkerSourceTask{id=oracdc-oracle-oracle-webcap-0} flushing 0 outstanding messages for offset commit (org.apache.kafk a.connect.runtime.WorkerSourceTask:443) [2020-10-10 16:36:18,874] INFO WorkerSourceTask{id=oracdc-oracle-oracle-webcap-0} Finished commitOffsets successfully in 0 ms (org.apache.kafka.conn ect.runtime.WorkerSourceTask:525) [2020-10-10 16:36:18,875] ERROR WorkerSourceTask{id=oracdc-oracle-oracle-webcap-0} Task threw an uncaught and unrecoverable exception (org.apache.ka fka.connect.runtime.WorkerTask:186) org.apache.kafka.connect.errors.DataException: org.apache.kafka.connect.errors.DataException: Invalid value: null used for required field: "ISHAVETEMPIMAGE", schema type: INT8 at eu.solutions.a2.cdc.oracle.OraTable4LogMiner.parseRedoRecord(OraTable4LogMiner.java:370) at eu.solutions.a2.cdc.oracle.OraCdcLogMinerTask.poll(OraCdcLogMinerTask.java:536) at org.apache.kafka.connect.runtime.WorkerSourceTask.poll(WorkerSourceTask.java:272) at org.apache.kafka.connect.runtime.WorkerSourceTask.execute(WorkerSourceTask.java:239) at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:184) at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:234) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: org.apache.kafka.connect.errors.DataException: Invalid value: null used for required field: "ISHAVETEMPIMAGE", schema type: INT8 at org.apache.kafka.connect.data.ConnectSchema.validateValue(ConnectSchema.java:220) at org.apache.kafka.connect.data.Struct.put(Struct.java:216) at org.apache.kafka.connect.data.Struct.put(Struct.java:203) at eu.solutions.a2.cdc.oracle.OraTable4LogMiner.parseRedoRecord(OraTable4LogMiner.java:367) ... 10 more [2020-10-10 16:36:18,875] ERROR WorkerSourceTask{id=oracdc-oracle-oracle-webcap-0} Task is being killed and will not recover until manually restarted (org.apache.kafka.connect.runtime.WorkerTask:187)

select NAME, FIRST_CHANGE#, NEXT_CHANGE# from V$ARCHIVED_LOG where 661102309349 between FIRST_CHANGE# and NEXT_CHANGE#;

select SQL_REDO from V$LOGMNR_CONTENTS where RS_ID = ' 0x00239e.0008d60c.0010 ' and SSN=0;

set transaction read write update "PRODUCT_LANGUAGE" set "HTMLSLIDER" = NULL where "PRODUCTID" = '229649' and "LANGUAGEID" = 'vi-VN' and "DESCRIPTION" = UNISTR('

') and "CATEGORYID" = '7077' and "KEYWORD" = UNISTR('\0110\1ED3ng h\1ED3 th\00F4ng minh Huawei Watch GT2 Pr o 46mm d\00E2y da,\0110\1ED3ng h\1ED3 th\00F4ng minh Huawei, Huawei Watch GT2') and "METAKEYWORD" = UNISTR('Huawei Watch GT2 Pro 46mm d\00E2y da, \0110\1ED3ng h\1ED3 th\00F4ng minh Huawei Watch GT2 Pro 46mm d\00E2y da,\0110\1ED3ng h\1ED3 th\00F4ng minh Huawei, Huawei Watch GT2, , \0110\1ED3ng h\1ED3 th\00F4ng minh Huawei Watch GT2 Pro 46mm d\00E2y da, gi\00E1 Huawei Watch GT2 Pro 46mm d\00E2y da, th\00F4ng tin Huawei Watch GT2 Pro 46mm d\00E2y da') and "METADESCRIPTION" = UNISTR('\0110\1ED3ng h\1ED3 th\00F4ng minh Huawei Watch GT2 Pro 46mm d\00E2y da,\0110\1ED3ng h\1ED3 th\00F4ng minh Huawei, Huawei Watch GT2 ch\00EDnh h\00E3ng gi\00E1 r\1EBB. Tr\1EA3 g\00F3p l\00E3i su\1EA5t th\1EA5p. L\1ED7i 1 \0111\1ED5i 1 trong 1 th\00E1ng. Giao h\00E0ng nhanh.') and "METATITLE" = UNISTR('\0110\1ED3ng h\1ED3 th\00F4ng minh Huawei Watch GT2 Pro 46mm d\00E2y da - Gi\00E1 r\1EBB') and "URL" = 'watch-gt2 -pro-46mm-day-da' and "PRODUCTNAME" = 'Huawei Watch GT2 Pro 46mm day da' and "SEONAME" = 'Huawei Watch GT2 Pro 46mm day da' and "CANONICAL" IS NULL and "SITEID" = '1' and "PRODUCTNAMEMAP" = 'Huawei Watch GT2 Pro 46mm day da' and "PURCHASINGINFO" IS NULL and "ISHOT" = '0' and "ISNEW" = '1' and "ISSPECIAL" = '0' and "ISEVENT" = '0' and "FEATUREIMAGE" IS NULL and "FEATURESTARTDATE" IS NULL and "FEATUREEXPIREDATE" IS NULL and "ADVANTAGE" IS NULL and "DISADVANTAGE" IS NULL and "EXPECTEDPRICE" = '0' and "ISSHOWEXPECTEDPRICE" = '0' and "ISHEARSAY" = '0' and "ISSHOWEXPECTEDTEXT" = '0' and "TOTALSLIDER" = '0' and "ISNEWSDETAILVERSION" = '1' and "SCENARIO" = '0' and "ISCHECKCONFIRMCONFIG" = '0' and "TEMPLATEALIAS" = 'ss_cao' and "TEMPLATEFEATURE" = 'cao' and "SPECIALFEATURE" IS NULL and "DETAILIMAGE" IS NULL and "COUNTLIKE" = '0' and "HOTREASON" IS NULL and "SHORTDESCRIPTION" IS NULL and "KITIMAGELARGE" IS NULL and "KITIMAGESMALL" IS NULL and "SPECIFICATIONIMAGE" IS NULL and "TOPIMAGE" IS NULL and "BACKGROUNDID" = '0' and "SCENARIOSTARTDATE" IS NULL and "SCENARIOENDDATE" IS NULL and "SCENARIOSHOWWEBFROMDATE" IS NULL and "SCENARIOSHOWWEBTODATE" IS NULL and "TMPIMAGE" IS NULL and "METATITLECHK" = 'DONG HO THONG MINH HUAWEI WATCH GT2 PRO 46MM DAY DA - GIA RE' and "ISCOLLECTION" = '0' and "COLLECTIONID" = '0' and "COLLECTIONPRODUCTCOUNT" = '0' and "COLLECTIONNAME" = 'D?ng h? thong minh Huawei Watch GT2 Pro 46mm day da' and "LISTRELATEDNEWSID" IS NULL and "LISTRELATEDVIDEOID" IS NULL and "BREPRESENTIMAGE" IS NULL and "MREPRESENTIMAGE" IS NULL and "SREPRESENTIMAGE" IS NULL and "LISTNEWSID" IS NULL and "LISTPRODUCTID" IS NULL and "ISSMARTPHONE" = '0' and "TEMPLATERATINGID" = '0' and "NORTHERNPRODUCTNAME" IS NULL and "REDIRECTURL" IS NULL and "REDIRECTFROMDATE" IS NULL and "REDIRECTTODATE" IS NULL and "LISTREPLACEPRODUCTID" IS NULL and "ISEASYDEAL" = '0' and "ISPAYMENT" = '0' and "PAYMENTFROMDATE" IS NULL and "PAYMENTTODATE" IS NULL and "CYCLEPROMOTIONIDLIST" IS NULL and "ISWEBLUCKYCYCLE" = '0' and "LISTCATEFEATUREID" IS NULL and "BADGETYPE" = '0' and "BADGESTARTDATE" = TO_TIMESTAMP('06-OCT-20 12.00.00 AM') and "BADGEENDDATE" = TO_TIMESTAMP('18-OCT-20 11.00.00 PM') and "SHORTNAME" = 'Huawei Watch GT2 Pro 46mm day da' and "SHOWHOMEENDDATE" IS NULL and "SIMAGE" = 'watch-gt2-pro-46mm-day-da-ava-200x200.jpg' and "MIMAGE" = 'watch-gt2-pro-46mm-day-da-ava-400x400.jpg' and "BIMAGE" = 'watch-gt2-pro-46mm-day-da-ava-600x600.jpg' and "UPDATEDDATE" = TO_TIMESTAMP('06-OCT-20 0 3.44.30 PM') and "UPDATEDUSER" = '25246' and "WARRANTYINFO" = '12' and "ISLANDINGPAGEONDETAIL" = '0' and "APPSCENARIO" = '0' and "APPSCENARIOSTARTDATE" IS NULL and "APPSCENARIOENDDATE" IS NULL and "APPSCENARIOSHOWWEBFROMDATE" IS NULL and "APPSCENARIOSHOWWEBTODATE" IS NULL and "REFPRICE" IS NULL and "COMBOPRODUCTIDLIST" IS NULL and "IMAGESIZE" = '0' and "PRODUCTNAMECHK" = 'HUAWEI WATCH GT2 PRO 46MM DAY DA' and "TIMERMETATILE" IS NULL and "TIMERMETADESCRIPTION" IS NULL and "TIMERMETAKEYWORD" IS NULL and "TIMERFROMDATE" IS NULL and "TIMERTODATE" IS NULL and "ISPARTNERPRODUCT" = '0' and "UPDATEDPA RTNERID" = '0' and "ISSHOWWEB" = '0' and "INSTOCKSITEIDLIST" IS NULL and "ISNOTSALE" = '0' and "NOTDELIVERYDISTRICTIDLIST" IS NULL and "ISREPRESENTPRODUCT" = '0' and "REPRESENTPRODUCTID" = '229650' and "ISREFERACCESSORY" = '0' and "SHOWHOMESTARTDATE" IS NULL and "PROVINCEIDLIST" IS NULL and "DETAILSHORTNAME" IS NULL and "DETAILSUGGESTDESCRIPTION" IS NULL and "SEARCHSUGGESTDESCRIPTION" IS NULL and "SUGGESTFROMDATE" IS NULL and "SUGGESTTODATE" IS NULL and "COMBODISCOUNTPERCENT" = '0' and "COMBOPROMOTIONIDLIST" IS NULL and "ISSHOWFULLSTOCK" = '0' and "ISSHOWHOME" = '0' and "SHOWHOMEDISPLAYORDER" = '0' and "DESKTOPFEATUREIMAGE" IS NULL and "ISPREORDERCAM" = '0' and "PREORDERCAMFROMDATE" IS NULL and "PREORDERCAMTODATE" IS NULL and "PREORDERCAMINFO" IS NULL and "TIMERTHUMBMETA" IS NULL and "TIMERFEATUREIMAGE" IS NULL and "TIMERFEATUREFROMDATE" IS NULL and "TIMERFEATURETODATE" IS NULL and "TIMERFEATUREIMAGEDESKTOP" IS NULL and "ISWARRANTYHOME" = '0' and "UPDATEDDATEPARTNER" IS NULL and "LABELPOSITION" = '0' and "LABELCOLOR" IS NULL and "WEBSTATUSID" = '1' and "TIMERTHUMBIMAGE" IS NULL and "TIMERTHUMBIMAGEFROMDATE" IS NULL and "TIMERTHUMBIMAGETODATE" IS NULL and "COMBOFROMDATE" IS NULL and "COMBOTODATE" IS NULL and "QUANTITYPROMOTIONID" = '0' and "RECORDID" = '856839' and "PLATFORMIDLIST" IS NULL and "PLATFORMNAMELIST" IS NULL and "CATEGORYIDLIST" IS NULL and "CATEGORYNAMELIST" IS NULL and "QUANTITY" = '0' and "UNITNAME" IS NULL and "ACCESSORIESSTARTDATE" IS NULL and "ACCESSORIESENDDATE" IS NULL and "ARRIVALDATE" IS NULL

DDL: CREATE TABLE PRODUCT_LANGUAGE ( PRODUCTID NUMBER NOT NULL, LANGUAGEID VARCHAR2(10 BYTE) DEFAULT 1 NOT NULL, DESCRIPTION NVARCHAR2(2000), CATEGORYID NUMBER NOT NULL, KEYWORD NVARCHAR2(2000), METAKEYWORD NVARCHAR2(2000), METADESCRIPTION NVARCHAR2(600), METATITLE NVARCHAR2(200), URL NVARCHAR2(300), HTML NCLOB, TOOLTIP NCLOB, GENERAL NCLOB, USERGUIDE NCLOB, PRODUCTNAME VARCHAR2(200 BYTE) DEFAULT 0 NOT NULL, SEONAME VARCHAR2(200 BYTE), CANONICAL VARCHAR2(500 BYTE), HTMLMOBILE NCLOB, HTMLDESCRIPTION NCLOB, SITEID NUMBER DEFAULT 1, PRODUCTNAMEMAP VARCHAR2(200 BYTE), PURCHASINGINFO VARCHAR2(4000 BYTE), ISHOT NUMBER(1, 0) DEFAULT 0 NOT NULL, ISNEW NUMBER(1, 0) DEFAULT 0 NOT NULL, ISSPECIAL NUMBER(1, 0) DEFAULT 0 NOT NULL, ISEVENT NUMBER(1, 0) DEFAULT 0 NOT NULL, FEATUREIMAGE VARCHAR2(2000 BYTE), FEATURESTARTDATE TIMESTAMP(6), FEATUREEXPIREDATE TIMESTAMP(6), ADVANTAGE NVARCHAR2(2000), DISADVANTAGE NVARCHAR2(2000), EXPECTEDPRICE NUMBER(38, 4) DEFAULT 0 NOT NULL, ISSHOWEXPECTEDPRICE NUMBER(1, 0) DEFAULT 0 NOT NULL, ISHEARSAY NUMBER(1, 0) DEFAULT 0 NOT NULL, ISSHOWEXPECTEDTEXT NUMBER(1, 0) DEFAULT 0 NOT NULL, TOTALSLIDER NUMBER(38, 0) DEFAULT 0 NOT NULL, HTMLSLIDER NCLOB, ISNEWSDETAILVERSION NUMBER(1, 0) DEFAULT 0 NOT NULL, HTMLSLIDERMOBILE NCLOB, SCENARIO NUMBER(38, 0) DEFAULT 0 NOT NULL, ISCHECKCONFIRMCONFIG NUMBER(1, 0) DEFAULT 0 NOT NULL, TEMPLATEALIAS VARCHAR2(2000 BYTE), TEMPLATEFEATURE VARCHAR2(2000 BYTE), SPECIALFEATURE VARCHAR2(4000 BYTE), DETAILIMAGE VARCHAR2(1000 BYTE), COUNTLIKE NUMBER(38, 0) DEFAULT 0 NOT NULL, HOTREASON NVARCHAR2(2000), SHORTDESCRIPTION NVARCHAR2(2000), HTMLSLIDER2 NCLOB, KITIMAGELARGE NVARCHAR2(2000), KITIMAGESMALL NVARCHAR2(2000), SPECIFICATIONIMAGE VARCHAR2(255 BYTE), TOPIMAGE VARCHAR2(1000 BYTE), BACKGROUNDID NUMBER(38, 0), SCENARIOSTARTDATE TIMESTAMP(6), SCENARIOENDDATE TIMESTAMP(6), SCENARIOSHOWWEBFROMDATE TIMESTAMP(6), SCENARIOSHOWWEBTODATE TIMESTAMP(6), TMPIMAGE VARCHAR2(2000 BYTE), METATITLECHK VARCHAR2(1000 BYTE), ISCOLLECTION NUMBER(1, 0) DEFAULT 0 NOT NULL, COLLECTIONID NUMBER(38, 0) DEFAULT 0 NOT NULL, COLLECTIONPRODUCTCOUNT NUMBER(38, 0) DEFAULT 0 NOT NULL, COLLECTIONNAME VARCHAR2(1000 BYTE), LISTRELATEDNEWSID VARCHAR2(2000 BYTE), LISTRELATEDVIDEOID VARCHAR2(2000 BYTE), BREPRESENTIMAGE VARCHAR2(1000 BYTE), MREPRESENTIMAGE VARCHAR2(1000 BYTE), SREPRESENTIMAGE VARCHAR2(1000 BYTE), LISTNEWSID VARCHAR2(2000 BYTE), LISTPRODUCTID VARCHAR2(2000 BYTE), ISSMARTPHONE NUMBER(1, 0) DEFAULT 0 NOT NULL, TEMPLATERATINGID NUMBER(38, 0) DEFAULT 0 NOT NULL, NORTHERNPRODUCTNAME VARCHAR2(2000 BYTE), REDIRECTURL VARCHAR2(2000 BYTE), REDIRECTFROMDATE TIMESTAMP(6), REDIRECTTODATE TIMESTAMP(6), LISTREPLACEPRODUCTID VARCHAR2(2000 BYTE), ISEASYDEAL NUMBER(1, 0) DEFAULT 0 NOT NULL, ISPAYMENT NUMBER(1, 0) DEFAULT 0 NOT NULL, PAYMENTFROMDATE TIMESTAMP(6), PAYMENTTODATE TIMESTAMP(6), CYCLEPROMOTIONIDLIST VARCHAR2(2000 BYTE), ISWEBLUCKYCYCLE NUMBER(1, 0) DEFAULT 0 NOT NULL, LISTCATEFEATUREID VARCHAR2(2000 BYTE), BADGETYPE NUMBER(38, 0) DEFAULT 0 NOT NULL, BADGESTARTDATE TIMESTAMP(6), BADGEENDDATE TIMESTAMP(6), SHORTNAME VARCHAR2(2000 BYTE), SHOWHOMEENDDATE TIMESTAMP(6), SIMAGE VARCHAR2(500 BYTE), MIMAGE VARCHAR2(500 BYTE), BIMAGE VARCHAR2(500 BYTE), UPDATEDDATE TIMESTAMP(6), UPDATEDUSER VARCHAR2(100 BYTE), WARRANTYINFO VARCHAR2(2000 BYTE), ISLANDINGPAGEONDETAIL NUMBER(1, 0) DEFAULT 0 NOT NULL, APPSCENARIO NUMBER(1, 0) DEFAULT 0 NOT NULL, APPSCENARIOSTARTDATE TIMESTAMP(6), APPSCENARIOENDDATE TIMESTAMP(6), APPSCENARIOSHOWWEBFROMDATE TIMESTAMP(6), APPSCENARIOSHOWWEBTODATE TIMESTAMP(6), REFPRICE NUMBER(38, 4), COMBOPRODUCTIDLIST VARCHAR2(2000 BYTE), IMAGESIZE NUMBER(38, 0) DEFAULT 0 NOT NULL, PRODUCTNAMECHK VARCHAR2(2000 BYTE), TIMERMETATILE VARCHAR2(1000 BYTE), TIMERMETADESCRIPTION VARCHAR2(1000 BYTE), TIMERMETAKEYWORD VARCHAR2(1000 BYTE), TIMERFROMDATE TIMESTAMP(6), TIMERTODATE TIMESTAMP(6), ISPARTNERPRODUCT NUMBER(1, 0) DEFAULT 0 NOT NULL, UPDATEDPARTNERID NUMBER(38, 0) DEFAULT 0 NOT NULL, ISSHOWWEB NUMBER(1, 0) DEFAULT 0 NOT NULL, INSTOCKSITEIDLIST VARCHAR2(500 BYTE), DUSERMANUAL NCLOB, MUSERMANUAL NCLOB, ISNOTSALE NUMBER(1, 0) DEFAULT 0 NOT NULL, NOTDELIVERYDISTRICTIDLIST VARCHAR2(2000 BYTE), ISREPRESENTPRODUCT NUMBER(1, 0) DEFAULT 0 NOT NULL, REPRESENTPRODUCTID NUMBER(38, 0) DEFAULT 0 NOT NULL, ISREFERACCESSORY NUMBER(1, 0) DEFAULT 0 NOT NULL, SHOWHOMESTARTDATE TIMESTAMP(6), PROVINCEIDLIST VARCHAR2(2000 BYTE), DETAILSHORTNAME VARCHAR2(2000 BYTE), SPECIFICATION NCLOB, PRODUCTARTICLE NCLOB, DETAILSUGGESTDESCRIPTION VARCHAR2(1000 BYTE), SEARCHSUGGESTDESCRIPTION VARCHAR2(1000 BYTE), SUGGESTFROMDATE TIMESTAMP(6), SUGGESTTODATE TIMESTAMP(6), COMBODISCOUNTPERCENT NUMBER(38, 4) DEFAULT 0 NOT NULL, COMBOPROMOTIONIDLIST VARCHAR2(2000 BYTE), ISSHOWFULLSTOCK NUMBER(1, 0) DEFAULT 0 NOT NULL, ISSHOWHOME NUMBER(1, 0) DEFAULT 0 NOT NULL, SHOWHOMEDISPLAYORDER NUMBER(38, 0) DEFAULT 0 NOT NULL, HTMLDESCRIPTIONREP NCLOB, DESKTOPFEATUREIMAGE VARCHAR2(2000 BYTE), SHORTDESCRIPTIONREP NCLOB, ISPREORDERCAM NUMBER(1, 0) DEFAULT 0 NOT NULL, PREORDERCAMFROMDATE TIMESTAMP(6), PREORDERCAMTODATE TIMESTAMP(6), PREORDERCAMINFO VARCHAR2(4000 BYTE), TIMERTHUMBMETA VARCHAR2(4000 BYTE), TIMERFEATUREIMAGE VARCHAR2(4000 BYTE), TIMERFEATUREFROMDATE TIMESTAMP(6), TIMERFEATURETODATE TIMESTAMP(6), TIMERFEATUREIMAGEDESKTOP VARCHAR2(4000 BYTE), ISWARRANTYHOME NUMBER(1, 0) DEFAULT 0 NOT NULL, UPDATEDDATEPARTNER TIMESTAMP(6), LABELPOSITION NUMBER(38, 0) DEFAULT 0 NOT NULL, LABELCOLOR VARCHAR2(100 BYTE), WEBSTATUSID NUMBER(38, 0) DEFAULT 0 NOT NULL, TIMERTHUMBIMAGE VARCHAR2(1000 BYTE), TIMERTHUMBIMAGEFROMDATE TIMESTAMP(6), TIMERTHUMBIMAGETODATE TIMESTAMP(6), COMBOFROMDATE TIMESTAMP(6), COMBOTODATE TIMESTAMP(6), QUANTITYPROMOTIONID NUMBER(38, 0) DEFAULT 0 NOT NULL, RECORDID NUMBER(38, 0), PLATFORMIDLIST VARCHAR2(2000 BYTE), PLATFORMNAMELIST VARCHAR2(2000 BYTE), CATEGORYIDLIST VARCHAR2(2000 BYTE), CATEGORYNAMELIST VARCHAR2(2000 BYTE), ISHAVETEMPIMAGE NUMBER(1, 0) DEFAULT 0 NOT NULL, QUANTITY NUMBER(38, 0), UNITNAME VARCHAR2(300 BYTE), ISHIDDENPRICE NUMBER(1, 0) DEFAULT 0 NOT NULL, ACCESSORIESSTARTDATE TIMESTAMP(6), ACCESSORIESENDDATE TIMESTAMP(6), ACCESSORIESISSHOWHOME NUMBER(1, 0) DEFAULT 0 NOT NULL, ACCESSORIESDISPLAYORDER NUMBER(2, 0) DEFAULT 0 NOT NULL, ARRIVALDATE TIMESTAMP(6) )

Regards, Son

averemee-si commented 3 years ago

Hi Son,

Could you please provide output for select COLUMN_ID from DBA_TAB_COLS where OWNER='TGDD_NEWS ' and TABLE_NAME='PRODUCT_LANGUAGE' and COLUMN_NAME='ISHAVETEMPIMAGE';

Regards, Aleksei

sonnguyen-dba commented 3 years ago

Hi Aleksei,

COLUMN_ID

   164

Regards, Son

averemee-si commented 3 years ago

Hi Son,

Thank you, it's different issue than STATUSLOCKQUANTITY column, but also DEFAULT value related. Hope that fix for this issue will be available soon

Regards, Aleksei

sonnguyen-dba commented 3 years ago

Hi Aleksei, Thank you, I'm waiting good news from you! Regards, Son

averemee-si commented 3 years ago

Hi Son,

This is related to LogMiner behavior when COLUMN has DEFAULT value and SUPPLEMENTAL LOGGING set to ALL COLUMNS. This is due to fixed schema's in Kafka broker. Whole fix will be available later in two-three weeks, this will be new type of shema to use (new value for a2.schema.type parameter and support SUPPLEMENTAL LOGGING=PK & UNIQUE columns), meanwhile I'll build codefix which will set COLUMN value to DEFAULT when oracdc unable to get it from V$LOGMNR_CONTENTS.SQL_REDO and print WARN level message to connector log.

Regards, Alexei

sonnguyen-dba commented 3 years ago

Thanks Alexei. Regards, Son

averemee-si commented 3 years ago

Hi Son,

Fixed in fix for SUPPLEMENTAL LOG DATA (ALL) COLUMNS and COLUMNS with DEFAULT value set Could you please clone latest code from Github, remove oracdc state file and pending transaction files and test this fix.

Regards, Aleksei

sonnguyen-dba commented 3 years ago

Thanks Aleksei, I'm retesting. Have a nice weekend! Regards, Son