search

timeplus-io / sling-cli

Sling is a CLI tool that extracts data from a source storage/database and loads it in a target storage/database.
https://docs.slingdata.io
GNU General Public License v3.0
1 stars 0 forks source link

failed to convert date types when copy date to tmp table #30

Closed shirley-gu-timeplus closed 1 month ago

shirley-gu-timeplus commented 1 month ago

Issue Description

source: DAILY_TIMEPLUS
target: HISTORICAL_TIMEPLUS

defaults:
  mode: incremental

streams:
  rtdc_exchange_order:
    update_key: _tp_time
    object: gj_rtdc_exchange_order
  rtdc_execution:
    update_key: _tp_time
    object: gj_rtdc_execution
  rtdc_position:
    update_key: _tp_time
    object: gj_rtdc_position
  rtdc_fund:
    update_key: _tp_time
    object: gj_rtdc_fund
  t_metrics:
    update_key: _tp_time
    object: gj_metrics
../sling run -r daily_to_his.yaml --streams t_metrics

~ failure running replication (see docs @ https://docs.slingdata.io/sling-cli)
--------------------------- t_metrics ---------------------------

~ could not copy data after retries
after 4 attempts, last error: ~ could not prepare statement for table: `default`.`gj_metrics_tmp`, statement: insert into `default`.`gj_metrics_tmp` (`event_ts`, `metric`, `value`, `metric_date`, `metric_time`, `metric_datetime`, `tagk1`, `tagv1`, `tagk2`, `tagv2`, `tagk3`, `tagv3`, `tagk4`, `tagv4`, `tagk5`, `tagv5`, `_tp_time`)  settings idempotent_id='3_batch_20241018201726' values ($1, $2, $3, $4, $5, $6, $7, $8, $9, $10, $11, $12, $13, $14, $15, $16, $17)
context canceled

~ could not insert into `default`.`gj_metrics_tmp`.
~ could not insert into table `default`.`gj_metrics_tmp`, row: []interface {}{1729227601517, "strategies", "s_80,s_38,s_99,s_85,s_5,s_91,s_67,s_44,s_77,s_84,s_28,s_46,s_39,s_12,s_15,s_26,s_60,s_43,s_3,s_50,s_19,s_33,s_37,s_51,s_49,s_40,s_57,s_10,s_97,s_83,s_16,s_87,s_86,s_42,s_82,s_34,s_24,s_17,s_74,s_14,s_90,s_71,s_72,s_31,s_55,s_9,s_78,s_13,s_68,s_29,s_81,s_45,s_64,s_79,s_54,s_96,s_63,s_21,s_20,s_35,s_48,s_70,s_2,s_8,s_89,s_73,s_58,s_94,s_22,s_52,s_11,s_32,s_41,s_75,s_7,s_1,s_25,s_61,s_95,s_4,s_53,s_6,s_59,s_100,s_76,s_66,s_88,s_65,s_56,s_92,s_93,s_62,s_98,s_27,s_30,s_69,s_23,s_36,s_18,s_47", 20241018, 50000009, 20241018050000009, "account", "ex_product_1031,ex_asset_31,ex_trade_62000", "strategy", "s_80,s_38,s_99,s_85,s_5,s_91,s_67,s_44,s_77,s_84,s_28,s_46,s_39,s_12,s_15,s_26,s_60,s_43,s_3,s_50,s_19,s_33,s_37,s_51,s_49,s_40,s_57,s_10,s_97,s_83,s_16,s_87,s_86,s_42,s_82,s_34,s_24,s_17,s_74,s_14,s_90,s_71,s_72,s_31,s_55,s_9,s_78,s_13,s_68,s_29,s_81,s_45,s_64,s_79,s_54,s_96,s_63,s_21,s_20,s_35,s_48,s_70,s_2,s_8,s_89,s_73,s_58,s_94,s_22,s_52,s_11,s_32,s_41,s_75,s_7,s_1,s_25,s_61,s_95,s_4,s_53,s_6,s_59,s_100,s_76,s_66,s_88,s_65,s_56,s_92,s_93,s_62,s_98,s_27,s_30,s_69,s_23,s_36,s_18,s_47", "", "", "", "", "", interface {}(nil), time.Date(2024, time.October, 18, 5, 0, 0, 9000000, time.Location("+00"))}
proton [AppendRow]: value proton [AppendRow]: converting string to decimal(38, 18) is unsupported

~ error during iteration
~ could not insert into table `default`.`gj_metrics_tmp`, row: []interface {}{1729227601517, "strategies", "s_80,s_38,s_99,s_85,s_5,s_91,s_67,s_44,s_77,s_84,s_28,s_46,s_39,s_12,s_15,s_26,s_60,s_43,s_3,s_50,s_19,s_33,s_37,s_51,s_49,s_40,s_57,s_10,s_97,s_83,s_16,s_87,s_86,s_42,s_82,s_34,s_24,s_17,s_74,s_14,s_90,s_71,s_72,s_31,s_55,s_9,s_78,s_13,s_68,s_29,s_81,s_45,s_64,s_79,s_54,s_96,s_63,s_21,s_20,s_35,s_48,s_70,s_2,s_8,s_89,s_73,s_58,s_94,s_22,s_52,s_11,s_32,s_41,s_75,s_7,s_1,s_25,s_61,s_95,s_4,s_53,s_6,s_59,s_100,s_76,s_66,s_88,s_65,s_56,s_92,s_93,s_62,s_98,s_27,s_30,s_69,s_23,s_36,s_18,s_47", 20241018, 50000009, 20241018050000009, "account", "ex_product_1031,ex_asset_31,ex_trade_62000", "strategy", "s_80,s_38,s_99,s_85,s_5,s_91,s_67,s_44,s_77,s_84,s_28,s_46,s_39,s_12,s_15,s_26,s_60,s_43,s_3,s_50,s_19,s_33,s_37,s_51,s_49,s_40,s_57,s_10,s_97,s_83,s_16,s_87,s_86,s_42,s_82,s_34,s_24,s_17,s_74,s_14,s_90,s_71,s_72,s_31,s_55,s_9,s_78,s_13,s_68,s_29,s_81,s_45,s_64,s_79,s_54,s_96,s_63,s_21,s_20,s_35,s_48,s_70,s_2,s_8,s_89,s_73,s_58,s_94,s_22,s_52,s_11,s_32,s_41,s_75,s_7,s_1,s_25,s_61,s_95,s_4,s_53,s_6,s_59,s_100,s_76,s_66,s_88,s_65,s_56,s_92,s_93,s_62,s_98,s_27,s_30,s_69,s_23,s_36,s_18,s_47", "", "", "", "", "", interface {}(nil), time.Date(2024, time.October, 18, 5, 0, 0, 9000000, time.Location("+00"))}
proton [AppendRow]: value proton [AppendRow]: converting string to decimal(38, 18) is unsupported

~ could not copy data after retries
after 4 attempts, last error: ~ could not prepare statement for table: `default`.`gj_metrics_tmp`, statement: insert into `default`.`gj_metrics_tmp` (`event_ts`, `metric`, `value`, `metric_date`, `metric_time`, `metric_datetime`, `tagk1`, `tagv1`, `tagk2`, `tagv2`, `tagk3`, `tagv3`, `tagk4`, `tagv4`, `tagk5`, `tagv5`, `_tp_time`)  settings idempotent_id='3_batch_20241018201726' values ($1, $2, $3, $4, $5, $6, $7, $8, $9, $10, $11, $12, $13, $14, $15, $16, $17)
context canceled

1018_sling_output.log.log