ClickHouse / clickhouse-odbc

ODBC driver for ClickHouse
https://clickhouse.tech
Apache License 2.0
239 stars 84 forks source link

Incomplete data loaded without errors #440

Open pauliusmiskunas opened 3 months ago

pauliusmiskunas commented 3 months ago

Problem trying to get data to Qlik Sense from Clickhouse through ODBC connector.

When load is finished without error, the number of rows doesn't match the table rows number in database (not all rows are loaded), also getting different number of records each load. (only 75-85% of rows loaded) ODBC version - Release 1.2.1.20220905 ClickHouse - 24.3.2.23 table DDL:

CREATE TABLE db_name.table_name
(
    `id` UInt64,
    `title` Nullable(String),
    `item_price` Nullable(Float64),
    `description` Nullable(String),
    `image_url` Nullable(String),
    `product_url` Nullable(String),
    `manufacturer_code` Nullable(String),
    `article_number` Nullable(String),
    `sale_price` Nullable(Float64),
    `manufacturer` Nullable(String),
    `short_message` Nullable(String),
    `specs` Nullable(String),
    `brand` Nullable(String),
    `categories` Nullable(String),    
    `margin_priority` Nullable(String),
    `eans_values` Nullable(String),
    `updated_at` DateTime
)
ENGINE = MergeTree
PARTITION BY toYYYYMM(updated_at)
ORDER BY id
SETTINGS index_granularity = 8192;

also might be related with #419