Import from CSV not getting all rows

dbeaver / dbeaver

Free universal database tool and SQL client

https://dbeaver.io

Apache License 2.0

39.29k stars 3.4k forks source link

Import from CSV not getting all rows #35386

Open SeppBerkner opened 2 weeks ago

SeppBerkner commented 2 weeks ago

Description

Similar to #14227 I have a CSV with 30354 entries. When uploading it to my Postgres database using DBeaver only 15781 entries are uploaded. And it is always the same amount for every run I try.

DBeaver Version

Community Edition 24.1.0

Operating System

macOS Ventura 13.6.1

Database and driver

PostgreSQL 12.5 PostgreSQL JDBC Driver

Steps to reproduce

Same as in #14227

Additional context

Same as in #14227

E1izabeth commented 2 weeks ago

SeppBerkner commented 2 weeks ago

Strangely, a second CSV with more entries (40942) is uploaded correctly. So whether it has to do with the CSV itself or there is a specific range of rows that causes this issue. The process planer also just considers the 15781 rows and stop there (even though I set the batch limit to 50000).

grafik

Also, in contrast to other CSV files where the newly created table is opened in the UI when the process is finished, this is not the case for the problematic CSV

Destrolaric commented 2 weeks ago

Hi, if possible, could you provide a similar example of row 15782 data.