search

apla / node-clickhouse

Yandex ClickHouse driver for nodejs
MIT License
216 stars 50 forks source link

Error: Chunk size is too large (version 21.3.2.5 (official build)) #74

Open mathurs opened 3 years ago

mathurs commented 3 years ago

We are using node-clickhouse and creating batches of insert values like

INSERT INTO .... values (), (), ()...

and so on.

After a certain batch size, the database starts to complain with the following error

Error: Chunk size is too large (version 21.3.2.5 (official build)) code: 307, scope: 'DB::Exception:'

While researching more on this problem, I found the following thread

https://github.com/ClickHouse/ClickHouse/issues/21907

which seemed to suggest it could be related to chunk headers. Can submit a script to try and reproduce the issue.

Thanks

paeolo commented 3 years ago

@mathurs I had the same issue but this was fixed recently with https://github.com/ClickHouse/ClickHouse/pull/22322. I don't know exactly when the PR has landed but for sure it is in 21.4.3.21 which is already there if you use the debian repository.