cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
29.97k stars 3.79k forks source link

Very slow container data loading #131877

Open safaci2000 opened 1 hour ago

safaci2000 commented 1 hour ago

Describe the problem

I'm curious to know why the data set I'm loading is so much slower. I'm trying to initialize couchdb using very similar dataset and letting the docker container load the .SQLs.

I'm not sure if this is couchDB issues or some bad choices made in how the docker setup works.

The load time for postgres is: around 12 seconds. The load time for Couch DB is around 1 min and 20 seconds. Give or take.

I'm trying to understand if this is expected, or I'm doing something silly.

To Reproduce

Initialize a docker-compose or docker stack as you like with the data provided here: https://github.com/go-jet/jet-test-data/tree/master/init/cockroach

container parameters: "start-single-node", "--accept-sql-without-tls" tested against the latest release: cockroachdb/cockroach:v23.1.27

Expected behavior

Load time should be relatively comparable to what postgres or mysql is for a similar data set.

load time for Mysql/Maria is around 7-8 seconds, Postgres 12-13 seconds, Couch DB is well at the minute mark. Sqlite is well, local disk IO, so ignoring that.

Excluding all of my own code, and only looking at the docker container data loading, it's still at the minute mark just to load data.

Environment:

Jira issue: CRDB-42732

blathers-crl[bot] commented 1 hour ago

Hi @safaci2000, please add branch-* labels to identify which branch(es) this C-bug affects.

:owl: Hoot! I am a Blathers, a bot for CockroachDB. My owner is dev-inf.

blathers-crl[bot] commented 1 hour ago

Hello, I am Blathers. I am here to help you get the issue triaged.

Hoot - a bug! Though bugs are the bane of my existence, rest assured the wretched thing will get the best of care here.

I was unable to automatically find someone to ping.

If we have not gotten back to your issue within a few business days, you can try the following:

:owl: Hoot! I am a Blathers, a bot for CockroachDB. My owner is dev-inf.