search

jaegertracing / jaeger-clickhouse

Jaeger ClickHouse storage plugin implementation
Apache License 2.0
247 stars 51 forks source link

Add sharding and replication guide #34

Closed pavolloffay closed 3 years ago

pavolloffay commented 3 years ago

Signed-off-by: Pavol Loffay p.loffay@gmail.com

Resolves #28

pavolloffay commented 3 years ago

Some questions: what is the ideal number of shards and replicas? For replicas I assume it is at least 3?

chhetripradeep commented 3 years ago

We run with 3 replica and as we need to expand the cluster we add more shards. One thing to note is clickhouse doesn't have any inbuilt data balancing feature i.e. once a data is written to a node, it will stay there throughout the lifetime of that data unless the operator moves the data manually, so it's good to do capacity planning in the beginning of cluster provisioning.

pavolloffay commented 3 years ago

@EinKrebs regarding the naming of tables. Most of the tutorials that I have seen use table_name_local for local tables and table_name for the distributed tables. if no objections I will rename to follow this schema.

EinKrebs commented 3 years ago

@EinKrebs regarding the naming of tables. Most of the tutorials that I have seen use table_name_local for local tables and table_name for the distributed tables. if no objections I will rename to follow this schema.

No objections, I think it's good