otel-collector parsing error in latest docker image

[samuelesabella]

Hi, first of all thank you for your great work!

Bug description

When deploying Signoz with docker-compose, using the latest image tags causes otel-collector to fail when parsing the configuration file. I'm using the latest image's version for all the services listed in docker-compose.yaml and I am deploying with:

docker-compose -f deploy/docker/clickhouse-setup/docker-compose.yaml up

I get the following error:

otel-collector_1          | Error: failed to get config: cannot unmarshal the configuration: error reading top level configuration sections: 1 error(s) decoding:
otel-collector_1          | 
otel-collector_1          | * error decoding 'exporters': error reading exporters configuration for "clickhousetraces": 1 error(s) decoding:
otel-collector_1          | 
otel-collector_1          | * '' has invalid keys: low_cardinal_exception_grouping
otel-collector_1          | 2023/03/24 09:21:16 application run finished with error: failed to get config: cannot unmarshal the configuration: error reading top level configuration sections: 1 error(s) decoding:
otel-collector_1          | 
otel-collector_1          | * error decoding 'exporters': error reading exporters configuration for "clickhousetraces": 1 error(s) decoding:
otel-collector_1          | 
otel-collector_1          | * '' has invalid keys: low_cardinal_exception_grouping

I've tried to comment out all the lines in otel-collector-config.yaml which cause the issue (L121, L122, L135), but I still get the following error:

otel-collector_1          | 2023-03-24T09:22:53.619Z    info    service/telemetry.go:140    Serving Prometheus metrics  {"address": "0.0.0.0:8888", "level": "basic"}
otel-collector_1          | 2023-03-24T09:22:53.619Z    info    components/components.go:30 Stability level of component is undefined   {"kind": "exporter", "data_type": "metrics", "name": "clickhousemetricswrite", "stability": "undefined"}
otel-collector_1          | time="2023-03-24T09:22:53Z" level=info msg="Executing:\nCREATE DATABASE IF NOT EXISTS signoz_metrics\n" component=clickhouse
otel-collector_1          | time="2023-03-24T09:22:53Z" level=info msg="Executing:\nCREATE TABLE IF NOT EXISTS signoz_metrics.samples_v2 (\n\t\t\tmetric_name LowCardinality(String),\n\t\t\tfingerprint UInt64 Codec(DoubleDelta, LZ4),\n\t\t\ttimestamp_ms Int64 Codec(DoubleDelta, LZ4),\n\t\t\tvalue Float64 Codec(Gorilla, LZ4)\n\t\t)\n\t\tENGINE = MergeTree\n\t\t\tPARTITION BY toDate(timestamp_ms / 1000)\n\t\t\tORDER BY (metric_name, fingerprint, timestamp_ms)\n" component=clickhouse
otel-collector_1          | time="2023-03-24T09:22:53Z" level=info msg="Executing:\nSET allow_experimental_object_type = 1\n" component=clickhouse
otel-collector_1          | time="2023-03-24T09:22:53Z" level=info msg="Executing:\nCREATE TABLE IF NOT EXISTS signoz_metrics.time_series_v2 (\n\t\t\tmetric_name LowCardinality(String),\n\t\t\tfingerprint UInt64 Codec(DoubleDelta, LZ4),\n\t\t\ttimestamp_ms Int64 Codec(DoubleDelta, LZ4),\n\t\t\tlabels String Codec(ZSTD(5)),\n\t\t\tlabels_object JSON DEFAULT labels CODEC(ZSTD(5))\n\t\t)\n\t\tENGINE = ReplacingMergeTree\n\t\t\tPARTITION BY toDate(timestamp_ms / 1000)\n\t\t\tORDER BY (metric_name, fingerprint)\n" component=clickhouse
otel-collector_1          | 2023-03-24T09:22:53.622Z    info    components/components.go:30 Stability level of component is undefined   {"kind": "exporter", "data_type": "metrics", "name": "clickhousemetricswrite/prometheus", "stability": "undefined"}
otel-collector_1          | time="2023-03-24T09:22:53Z" level=info msg="Executing:\nCREATE DATABASE IF NOT EXISTS signoz_metrics\n" component=clickhouse
otel-collector_1          | time="2023-03-24T09:22:53Z" level=info msg="Executing:\nCREATE TABLE IF NOT EXISTS signoz_metrics.samples_v2 (\n\t\t\tmetric_name LowCardinality(String),\n\t\t\tfingerprint UInt64 Codec(DoubleDelta, LZ4),\n\t\t\ttimestamp_ms Int64 Codec(DoubleDelta, LZ4),\n\t\t\tvalue Float64 Codec(Gorilla, LZ4)\n\t\t)\n\t\tENGINE = MergeTree\n\t\t\tPARTITION BY toDate(timestamp_ms / 1000)\n\t\t\tORDER BY (metric_name, fingerprint, timestamp_ms)\n" component=clickhouse
otel-collector_1          | time="2023-03-24T09:22:53Z" level=info msg="Executing:\nSET allow_experimental_object_type = 1\n" component=clickhouse
otel-collector_1          | time="2023-03-24T09:22:53Z" level=info msg="Executing:\nCREATE TABLE IF NOT EXISTS signoz_metrics.time_series_v2 (\n\t\t\tmetric_name LowCardinality(String),\n\t\t\tfingerprint UInt64 Codec(DoubleDelta, LZ4),\n\t\t\ttimestamp_ms Int64 Codec(DoubleDelta, LZ4),\n\t\t\tlabels String Codec(ZSTD(5)),\n\t\t\tlabels_object JSON DEFAULT labels CODEC(ZSTD(5))\n\t\t)\n\t\tENGINE = ReplacingMergeTree\n\t\t\tPARTITION BY toDate(timestamp_ms / 1000)\n\t\t\tORDER BY (metric_name, fingerprint)\n" component=clickhouse
otel-collector_1          | 2023-03-24T09:22:53.625Z    info    clickhouselogsexporter/exporter.go:247  Running migrations from path:   {"kind": "exporter", "data_type": "logs", "name": "clickhouselogsexporter", "test": "/logsmigrations"}
otel-collector_1          | Error: cannot build pipelines: failed to create "clickhouselogsexporter" exporter, in pipeline "logs": cannot configure clickhouse logs exporter: clickhouse Migrate failed to run, error: no migration found for version 5: read down for version 5 .: file does not exist
otel-collector_1          | 2023/03/24 09:22:53 application run finished with error: cannot build pipelines: failed to create "clickhouselogsexporter" exporter, in pipeline "logs": cannot configure clickhouse logs exporter: clickhouse Migrate failed to run, error: no migration found for version 5: read down for version 5 .: file does not exist
clickhouse-setup_otel-collector_1 exited with code 1

Version information

• Signoz version: da79f934957ff7a608d173805a395fc933f389c3
• Your OS and version: Ubuntu 20.04.2 LTS

[welcome[bot]]

Thanks for opening this issue. A team member should give feedback soon. In the meantime, feel free to check out the contributing guidelines.

[srikanthccv]

The version set in the config file is the latest version. I guess we haven't updated the latest tag in six months. Please use the versions that come with the current config.