Logs do not pass through probabilistic sampling processor

[aduncan314]

Component(s)

processor/probabilisticsampler

What happened?

Description

No matter how much I simplify the configuration, I cannot get any logs to pass through the probabilisitic sampler even when sampling_percentage is set to 100.

Even if I'm making a mistake configuring the attributes, I would expect a percentage of 100 to pass every log.

Steps to Reproduce

Run the otel docker image (I tried with latest, 0.103.1, and 0.102.1) using this script with the simplified config shown below

#!/bin/zsh

CONFIG_PATH=./config.yaml

if [[ ! -f $CONFIG_PATH ]];then
  echo No file found at $CONFIG_PATH
fi

docker run \
  -v $CONFIG_PATH:/etc/otelcol-contrib/config.yaml \
  -p 127.0.0.1:4317:4317 \
  -p 127.0.0.1:55679:55679 \
  otel/opentelemetry-collector-contrib:latest \
  2>&1 | tee collector-output.txt

and send logs or traces using telemetrygen, e.g.

telemetrygen logs --oltp-insecure --logs 10

Our real config is obviously more complex, but I kept cutting it down until it was a minimal config in order to test this. I tried setting different values for from_attribute with no change in behavior.

Expected Result

Some logs should be displayed by the debug exporter depending on the sampling_percentage and attribute_source/from_attribute. When sampling_percentage is set to 100, I expect all logs to pass through even if the sampling attribute is constant across all logs.

Actual Result

Sampling works as expected when sending traces with telemetrygen and logs are displayed when the sampler is not in the pipeline.

When the sampler is in the logs pipeline, 0 logs display even when percentage is set to 100

Collector version

0.103.1, latest(0.112.0 I think), and 0.102.1

Environment information

Environment

OS: Mac

running docker images using Rancher.

OpenTelemetry Collector configuration

receivers:
  otlp:
    protocols:
      grpc:
        endpoint: 0.0.0.0:4317

processors:
  probabilistic_sampler:
    sampling_percentage: 100
#    hash_seed: 22
#    attribute_source: record
#    from_attribute: "Timestamp"

exporters:
  debug:
    verbosity: detailed

service:
  pipelines:
    traces:
      receivers: [otlp]
      processors: [probabilistic_sampler]
      exporters: [debug]
    logs:
      receivers: [otlp]
      processors: [probabilistic_sampler]
      exporters: [debug]

Log output

2024-10-31T18:22:40.765Z    info    service@v0.112.0/service.go:135 Setting up own telemetry...
2024-10-31T18:22:40.765Z    info    telemetry/metrics.go:70 Serving metrics {"address": "localhost:8888", "metrics level": "Normal"}
2024-10-31T18:22:40.765Z    info    builders/builders.go:26 Development component. May change in the future.    {"kind": "exporter", "data_type": "traces", "name": "debug"}
2024-10-31T18:22:40.765Z    info    builders/builders.go:26 Development component. May change in the future.    {"kind": "exporter", "data_type": "logs", "name": "debug"}
2024-10-31T18:22:40.766Z    info    service@v0.112.0/service.go:207 Starting otelcol-contrib... {"Version": "0.112.0", "NumCPU": 2}
2024-10-31T18:22:40.766Z    info    extensions/extensions.go:39 Starting extensions...
2024-10-31T18:22:40.766Z    warn    internal@v0.112.0/warning.go:40 Using the 0.0.0.0 address exposes this server to every network interface, which may facilitate Denial of Service attacks.   {"kind": "receiver", "name": "otlp", "data_type": "logs", "documentation": "https://github.com/open-telemetry/opentelemetry-collector/blob/main/docs/security-best-practices.md#safeguards-against-denial-of-service-attacks"}
2024-10-31T18:22:40.766Z    info    otlpreceiver@v0.112.0/otlp.go:112   Starting GRPC server    {"kind": "receiver", "name": "otlp", "data_type": "logs", "endpoint": "0.0.0.0:4317"}
2024-10-31T18:22:40.766Z    info    service@v0.112.0/service.go:230 Everything is ready. Begin running and processing data.

Additional context

No response

[github-actions[bot]]

Pinging code owners:

• processor/probabilisticsampler: @jpkrohling @jmacd

  See Adding Labels via Comments if you do not have permissions to add labels yourself.

[corrosive4354]

You mentioned running OpenTelemetry Collector in Docker, make sure the Docker container can access the required network and ports. Confirm that the port mapping is correct, especially port 4317.

Or I think you can try servbay, which is more professional on Mac and supports more than docker