couchbase / kafka-connect-couchbase

Kafka Connect connector for Couchbase Server
https://issues.couchbase.com/projects/KAFKAC
Apache License 2.0
73 stars 72 forks source link

Option to remove "default" collection prefix from the dcp logs #46

Closed yeikel closed 3 weeks ago

yeikel commented 3 weeks ago

While looking at the dcp logs, I noticed the following

{
  "milestone": "COMMITTED_TO_TOPIC",
  "tracingToken": 15204767,
  "context": "[redactedtask-6]",
  "documentId": "_default._default.dDwiWLW9nSVMYx1",
  "recordMetadata": {
    "topic": "redacted-topic",
    "partition": 15,
    "offset": 100378824,
    "timestamp": 1730390347102,
    "serializedKeySize": 17,
    "serializedValueSize": 3210
  }
} 

In particular this part is a bit confusing _default._default. My document ID is dDwiWLW9nSVMYx1 and the collection abstraction is irrelevant to me here as It is the default value

"documentId":"_default._default.dDwiWLW9nSVMYx1","

Is there any value in having that default.default prefix?

dnault commented 3 weeks ago

The inclusion of the scope and collection names is intentional. The full keyspace prefix is valuable when diagnosing issues in deployments that use multiple scopes / collections.