snowplow / enrich

Snowplow Enrichment jobs and library
https://snowplowanalytics.com
Other
21 stars 39 forks source link

Issue when updating to snowplow-enrich-kinesis-4.0.0.jar #861

Closed vishalrv1904 closed 9 months ago

vishalrv1904 commented 9 months ago

We are facing the below error while updating the Jar version to 4.0.0.Jar, The Previously actively working jar was snowplow-enrich-kinesis-3.9.0.jar. The same hocon file worked for the previous jar version.

Error:

[io-compute-1] ERROR com.snowplowanalytics.snowplow.enrich.common.fs2.Run - CLI arguments are valid but some of the configuration is not correct. Error: Cannot parse file enricher.config.hocon: application.conf @ jar:file:/usr/app/snowplow-enrich-kinesis-4.0.0.jar!/application.conf: 107: Document has trailing tokens after first object or array: '{' 

enricher.config.hocon

{
  "license": {
    "accept": true
  }

  "input": {
    "type": "Kinesis"

    "appName":  "collector-good-event-table"

    "streamName": "collected-good-events-stream"

    "region": "us-east-1"

    "initialPosition": {
      "type": "TRIM_HORIZON"
    }

    "retrievalMode": {
      "type": "Polling"
      "maxRecords": 5000
    }

    "bufferSize": 3

    "checkpointBackoff": {
      "minBackoff": 100 milliseconds
      "maxBackoff": 10 seconds
      "maxRetries": 10
    }
  }

  "output": {
    "good": {

      "type": "Kinesis"

      "streamName": "enriched-good-events-stream"

      "region": "us-east-1"

      "partitionKey": "event_id"

      "backoffPolicy": {
        "minBackoff": 1000 milliseconds
        "maxBackoff": 5000 milliseconds
        "maxRetries": 10
      }

      "throttledBackoffPolicy": {
        "minBackoff": 1000 milliseconds
        "maxBackoff": 5000 milliseconds
      }

      "recordLimit": 10

      "byteLimit": 1000000000

    }
    "bad": {

      "type": "Kinesis"

      "streamName": "enriched-bad-events-stream"

      "region": "us-east-1"

      "backoffPolicy": {
        "minBackoff": 1000 milliseconds
        "maxBackoff": 5000 milliseconds
        "maxRetries": 10
      }

      "throttledBackoffPolicy": {
        "minBackoff": 100 milliseconds
        "maxBackoff": 1 second
      }

      "recordLimit": 10

      "byteLimit": 1000000000
    }
  }
}
miike commented 9 months ago

Hi @vishalrv1904 - as this is a support issue could you please post this on our Discourse forum? Thanks!

https://discourse.snowplow.io/