Failed to get partition key

prandelicious commented 5 years ago

Can someone help me how to fix this error message?

2019-02-13T05:13:34.287Z        DEBUG   [kinesis]       streams/client.go:114   failed to map event({{2019-02-13 05:13:30.925710489 +0000 UTC m=+0.052119993 null {"beat":{"hostname":"ip-xxxxxx.ec2.internal","name":"ip-xxxxxx.ec2.internal","version":"6.5.4"},"host":{"name":"ip-xxxxxx.ec2.internal"},"message":"Feb 10 03:47:01 ip-xxxxxx systemd: Removed slice User Slice of root.","meta":{"cloud":{"availability_zone":"us-east-1e","instance_id":"i-xxxxxxx","machine_type":"t2.large","provider":"ec2","region":"us-east-1"}},"offset":1215,"source":"/var/log/messages"} { false 0xc000337e10 /var/log/messages 1291 2019-02-13 05:13:30.923972221 +0000 UTC m=+0.050381713 -1ns log map[] 4321741-51713}} 1}): failed to get parititon key: failed to get parition key: key not found

Here's my configuration file:

`filebeat.prospectors:
  - input_type: log
    paths:
    - /var/log/messages
    document_type: syslog

processors:
- add_cloud_metadata:

output:
  streams:
    region: us-east-1
    stream_name: system-log-stream
    partition_key: testing1

queue.mem:
  events: 4096
  flush.min_events: 5
  flush.timeout: 3s

abdalians commented 4 years ago

I am getting the same thing, any help would be appreciated.

abdalians commented 4 years ago

solved here https://github.com/s12v/awsbeats/issues/50#issuecomment-675690766

s12v / awsbeats

Failed to get partition key #56