mozilla-services / heka

DEPRECATED: Data collection and processing made easy.
http://hekad.readthedocs.org/
Other
3.4k stars 531 forks source link

Timestamp problems with heka/influx_batch #1925

Closed jpereira closed 4 years ago

jpereira commented 8 years ago

Hi,

I can't figure out the reason, but sounds like a bug with influx_batch during the process of "Timestamp"

1) I receive the timestamp with milliseconds.

Timestamp: 2016-05-04 14:30:08.669840094 +0000 UTC

2) but, the influx_batch ignore the milliseconds in the serie timestamp.

:Payload: webapps_response_bytes,rule_id=7eGMfyZYlK value=825.000000 1462372207000

Below my influx config set.

[InfluxdbOutput]
  type = "HttpOutput"
  message_matcher = "Fields[payload_name] == 'influx_line'"
  encoder = "PayloadEncoder"
  address = "https://influx-host:8086/write?db=mydb&precision=ms"
  username = "user"
  password = "caipirinha"

[InfluxdbOutput.tls]
    insecure_skip_verify = true

[InfluxdbLineFilter]
  type = "SandboxFilter"
  message_matcher = "Type =~ /.*influx.zen_metrics/"
  filename = "lua_filters/influx_batch.lua"

[InfluxdbLineFilter.config]
  skip_fields = "**all_base** rule_id FilePath NumProcesses Environment TickerInterval Severity Uuid Timestamp"
  tag_fields = "rule_id"
  timestamp_precision= "ms"
  flush_count = 1 

My setup:

# dpkg -l | grep -E "(lua|heka)"
ii  heka                                0.10.0                           amd64        High performance data gathering, analysis, monitoring, and reporting.
ii  liblua5.2-0:amd64                   5.2.3-1                          amd64        Shared library for the Lua interpreter version 5.2
ii  lua5.2                              5.2.3-1                          amd64        Simple, extensible, embeddable programming language
#