elastic / integrations

Elastic Integrations
https://www.elastic.co/integrations
Other
21 stars 436 forks source link

postgresql module does not support timezone other than UTC #6795

Open mussi opened 1 year ago

mussi commented 1 year ago

it is serious ?

filebeat-8.8.1-postgresql-log-pipeline

--- /dev/fd/63  2023-07-01 11:31:36.741676764 -0300
+++ /dev/fd/62  2023-07-01 11:31:36.741676764 -0300
@@ -10,7 +10,7 @@
       "field": "message",
       "pattern_definitions": {
         "CHAR": ".",
-        "DATETIME": "[-0-9]+ %{TIME} %{WORD:event.timezone}",
+        "DATETIME": "%{TIMESTAMP_ISO8601} %{NUMBER:event.timezone}",
         "GREEDYDATA": "(.|\n|\t)*"
       },
       "patterns": [
@@ -35,7 +35,9 @@
       "field": "postgresql.log.timestamp",
       "formats": [
         "yyyy-MM-dd HH:mm:ss.SSS zz",
-        "yyyy-MM-dd HH:mm:ss zz"
+        "yyyy-MM-dd HH:mm:ss zz",
+        "yyyy-MM-dd HH:mm:ss.SSS X",
+        "yyyy-MM-dd HH:mm:ss X"
       ],
       "target_field": "@timestamp"
     }

and same in csv pipeline (date processor only)

its solve for me. tz = -03

botelastic[bot] commented 3 months ago

Hi! We just realized that we haven't looked into this issue in a while. We're sorry! We're labeling this issue as Stale to make it hit our filters and make sure we get back to it as soon as possible. In the meantime, it'd be extremely helpful if you could take a look at it as well and confirm its relevance. A simple comment with a nice emoji will be enough :+1. Thank you for your contribution!