opensearch-project / data-prepper

Data Prepper is a component of the OpenSearch project that accepts, filters, transforms, enriches, and routes data at scale.
https://opensearch.org/docs/latest/clients/data-prepper/index/
Apache License 2.0
258 stars 188 forks source link

[BUG] all parsed field with pattern COMMONAPACHELOG are string #3918

Open anasoid opened 8 months ago

anasoid commented 8 months ago

Describe the bug A clear and concise description of what the bug is.

To Reproduce I follow example from https://github.com/opensearch-project/data-prepper/tree/main/examples/log-ingestion

and all field are parsed as string expected date as number

Expected behavior date should be parsed as timestamp, and size ans number ...

Screenshots

image

image

Environment (please complete the following information):

dlvenable commented 8 months ago

@anasoid , Please use the COMMONAPACHELOG_DATATYPED grok pattern. It has predefined types for each.

anasoid commented 8 months ago

Thanks @dlvenable

Now with (COMMONAPACHELOG_DATATYPED) I have timestamp as number so i can't use it as date filter on discovery

image