[IBM] - Ingest Pipeline - lowercase data normalizer

elastic / elasticsearch

Free and Open Source, Distributed, RESTful Search Engine

https://www.elastic.co/products/elasticsearch

Other

69.92k stars 24.73k forks source link

[IBM] - Ingest Pipeline - lowercase data normalizer #92476

Open ScottElastic opened 1 year ago

ScottElastic commented 1 year ago

Description

Customer has implemented case normalization in their data ingest pipelines, but was curious why we don't have lowercase fields by default with OOTB ECS integrations. For example: they were having case sensitivity issues with email addresses being passed through in a default integration.

elasticsearchmachine commented 1 year ago

Pinging @elastic/es-data-management (Team:Data Management)

dakrone commented 1 year ago

@ScottElastic when you say "OOTB ECS integrations", are you talking about our default logs-*-*, metrics-*-*, and synthetics-*-* templates? Those included templates don't have any email addresses that I can see. If you're talking about agent integrations, you'll probably need to open an issue at https://github.com/elastic/integrations/ instead.