elastic / integrations

Elastic Integrations
https://www.elastic.co/integrations
Other
21 stars 435 forks source link

[All integrations] Test ingestion against pre-release ES 8.16 and JDK23 #11454

Open lucabelluccini opened 2 weeks ago

lucabelluccini commented 2 weeks ago

Due to the upcoming breaking change in Elasticsearch https://www.elastic.co/blog/locale-changes-elasticsearch-8-16-jdk-23, we should test all the integrations can run and properly parse the data without issues when the destination is an Elasticsearch cluster 8.16 on JDK 23.

This should be done prior the official release.

FYI @jsoriano / @mrodm

jsoriano commented 2 weeks ago

We have daily builds running all tests with 8.16 and 9.0 and I don't see any issue related to dates https://buildkite.com/elastic/integrations-schedule-daily/

@lucabelluccini do you know of some specific additional test that should be done?

lucabelluccini commented 2 weeks ago

Some ideas might be:

jsoriano commented 2 weeks ago

Do we test we do not have date parsing errors in ingest pipelines and the timestamp is as expected in the original test data?

Yes, we do this kind of testing.

Do we have production-representative data to exercise all the date processors which might be present in the ingest pipelines?

This will depend on the package, there are some packages with better testing coverage than others. An approximation of the current coverage in main branch can be found in https://sonar.elastic.dev/code?id=elastic_integrations_AYu5LCaKQZlFqhqWIrk_&selected=elastic_integrations_AYu5LCaKQZlFqhqWIrk_%3Apackages