adoptium / aqa-systemtest

Java load testing and other full system application tests
Apache License 2.0
23 stars 67 forks source link

Propose to add system test for openjdk startup features #470

Open joeyleeeeeee97 opened 2 years ago

joeyleeeeeee97 commented 2 years ago

Summary

Java is(or 'was') not suitable for shot lived applications, and is notorious for slow startup and performance hiccups during warmup. There is some features in openjdk that could speed up startup and reduce memory footprint, I propose we add a system test to ensure these features did improve applications as expected.

Again this test will set a minimal bar for feature's optimization effect rather than benchmarking between different implementations.(The passed/failed is the final result instead of detailed start-up time).

For example we assert AppCDS improves at least 5% for some workload.

What to include now

What is new

Now we have jtreg tests to ensure they are working separately. This system test will add test in aspects as does AppCDS work with JarIndex and some feature did bring improvements in real application

I am trying in https://github.com/joeyleeeeeee97/aqa-systemtest/tree/serverless/openjdk.test.serverless/doc. Looking forward to your feedback.