OpenLiberty / open-liberty

Open Liberty is a highly composable, fast to start, dynamic application server runtime environment
https://openliberty.io
Eclipse Public License 2.0
1.14k stars 587 forks source link

Feature Test Summary for supporting Java 22 in Open Liberty #27857

Closed gjwatts closed 5 months ago

gjwatts commented 6 months ago

Test Strategy

This Feature Test Summary is provided for the epic Support Java 22 in Open Liberty to add a new Java 22 specific FAT https://github.com/OpenLiberty/open-liberty/pull/27515 and not to introduce any new or modified Open Liberty functionality.

Normally FAT testing is designed to validate the functionality of a new or changed feature in Open Liberty. Since there is no new OL functionality to test, the associated FAT test is a validation check to make sure we are running on Java 22. To accomplish that, this FAT uses a WAR file for testing that has been compiled at Java 22 using functionality that is specific to Java 22.

The main testing to validate Java 22 is done via our entire suite of Open Liberty and WebSphere Liberty FAT buckets.

List of FAT projects affected

Test strategy

Confidence Level

Collectively as a team you need to assess your confidence in the testing delivered based on the values below. This should be done as a team and not an individual to ensure more eyes are on it and that pressures to deliver quickly are absorbed by the team as a whole.

Please indicate your confidence in the testing (up to and including FAT) delivered with this feature by selecting one of these values:

4 - We have delivered all automated testing we believe is needed for the golden paths of this feature and have good coverage of the error/outlying scenarios. While more testing of the error/outlying scenarios could be added we believe there is minimal risk here and the cost of providing these is considered higher than the benefit they would provide.

gjwatts commented 5 months ago

Team confidence level landed on a 4.

ayoho commented 5 months ago

LGTM 👍