search

wso2 / product-is

Welcome to the WSO2 Identity Server source code! For info on working with the WSO2 Identity Server repository and contributing code, click the link below.
http://wso2.github.io/
Apache License 2.0
748 stars 729 forks source link

Intermittent test failure in SAMLQueryProfileTestCase #21614

Open pamodaaw opened 2 weeks ago

pamodaaw commented 2 weeks ago

Describe the issue: An intermittent test failure in SAMLQueryProfileTestCase was identified in the recent dependency updater build. It was observed in a previous jenkins build as well

[ERROR] testSAMLAssertionIDRequest(org.wso2.identity.integration.test.saml.SAMLQueryProfileTestCase)  Time elapsed: 4.06 s  <<< FAILURE!
java.lang.OutOfMemoryError: Java heap space
    at org.wso2.identity.integration.test.saml.SAMLQueryProfileTestCase.testSAMLAssertionIDRequest(SAMLQueryProfileTestCase.java:263)

[INFO] 
[INFO] Results:
[INFO] 
[ERROR] Failures: 
[ERROR] org.wso2.identity.integration.test.saml.SAMLQueryProfileTestCase.testSAMLAssertionIDRequest(org.wso2.identity.integration.test.saml.SAMLQueryProfileTestCase)
[INFO]   Run 1: PASS
[ERROR]   Run 2: SAMLQueryProfileTestCase.testSAMLAssertionIDRequest:263 » OutOfMemory Java hea...
[INFO]   Run 3: PASS
[INFO]   Run 4: PASS
[INFO]   Run 5: PASS
[INFO]   Run 6: PASS
[INFO]   Run 7: PASS
[INFO]   Run 8: PASS
[INFO]
madurangasiriwardena commented 2 weeks ago

Attaching the console log for reference.

INFO  [org.wso2.carbon.automation.engine.testlisteners.TestManagerListener] - =================== Running the test method org.wso2.identity.integration.test.saml.SAMLQueryProfileTestCase.testSAMLAssertionIDRequest ===================
INFO  [org.wso2.identity.integration.test.saml.SAMLQueryProfileTestCase] - RESPONSE <?xml version="1.0" encoding="UTF-8"?><saml2p:Response xmlns:saml2p="urn:oasis:names:tc:SAML:2.0:protocol" Destination="http://localhost:8490/travelocity.com-saml-tenantwithoutsigning/home.jsp" ID="_a4c453b96cd4102ec6bd795b85dcf3fb" InResponseTo="fcjkpbodkkkahokgfndedchmokodlmioegifpeed" IssueInstant="2024-11-01T22:41:14.117Z" Version="2.0"><saml2:Issuer xmlns:saml2="urn:oasis:names:tc:SAML:2.0:assertion" Format="urn:oasis:names:tc:SAML:2.0:nameid-format:entity">localhost/t/wso2.com</saml2:Issuer><saml2p:Status><saml2p:StatusCode Value="urn:oasis:names:tc:SAML:2.0:status:Success"/></saml2p:Status><saml2:Assertion xmlns:saml2="urn:oasis:names:tc:SAML:2.0:assertion" ID="_7111d77210bf8b86884ac6010366b3ea" IssueInstant="2024-11-01T22:41:14.128Z" Version="2.0"><saml2:Issuer Format="urn:oasis:names:tc:SAML:2.0:nameid-format:entity">localhost/t/wso2.com</saml2:Issuer><ds:Signature xmlns:ds="http://www.w3.org/2000/09/xmldsig#"><ds:SignedInfo><ds:CanonicalizationMethod Algorithm="http://www.w3.org/2001/10/xml-exc-c14n#"/><ds:SignatureMethod Algorithm="http://www.w3.org/2001/04/xmldsig-more#rsa-sha256"/><ds:Reference URI="#_7111d77210bf8b86884ac6010366b3ea"><ds:Transforms><ds:Transform Algorithm="http://www.w3.org/2000/09/xmldsig#enveloped-signature"/><ds:Transform Algorithm="http://www.w3.org/2001/10/xml-exc-c14n#"/></ds:Transforms><ds:DigestMethod Algorithm="http://www.w3.org/2000/09/xmldsig#sha1"/><ds:DigestValue>IftCZLTCORHb0g9qp+AMI2TDJGs=</ds:DigestValue></ds:Reference></ds:SignedInfo><ds:SignatureValue>H2Qi2H+eAETJiCtbnOxkvDH4UlDGS4vmEAl4htKUrakYDXaJgK6iD5BYot2bm8pw9yBkWt5R9UAhabN3L+CnEsQm1DXtWBenTcRY0bzlcp1eYKxQOnCY+/F+1+BMFvIdlhCD0T+hwb+rzFeqT5M4wlp5IbaBRoJZa2QIJR0FHhxXuIqZjKwCS5mucHXP0dGXoT6ikXdzFW4Bqo9LFpMJVa38dzTRBrYy2ToUEFuaUGoGsHdnO0Ayysg1MG2WX1ANqQq64GW+qJzW/HQLxRSTQY1izcMmr9P0wNHJobjsWawlPeapOIVg5SNrFU8pLAsnE5QNrcA5ovZNf7aw3Or5Ag==</ds:SignatureValue><ds:KeyInfo><ds:X509Data><ds:X509Certificate>MIIDGjCCAgKgAwIBAgIELq7wPDANBgkqhkiG9w0BAQsFADBPMREwDwYDVQQDDAh3c28yLmNvbTENMAsGA1UECwwETm9uZTENMAsGA1UECgwETm9uZTENMAsGA1UEBwwETm9uZTENMAsGA1UEBhMETm9uZTAeFw0yNDEwMDIyMTE1MTZaFw0zNDEwMzAyMTE1MTZaME8xETAPBgNVBAMMCHdzbzIuY29tMQ0wCwYDVQQLDAROb25lMQ0wCwYDVQQKDAROb25lMQ0wCwYDVQQHDAROb25lMQ0wCwYDVQQGEwROb25lMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAkGA7E+bXD1fb3udynjpgihJZSrqDjydZNV4zPBWtvgM1jOzCYMA4Qg6Eo6GJBmhS3zUDn/KhK1yGls/+Y+UXLG3ZbGj5lm8fQs9GfTUc9Qodj3pzPgSGQZKaqyuGDIHTEsmcz4uuJXnLbqJRqMCEwtMwVM5X4fL9DsGVd+lViL1cQy7djuQuOBAruP1fV6dJo6ZsXcfLJLqlTR40lBfefRiPYWA8IptXY/qd7HvAnO7dddS/aKW2fUptMOIlH0tS8Tg+X/x1+r+mtaZgIC/cPT7d3ad4MXkPznQmuI9KTsGZq1rRRVZF2UAN4224Ol4KEjIB8Hoeq49BwaeJOzryAQIDAQABMA0GCSqGSIb3DQEBCwUAA4IBAQA/Pq6pEA9fXE+IzjId9TxDTAsQ827/6SOY9eBfhu7aGNE+vk9Hy10CJbVoKNgXEXayONouyIml0cG65Lyx//h4l7P9eJC+O1uI1+qfYVwcsvFDSZtoNByghfzNUVUUmcw2JG8o11SmoGrNQWE8bHq542K4J3wxCOwZI1wuwed5A5erkpu4BBEKriLHcKFAvSkl9VYp/Qa/XYAUKR93bPlemtyqWjIKcBq8WLzWV1+/UVEh4pDq/Yhfa+qyBc05ByR7THJlhovE308fwkIMja618SV+EGHaFIkJ4BefCFkXDhTjBN4VEEF+RjFv672l2shhg5mh1vdK1CgXpkL+Xj6A</ds:X509Certificate></ds:X509Data></ds:KeyInfo></ds:Signature><saml2:Subject><saml2:NameID Format="urn:oasis:names:tc:SAML:1.1:nameid-format:emailAddress">688ead9a-86fc-4a62-a52d-3d0a865f7f3b</saml2:NameID><saml2:SubjectConfirmation Method="urn:oasis:names:tc:SAML:2.0:cm:bearer"><saml2:SubjectConfirmationData InResponseTo="fcjkpbodkkkahokgfndedchmokodlmioegifpeed" NotOnOrAfter="2024-11-01T22:46:14.117Z" Recipient="http://localhost:8490/travelocity.com-saml-tenantwithoutsigning/home.jsp"/></saml2:SubjectConfirmation></saml2:Subject><saml2:Conditions NotBefore="2024-11-01T22:41:14.128Z" NotOnOrAfter="2024-11-01T22:46:14.117Z"><saml2:AudienceRestriction><saml2:Audience>travelocity.com-saml-tenantwithoutsigning</saml2:Audience></saml2:AudienceRestriction></saml2:Conditions><saml2:AuthnStatement AuthnInstant="2024-11-01T22:41:13.974Z" SessionIndex="9b9405dd-d9a0-41f7-92c1-998f7737efd9"><saml2:AuthnContext><saml2:AuthnContextClassRef>urn:oasis:names:tc:SAML:2.0:ac:classes:Password</saml2:AuthnContextClassRef></saml2:AuthnContext></saml2:AuthnStatement></saml2:Assertion></saml2p:Response>
INFO  [org.opensaml.core.config.InitializationService] - Initializing OpenSAML using the Java Services API
Exception in thread "http-bio-8490-AsyncTimeout" java.lang.OutOfMemoryError: Java heap space
ERROR [org.wso2.carbon.automation.engine.testlisteners.TestManagerListener] - java.base/sun.security.util.DerValue.encode(DerValue.java:426)
ERROR [org.wso2.carbon.automation.engine.testlisteners.TestManagerListener] - java.base/sun.security.util.DerValue.toByteArray(DerValue.java:859)
ERROR [org.wso2.carbon.automation.engine.testlisteners.TestManagerListener] - java.base/sun.security.pkcs12.PKCS12KeyStore.engineLoad(PKCS12KeyStore.java:2033)
ERROR [org.wso2.carbon.automation.engine.testlisteners.TestManagerListener] - java.base/sun.security.util.KeyStoreDelegator.engineLoad(KeyStoreDelegator.java:222)
ERROR [org.wso2.carbon.automation.engine.testlisteners.TestManagerListener] - java.base/java.security.KeyStore.load(KeyStore.java:1479)
ERROR [org.wso2.carbon.automation.engine.testlisteners.TestManagerListener] - org.wso2.identity.integration.common.clients.sso.saml.query.ClientSignKeyDataHolder.<init>(ClientSignKeyDataHolder.java:78)
ERROR [org.wso2.carbon.automation.engine.testlisteners.TestManagerListener] - org.wso2.identity.integration.test.saml.SAMLQueryProfileTestCase.testSAMLAssertionIDRequest(SAMLQueryProfileTestCase.java:263)
ERROR [org.wso2.carbon.automation.engine.testlisteners.TestManagerListener] - java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
ERROR [org.wso2.carbon.automation.engine.testlisteners.TestManagerListener] - java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
ERROR [org.wso2.carbon.automation.engine.testlisteners.TestManagerListener] - java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
ERROR [org.wso2.carbon.automation.engine.testlisteners.TestManagerListener] - java.base/java.lang.reflect.Method.invoke(Method.java:566)
ERROR [org.wso2.carbon.automation.engine.testlisteners.TestManagerListener] - org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:80)
ERROR [org.wso2.carbon.automation.engine.testlisteners.TestManagerListener] - org.testng.internal.Invoker.invokeMethod(Invoker.java:673)
ERROR [org.wso2.carbon.automation.engine.testlisteners.TestManagerListener] - org.testng.internal.Invoker.invokeTestMethod(Invoker.java:842)
ERROR [org.wso2.carbon.automation.engine.testlisteners.TestManagerListener] - org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1166)
ERROR [org.wso2.carbon.automation.engine.testlisteners.TestManagerListener] - org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:125)
ERROR [org.wso2.carbon.automation.engine.testlisteners.TestManagerListener] - org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:109)
ERROR [org.wso2.carbon.automation.engine.testlisteners.TestManagerListener] - org.testng.TestRunner.runWorkers(TestRunner.java:1178)
ERROR [org.wso2.carbon.automation.engine.testlisteners.TestManagerListener] - org.testng.TestRunner.privateRun(TestRunner.java:757)
ERROR [org.wso2.carbon.automation.engine.testlisteners.TestManagerListener] - org.testng.TestRunner.run(TestRunner.java:608)
ERROR [org.wso2.carbon.automation.engine.testlisteners.TestManagerListener] - org.testng.SuiteRunner.runTest(SuiteRunner.java:334)
ERROR [org.wso2.carbon.automation.engine.testlisteners.TestManagerListener] - org.testng.SuiteRunner.runSequentially(SuiteRunner.java:329)
ERROR [org.wso2.carbon.automation.engine.testlisteners.TestManagerListener] - org.testng.SuiteRunner.privateRun(SuiteRunner.java:291)
ERROR [org.wso2.carbon.automation.engine.testlisteners.TestManagerListener] - org.testng.SuiteRunner.run(SuiteRunner.java:240)
ERROR [org.wso2.carbon.automation.engine.testlisteners.TestManagerListener] - org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52)
ERROR [org.wso2.carbon.automation.engine.testlisteners.TestManagerListener] - org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86)
ERROR [org.wso2.carbon.automation.engine.testlisteners.TestManagerListener] - org.testng.TestNG.runSuitesSequentially(TestNG.java:1158)
ERROR [org.wso2.carbon.automation.engine.testlisteners.TestManagerListener] - org.testng.TestNG.runSuitesLocally(TestNG.java:1083)
ERROR [org.wso2.carbon.automation.engine.testlisteners.TestManagerListener] - org.testng.TestNG.run(TestNG.java:999)
ERROR [org.wso2.carbon.automation.engine.testlisteners.TestManagerListener] - org.apache.maven.surefire.testng.TestNGExecutor.run(TestNGExecutor.java:283)
ERROR [org.wso2.carbon.automation.engine.testlisteners.TestManagerListener] - org.apache.maven.surefire.testng.TestNGXmlTestSuite.execute(TestNGXmlTestSuite.java:75)
ERROR [org.wso2.carbon.automation.engine.testlisteners.TestManagerListener] - org.apache.maven.surefire.testng.TestNGProvider.invoke(TestNGProvider.java:120)
INFO  [org.wso2.carbon.automation.engine.testlisteners.TestManagerListener] - =================== On test failure org.wso2.identity.integration.test.saml.SAMLQueryProfileTestCase.testSAMLAssertionIDRequest ===================

consoleText.txt

ashanthamara commented 5 days ago

Seems like this is still reproducible. Failing IS builds 5565, 5566, 5567 due to this. https://wso2.org/jenkins/job/products/job/product-is/5567/

madurangasiriwardena commented 2 days ago

https://github.com/wso2/product-is/actions/runs/11930740242 action execution has the respective memory dump.

As a temporary measure, we have increased the surefire plugin memory limit to 1.5GB.