Good news is that the changes seem to work addressing the issue. It seems related to accumulating data when using oidc for a relogin and continue. Kicking off another build to verify but since all the buckets failed the same way last time I'm confident about this fix

isaacrivriv commented 1 week ago

!build

spawn.fullfat.buckets=com.ibm.ws.grpc_fat

LibbyBot commented 1 week ago

Your personal pipeline request is at https://libh-proxy1.fyre.ibm.com/cognitive/pipelineAnalysis.html?uuid=5ca0082d-326a-4720-83d2-9e6d8b9b44db

Target locations of links might be accessible only to IBM employees.

LibbyBot commented 1 week ago

Your personal pipeline request is at https://libh-proxy1.fyre.ibm.com/cognitive/pipelineAnalysis.html?uuid=2b28f78e-809d-430a-9e25-6e83fcb675a8

Target locations of links might be accessible only to IBM employees.

LibbyBot commented 1 week ago

https://libh-proxy1.fyre.ibm.com/cognitive/pipelineAnalysis.html?uuid=5ca0082d-326a-4720-83d2-9e6d8b9b44db has errors/failures.

LibbyBot commented 1 week ago

https://libh-proxy1.fyre.ibm.com/cognitive/pipelineAnalysis.html?uuid=fda47d19-9be3-4555-a073-d5d875d66c4b has errors/failures.

LibbyBot commented 1 week ago

https://libh-proxy1.fyre.ibm.com/cognitive/pipelineAnalysis.html?uuid=2b28f78e-809d-430a-9e25-6e83fcb675a8 completed.

fritze2 commented 5 days ago

Would this also address the timeouts in the other two buckets we've seen? I'll run a pipeline to find out tomorrow. !build

spawn.fullfat.buckets=com.ibm.ws.grpc_fat,io.openliberty.springboot.fat30_fat,com.ibm.ws.springboot.fat20_fat

LibbyBot commented 5 days ago

Your personal pipeline request is at https://libh-proxy1.fyre.ibm.com/cognitive/pipelineAnalysis.html?uuid=a00f08d7-c261-4161-a4c7-077f9b8a91f6

Target locations of links might be accessible only to IBM employees.

LibbyBot commented 5 days ago

Your personal pipeline request is at https://libh-proxy1.fyre.ibm.com/cognitive/pipelineAnalysis.html?uuid=ecc9d532-4856-4d73-992b-b52dcf0511f6

Target locations of links might be accessible only to IBM employees.

isaacrivriv commented 5 days ago

Thanks @fritze2! We're working on a review this week with the GRPC experts. Hoping to get this merged in ASAP!

As for the other timeouts, I'm not sure. I haven't looked into the other defects associated with those buckets. This fix is very GRPC specific, so I would not think the springboot buckets use the feature and therefore would probably not be affected by this change.

fritze2 commented 4 days ago

The pipeline confirmed it has no change in the springboot buckets, and I've found the pause in those buckets that leads to a timeout is tracing to java.nio.channels.Selector, so I will try updating to the latest JDK in hopes a bug was patched, and if that doesn't help, then I'll open a defect that we can get help from the springboot devs on.

LibbyBot commented 4 days ago

https://libh-proxy1.fyre.ibm.com/cognitive/pipelineAnalysis.html?uuid=ecc9d532-4856-4d73-992b-b52dcf0511f6 has errors/failures.

LibbyBot commented 3 days ago

https://libh-proxy1.fyre.ibm.com/cognitive/pipelineAnalysis.html?uuid=a00f08d7-c261-4161-a4c7-077f9b8a91f6 has errors/failures.

isaacrivriv commented 3 days ago

!build