ailog-analytics / wls-analytics

0 stars 0 forks source link

Improve OSB service name parser to correctly extract additional information about the service and/or errors #9

Open Michalski-Piotr opened 8 months ago

Michalski-Piotr commented 8 months ago

Hello,

there is requirement to add additional pattern to parse OSB Service name.

There are entries with servicebus:


IME                        SERVER       COMPONENT  CODE        SERVICE                             ERROR  DETAIL                INDEX
2023-10-08 17:34:36.872000  osb_server2  jca        BEA-000000  servicebus                          -      TRANSACTION_ROLLBACK  zine38
2023-10-08 18:30:42.020000  osb_server2  jca        BEA-000000  servicebus                          -      TRANSACTION_ROLLBACK  wuwa20
2023-10-08 20:23:44.574000  osb_server2  security   WSM-00279   -                                   -      -                     zefo51
2023-10-08 22:18:49.068000  osb_server2  router     OSB-382191  SWICustomerPartyProvABCSLikeImplV1  -      -                     veba20
2023-10-08 22:20:57.708000  osb_server2  router     OSB-382191  SWICustomerPartyProvABCSLikeImplV1  -      -                     zidu80
2023-10-08 22:21:09.676000  osb_server2  router     OSB-382191  SWICustomerPartyProvABCSLikeImplV1  -      -                     wori53
2023-10-08 23:22:37.235000  osb_server6  jca        BEA-000000  servicebus                          -      TRANSACTION_ROLLBACK  vale34
2023-10-08 23:32:28.774000  osb_server6  jca        BEA-000000  servicebus                          -      TRANSACTION_ROLLBACK  voce88
2023-10-08 23:53:35.239000  osb_server2  jca        BEA-000000  servicebus                          -      TRANSACTION_ROLLBACK  wogu24

Below pattern would be useful servicebus:([A-Za-z0-9_\/].*)\/([A-Za-z0-9_].*) in that case to extract the last part of service name:


        - pattern: "servicebus:([A-Za-z0-9_\/].*)\/([A-Za-z0-9_].*) \\[.*Could not invoke operation '([A-Za-z0-9].*)'"
          value: "OSB_SERVICE_ERROR_{2}"

Different patterns I noticed based on the OSB logs I was checking:


        - pattern: "servicebus:([A-Za-z0-9_\/].*)\/([A-Za-z0-9_].*) \\[.*Could not invoke operation '([A-Za-z0-9].*)'"
          value: "OSB_SERVICE_ERROR_{2}"

        - pattern: "<([A-Za-z0-9_\/].*)\/([A-Za-z0-9_].*): Unhandled.*Error parsing XML: {err}([A-Za-z0-9].*):"
          value: "{2}({3})"

This may be also helpful to code different cases.

Regards, Piotr Michalski

tomvit commented 8 months ago

There is a code in the outlog.py the parses the service name as follows:

m = next(re.finditer(r"^\s*<([A-Za-z\/0-9]+)\:", self.payload), None)
if m is not None:
    self.service = m.group(1).split("/")[-1]

This returns always the last part of the path of the service name. I had to hardwire this it in the code directly as it was easier than having an explicit parser in the yaml.

What I understand from the issue is that there are cases where there is additional information after servicebus keyword for which the code currently only returns servicebus in the service column.

Can you paste here examples of such cases with locations to log files where I can find them please?

Michalski-Piotr commented 8 months ago

Hello, kindly find 3 different cases types that are not covered yet:

case 1


[oracle@k8s-registry logs]$ wlsanalytics log index puxi90 --stdout
index_id    : puxi90
log_file    : /u01/oracle/wlsanalytics/data/osb/osb_server8/logs/osb_server8.out38073
index_file  : /u01/oracle/wlsanalytics/data/index/wlsa-soaerrors-806.index

<Oct 24, 2023 9:22:12,684 AM UTC> <Error> <oracle.osb.transports.jca> <BEA-000000> <servicebus:/CommonUtility/FMWErrorManagement/DBAdapter/GetFMWError/GetFMWError.wsdl [ GetFMWError_ptt::GetFMWError(InputParameters,OutputParameters) ] - Could not invoke operation 'GetFMWError' due to:

BINDING.JCA-11811
Stored procedure invocation error.
Error while trying to prepare and execute the NEWCO_CORE.NEWCO_CORE_PKG.SP_GETFMWERRORCODEV1 API.
An error occurred while preparing and executing the NEWCO_CORE.NEWCO_CORE_PKG.SP_GETFMWERRORCODEV1 API. Cause: java.sql.SQLException: ORA-01422: exact fetch returns more than requested number of rows
ORA-06512: at "NEWCO_CORE.NEWCO_CORE_PKG", line 277
ORA-01403: no data found
ORA-06512: at "NEWCO_CORE.NEWCO_CORE_PKG", line 267
ORA-01403: no data found
ORA-06512: at "NEWCO_CORE.NEWCO_CORE_PKG", line 258
ORA-06512: at "NEWCO_CORE.NEWCO_CORE_PKG", line 338
ORA-06512: at line 1

Check to ensure that the API is defined in the database and that the parameters match the signature of the API.  This exception is considered not retriable, likely due to a modelling mistake.  To classify it as retriable instead add property nonRetriableErrorCodes with value "-1422" to your deployment descriptor (i.e. weblogic-ra.xml).  To auto retry a retriable fault set these composite.xml properties for this invoke: jca.retry.interval, jca.retry.count, and jca.retry.backoff.  All properties are integers.

        at oracle.tip.adapter.db.exceptions.DBResourceException.createNonRetriableException(DBResourceException.java:690)
        at oracle.tip.adapter.db.exceptions.DBResourceException.createEISException(DBResourceException.java:656)
        at oracle.tip.adapter.db.sp.SPUtil.createResourceException(SPUtil.java:186)
        at oracle.tip.adapter.db.sp.AbstractStoredProcedure.execute(AbstractStoredProcedure.java:150)
        at oracle.tip.adapter.db.sp.SPInteraction.executeStoredProcedure(SPInteraction.java:155)
        at oracle.tip.adapter.db.DBInteraction.executeStoredProcedure(DBInteraction.java:1355)
        at oracle.tip.adapter.db.DBInteraction.execute(DBInteraction.java:306)
        at oracle.tip.adapter.sa.impl.fw.wsif.jca.WSIFOperation_JCA.performOperation(WSIFOperation_JCA.java:576)
        at oracle.tip.adapter.sa.impl.fw.wsif.jca.WSIFOperation_JCA.executeOperation(WSIFOperation_JCA.java:387)
        at oracle.tip.adapter.sa.impl.fw.wsif.jca.WSIFOperation_JCA.executeRequestResponseOperation(WSIFOperation_JCA.java:346)
        at oracle.tip.adapter.sa.impl.JCABindingReferenceImpl.invokeWsifProvider(JCABindingReferenceImpl.java:418)
        at oracle.tip.adapter.sa.impl.JCABindingReferenceImpl.request(JCABindingReferenceImpl.java:319)
        at com.bea.wli.sb.transports.jca.binding.JCATransportOutboundOperationBindingServiceImpl.invoke(JCATransportOutboundOperationBindingServiceImpl.java:178)
        at com.bea.wli.sb.transports.jca.JCATransportEndpoint.sendRequestResponse(JCATransportEndpoint.java:261)
        at com.bea.wli.sb.transports.jca.JCATransportEndpoint.send(JCATransportEndpoint.java:221)
        at com.bea.wli.sb.transports.jca.JCATransportProvider.sendMessageAsync(JCATransportProvider.java:721)
        at sun.reflect.GeneratedMethodAccessor1349.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.bea.wli.sb.transports.Util$1.invoke(Util.java:80)
        at com.sun.proxy.$Proxy285.sendMessageAsync(Unknown Source)
        at com.bea.wli.sb.transports.TransportManagerImpl.sendMessageToService(TransportManagerImpl.java:487)
        at com.bea.wli.sb.transports.TransportManagerImpl.sendMessageAsync(TransportManagerImpl.java:375)
        at com.bea.wli.sb.service.handlerchain.handlers.TransportProviderInvoker.dispatch(TransportProviderInvoker.java:87)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.EndpointManagementHandler.dispatch(EndpointManagementHandler.java:47)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.UpdateOutboundStatistics.dispatch(UpdateOutboundStatistics.java:65)
        at com.bea.wli.sb.service.handlerchain.handlers.LoadBalanceFailover$LoadBalanceFailoverHelper.sendMessageAsync(LoadBalanceFailover.java:418)
        at com.bea.wli.sb.service.handlerchain.handlers.LoadBalanceFailover$LoadBalanceFailoverHelper.sendMessageToServiceAsync(LoadBalanceFailover.java:339)
        at com.bea.wli.sb.service.handlerchain.handlers.LoadBalanceFailover$LoadBalanceFailoverHelper.sendMessageToService(LoadBalanceFailover.java:282)
        at com.bea.wli.sb.service.handlerchain.handlers.LoadBalanceFailover.dispatch(LoadBalanceFailover.java:164)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.OutboundMessageContentHandler.dispatch(OutboundMessageContentHandler.java:71)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.CheckTxDeadlock.dispatch(CheckTxDeadlock.java:54)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.ResultCachingHandler.dispatch(ResultCachingHandler.java:113)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.SetSoapAction.dispatch(SetSoapAction.java:167)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.OutboundMessagePatternHandler.dispatch(OutboundMessagePatternHandler.java:174)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.DefaultOutboundHandlerChain.dispatch(DefaultOutboundHandlerChain.java:114)
        at com.bea.wli.sb.service.dispatcher.TransportDispatcher.dispatch(TransportDispatcher.java:58)
        at com.bea.wli.sb.context.PipelineDispatcherClient.dispatch(PipelineDispatcherClient.java:216)
        at com.bea.wli.sb.pipeline.PipelineContextImpl.doDispatch(PipelineContextImpl.java:515)
        at com.bea.wli.sb.pipeline.PipelineContextImpl.dispatch(PipelineContextImpl.java:491)
        at stages.routing.runtime.RouteRuntimeStep.processMessage(RouteRuntimeStep.java:186)
        at com.bea.wli.sb.stages.StageMetadataImpl$WrapperRuntimeStep.processMessage(StageMetadataImpl.java:384)
        at com.bea.wli.sb.pipeline.components.RouteNode.doRequest(RouteNode.java:137)
        at com.bea.wli.sb.pipeline.components.Node.processMessage(Node.java:82)
        at com.bea.wli.sb.pipeline.PipelineContextImpl.execute(PipelineContextImpl.java:902)
        at com.bea.wli.sb.pipeline.components.Router.processMessage(Router.java:209)
        at com.bea.wli.sb.pipeline.MessageProcessor.processRequest(MessageProcessor.java:96)
        at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher$1.run(PipelineDispatcher.java:143)
        at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher$1.run(PipelineDispatcher.java:138)
        at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:386)
        at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:163)
        at com.bea.wli.sb.util.security.SecurityUtils.executeAs(SecurityUtils.java:102)
        at com.bea.wli.sb.security.WLSSecurityContextService.executeAs(WLSSecurityContextService.java:55)
        at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher.dispatch(PipelineDispatcher.java:136)
        at com.bea.wli.sb.service.handlerchain.handlers.ServiceInvoker.dispatch(ServiceInvoker.java:163)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.UpdateInboundOperationalStatistics.dispatch(UpdateInboundOperationalStatistics.java:75)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.InboundMessageContentHandler.dispatch(InboundMessageContentHandler.java:170)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.CheckAccessControl.dispatch(CheckAccessControl.java:73)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.UpdateInboundTransportStatistics.dispatch(UpdateInboundTransportStatistics.java:64)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.DefaultInboundErrorHandler.dispatch(DefaultInboundErrorHandler.java:44)
        at com.bea.wli.sb.service.handlerchain.DefaultInboundHandlerChain.dispatch(DefaultInboundHandlerChain.java:135)
        at com.bea.wli.sb.transports.TransportDispatcherClient.dispatch(TransportDispatcherClient.java:96)
        at com.bea.wli.sb.transports.TransportManagerImpl.receiveMessage(TransportManagerImpl.java:330)
        at com.bea.wli.sb.transports.CoLocatedMessageContext$1.run(CoLocatedMessageContext.java:153)
        at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:386)
        at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:163)
        at com.bea.wli.sb.util.security.SecurityUtils.executeAs(SecurityUtils.java:102)
        at com.bea.wli.sb.service.handlerchain.handlers.TransportProviderInvoker$ServiceCredentialCallback.runAsSubject(TransportProviderInvoker.java:290)
        at com.bea.wli.sb.transports.CoLocatedMessageContext.send(CoLocatedMessageContext.java:148)
        at com.bea.wli.sb.transports.http.wls.HttpTransportProvider.sendMessageAsync(HttpTransportProvider.java:251)
        at sun.reflect.GeneratedMethodAccessor1349.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.bea.wli.sb.transports.Util$1.invoke(Util.java:80)
        at com.sun.proxy.$Proxy271.sendMessageAsync(Unknown Source)
        at com.bea.wli.sb.transports.TransportManagerImpl.sendMessageToService(TransportManagerImpl.java:487)
        at com.bea.wli.sb.transports.TransportManagerImpl.sendMessageAsync(TransportManagerImpl.java:375)
        at com.bea.wli.sb.service.handlerchain.handlers.TransportProviderInvoker.dispatch(TransportProviderInvoker.java:87)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.EndpointManagementHandler.dispatch(EndpointManagementHandler.java:47)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.UpdateOutboundStatistics.dispatch(UpdateOutboundStatistics.java:65)
        at com.bea.wli.sb.service.handlerchain.handlers.LoadBalanceFailover$LoadBalanceFailoverHelper.sendMessageAsync(LoadBalanceFailover.java:418)
        at com.bea.wli.sb.service.handlerchain.handlers.LoadBalanceFailover$LoadBalanceFailoverHelper.sendMessageToServiceAsync(LoadBalanceFailover.java:339)
        at com.bea.wli.sb.service.handlerchain.handlers.LoadBalanceFailover$LoadBalanceFailoverHelper.sendMessageToService(LoadBalanceFailover.java:282)
        at com.bea.wli.sb.service.handlerchain.handlers.LoadBalanceFailover.dispatch(LoadBalanceFailover.java:164)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.OutboundMessageContentHandler.dispatch(OutboundMessageContentHandler.java:71)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.CheckTxDeadlock.dispatch(CheckTxDeadlock.java:54)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.OutboundMessagePatternHandler.dispatch(OutboundMessagePatternHandler.java:174)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.DefaultOutboundHandlerChain.dispatch(DefaultOutboundHandlerChain.java:114)
        at com.bea.wli.sb.service.dispatcher.TransportDispatcher.dispatch(TransportDispatcher.java:58)
        at com.bea.wli.sb.context.PipelineDispatcherClient.dispatch(PipelineDispatcherClient.java:216)
        at com.bea.wli.sb.pipeline.PipelineContextImpl.doDispatch(PipelineContextImpl.java:515)
        at com.bea.wli.sb.pipeline.PipelineContextImpl.dispatchSync(PipelineContextImpl.java:455)
        at stages.transform.runtime.WsCalloutRuntimeStep$WsCalloutDispatcher.dispatch(WsCalloutRuntimeStep.java:1445)
        at stages.transform.runtime.WsCalloutRuntimeStep.processMessage(WsCalloutRuntimeStep.java:276)
        at com.bea.wli.sb.stages.StageMetadataImpl$WrapperRuntimeStep.processMessage(StageMetadataImpl.java:384)
        at com.bea.wli.sb.pipeline.components.PipelineStage.processMessage(PipelineStage.java:89)
        at com.bea.wli.sb.pipeline.PipelineContextImpl.execute(PipelineContextImpl.java:902)
        at com.bea.wli.sb.pipeline.components.Pipeline.processMessage(Pipeline.java:158)
        at com.bea.wli.sb.pipeline.PipelineContextImpl.execute(PipelineContextImpl.java:902)
        at com.bea.wli.sb.pipeline.components.PipelineNode.doRequest(PipelineNode.java:64)
        at com.bea.wli.sb.pipeline.components.Node.processMessage(Node.java:82)
        at com.bea.wli.sb.pipeline.PipelineContextImpl.execute(PipelineContextImpl.java:902)
        at com.bea.wli.sb.pipeline.components.Router.processMessage(Router.java:209)
        at com.bea.wli.sb.pipeline.MessageProcessor.processRequest(MessageProcessor.java:96)
        at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher$1.run(PipelineDispatcher.java:143)
        at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher$1.run(PipelineDispatcher.java:138)
        at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:386)
        at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:163)
        at com.bea.wli.sb.util.security.SecurityUtils.executeAs(SecurityUtils.java:102)
        at com.bea.wli.sb.security.WLSSecurityContextService.executeAs(WLSSecurityContextService.java:55)
        at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher.dispatch(PipelineDispatcher.java:136)
        at com.bea.wli.sb.service.handlerchain.handlers.ServiceInvoker.dispatch(ServiceInvoker.java:163)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.UpdateInboundOperationalStatistics.dispatch(UpdateInboundOperationalStatistics.java:75)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.InboundMessageContentHandler.dispatch(InboundMessageContentHandler.java:170)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.CheckAccessControl.dispatch(CheckAccessControl.java:73)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.UpdateInboundTransportStatistics.dispatch(UpdateInboundTransportStatistics.java:64)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.DefaultInboundErrorHandler.dispatch(DefaultInboundErrorHandler.java:44)
        at com.bea.wli.sb.service.handlerchain.DefaultInboundHandlerChain.dispatch(DefaultInboundHandlerChain.java:135)
        at com.bea.wli.sb.transports.TransportDispatcherClient.dispatch(TransportDispatcherClient.java:96)
        at com.bea.wli.sb.transports.TransportManagerImpl.receiveMessage(TransportManagerImpl.java:330)
        at com.bea.wli.sb.transports.CoLocatedMessageContext$1.run(CoLocatedMessageContext.java:153)
        at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:386)
        at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:163)
        at com.bea.wli.sb.util.security.SecurityUtils.executeAs(SecurityUtils.java:102)
        at com.bea.wli.sb.service.handlerchain.handlers.TransportProviderInvoker$ServiceCredentialCallback.runAsSubject(TransportProviderInvoker.java:290)
        at com.bea.wli.sb.transports.CoLocatedMessageContext.send(CoLocatedMessageContext.java:148)
        at com.bea.wli.sb.transports.http.wls.HttpTransportProvider.sendMessageAsync(HttpTransportProvider.java:251)
        at sun.reflect.GeneratedMethodAccessor1349.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.bea.wli.sb.transports.Util$1.invoke(Util.java:80)
        at com.sun.proxy.$Proxy271.sendMessageAsync(Unknown Source)
        at com.bea.wli.sb.transports.TransportManagerImpl.sendMessageToService(TransportManagerImpl.java:487)
        at com.bea.wli.sb.transports.TransportManagerImpl.sendMessageAsync(TransportManagerImpl.java:375)
        at com.bea.wli.sb.service.handlerchain.handlers.TransportProviderInvoker.dispatch(TransportProviderInvoker.java:87)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.EndpointManagementHandler.dispatch(EndpointManagementHandler.java:47)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.UpdateOutboundStatistics.dispatch(UpdateOutboundStatistics.java:65)
        at com.bea.wli.sb.service.handlerchain.handlers.LoadBalanceFailover$LoadBalanceFailoverHelper.sendMessageAsync(LoadBalanceFailover.java:418)
        at com.bea.wli.sb.service.handlerchain.handlers.LoadBalanceFailover$LoadBalanceFailoverHelper.sendMessageToServiceAsync(LoadBalanceFailover.java:339)
        at com.bea.wli.sb.service.handlerchain.handlers.LoadBalanceFailover$LoadBalanceFailoverHelper.sendMessageToService(LoadBalanceFailover.java:282)
        at com.bea.wli.sb.service.handlerchain.handlers.LoadBalanceFailover.dispatch(LoadBalanceFailover.java:164)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.OutboundMessageContentHandler.dispatch(OutboundMessageContentHandler.java:71)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.CheckTxDeadlock.dispatch(CheckTxDeadlock.java:54)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.OutboundMessagePatternHandler.dispatch(OutboundMessagePatternHandler.java:174)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.DefaultOutboundHandlerChain.dispatch(DefaultOutboundHandlerChain.java:114)
        at com.bea.wli.sb.service.dispatcher.TransportDispatcher.dispatch(TransportDispatcher.java:58)
        at com.bea.wli.sb.context.PipelineDispatcherClient.dispatch(PipelineDispatcherClient.java:216)
        at com.bea.wli.sb.pipeline.PipelineContextImpl.doDispatch(PipelineContextImpl.java:515)
        at com.bea.wli.sb.pipeline.PipelineContextImpl.dispatch(PipelineContextImpl.java:491)
        at stages.routing.runtime.RouteRuntimeStep.processMessage(RouteRuntimeStep.java:186)
        at com.bea.wli.sb.stages.StageMetadataImpl$WrapperRuntimeStep.processMessage(StageMetadataImpl.java:384)
        at com.bea.wli.sb.pipeline.components.RouteNode.doRequest(RouteNode.java:137)
        at com.bea.wli.sb.pipeline.components.Node.processMessage(Node.java:82)
        at com.bea.wli.sb.pipeline.PipelineContextImpl.execute(PipelineContextImpl.java:902)
        at com.bea.wli.sb.pipeline.components.Router.processMessage(Router.java:209)
        at com.bea.wli.sb.pipeline.MessageProcessor.processRequest(MessageProcessor.java:96)
        at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher$1.run(PipelineDispatcher.java:143)
        at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher$1.run(PipelineDispatcher.java:138)
        at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:386)
        at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:163)
        at com.bea.wli.sb.util.security.SecurityUtils.executeAs(SecurityUtils.java:102)
        at com.bea.wli.sb.security.WLSSecurityContextService.executeAs(WLSSecurityContextService.java:55)
        at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher.dispatch(PipelineDispatcher.java:136)
        at com.bea.wli.sb.service.handlerchain.handlers.ServiceInvoker.dispatch(ServiceInvoker.java:163)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.UpdateInboundOperationalStatistics.dispatch(UpdateInboundOperationalStatistics.java:75)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.InboundMessageContentHandler.dispatch(InboundMessageContentHandler.java:170)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.CheckAccessControl.dispatch(CheckAccessControl.java:73)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.UpdateInboundTransportStatistics.dispatch(UpdateInboundTransportStatistics.java:64)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.DefaultInboundErrorHandler.dispatch(DefaultInboundErrorHandler.java:44)
        at com.bea.wli.sb.service.handlerchain.DefaultInboundHandlerChain.dispatch(DefaultInboundHandlerChain.java:135)
        at com.bea.wli.sb.transports.TransportDispatcherClient.dispatch(TransportDispatcherClient.java:96)
        at com.bea.wli.sb.transports.TransportManagerImpl.receiveMessage(TransportManagerImpl.java:330)
        at com.bea.wli.sb.transports.CoLocatedMessageContext$1.run(CoLocatedMessageContext.java:153)
        at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:386)
        at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:163)
        at com.bea.wli.sb.util.security.SecurityUtils.executeAs(SecurityUtils.java:102)
        at com.bea.wli.sb.service.handlerchain.handlers.TransportProviderInvoker$ServiceCredentialCallback.runAsSubject(TransportProviderInvoker.java:290)
        at com.bea.wli.sb.transports.CoLocatedMessageContext.send(CoLocatedMessageContext.java:148)
        at com.bea.wli.sb.transports.http.wls.HttpTransportProvider.sendMessageAsync(HttpTransportProvider.java:251)
        at sun.reflect.GeneratedMethodAccessor1349.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.bea.wli.sb.transports.Util$1.invoke(Util.java:80)
        at com.sun.proxy.$Proxy271.sendMessageAsync(Unknown Source)
        at com.bea.wli.sb.transports.TransportManagerImpl.sendMessageToService(TransportManagerImpl.java:487)
        at com.bea.wli.sb.transports.TransportManagerImpl.sendMessageAsync(TransportManagerImpl.java:375)
        at com.bea.wli.sb.service.handlerchain.handlers.TransportProviderInvoker.dispatch(TransportProviderInvoker.java:87)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.EndpointManagementHandler.dispatch(EndpointManagementHandler.java:47)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.UpdateOutboundStatistics.dispatch(UpdateOutboundStatistics.java:65)
        at com.bea.wli.sb.service.handlerchain.handlers.LoadBalanceFailover$LoadBalanceFailoverHelper.sendMessageAsync(LoadBalanceFailover.java:418)
        at com.bea.wli.sb.service.handlerchain.handlers.LoadBalanceFailover$LoadBalanceFailoverHelper.sendMessageToServiceAsync(LoadBalanceFailover.java:339)
        at com.bea.wli.sb.service.handlerchain.handlers.LoadBalanceFailover$LoadBalanceFailoverHelper.sendMessageToService(LoadBalanceFailover.java:282)
        at com.bea.wli.sb.service.handlerchain.handlers.LoadBalanceFailover.dispatch(LoadBalanceFailover.java:164)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.OutboundMessageContentHandler.dispatch(OutboundMessageContentHandler.java:71)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.CheckTxDeadlock.dispatch(CheckTxDeadlock.java:54)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.OutboundMessagePatternHandler.dispatch(OutboundMessagePatternHandler.java:174)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.DefaultOutboundHandlerChain.dispatch(DefaultOutboundHandlerChain.java:114)
        at com.bea.wli.sb.service.dispatcher.TransportDispatcher.dispatch(TransportDispatcher.java:58)
        at com.bea.wli.sb.context.PipelineDispatcherClient.dispatch(PipelineDispatcherClient.java:216)
        at com.bea.wli.sb.pipeline.PipelineContextImpl.doDispatch(PipelineContextImpl.java:515)
        at com.bea.wli.sb.pipeline.PipelineContextImpl.dispatch(PipelineContextImpl.java:491)
        at stages.routing.runtime.RouteRuntimeStep.processMessage(RouteRuntimeStep.java:186)
        at com.bea.wli.sb.stages.StageMetadataImpl$WrapperRuntimeStep.processMessage(StageMetadataImpl.java:384)
        at com.bea.wli.sb.pipeline.components.RouteNode.doRequest(RouteNode.java:137)
        at com.bea.wli.sb.pipeline.components.Node.processMessage(Node.java:82)
        at com.bea.wli.sb.pipeline.PipelineContextImpl.execute(PipelineContextImpl.java:902)
        at com.bea.wli.sb.pipeline.components.Router.processMessage(Router.java:209)
        at com.bea.wli.sb.pipeline.MessageProcessor.processRequest(MessageProcessor.java:96)
        at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher$1.run(PipelineDispatcher.java:143)
        at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher$1.run(PipelineDispatcher.java:138)
        at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:386)
        at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:163)
        at com.bea.wli.sb.util.security.SecurityUtils.executeAs(SecurityUtils.java:102)
        at com.bea.wli.sb.security.WLSSecurityContextService.executeAs(WLSSecurityContextService.java:55)
        at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher.dispatch(PipelineDispatcher.java:136)
        at com.bea.wli.sb.service.handlerchain.handlers.ServiceInvoker.dispatch(ServiceInvoker.java:163)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.UpdateInboundOperationalStatistics.dispatch(UpdateInboundOperationalStatistics.java:75)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.ComputeOperation.dispatch(ComputeOperation.java:110)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.InboundMessageContentHandler.dispatch(InboundMessageContentHandler.java:170)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.CheckAccessControl.dispatch(CheckAccessControl.java:73)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.UpdateInboundTransportStatistics.dispatch(UpdateInboundTransportStatistics.java:64)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.DefaultInboundErrorHandler.dispatch(DefaultInboundErrorHandler.java:44)
        at com.bea.wli.sb.service.handlerchain.DefaultInboundHandlerChain.dispatch(DefaultInboundHandlerChain.java:135)
        at com.bea.wli.sb.transports.TransportDispatcherClient.dispatch(TransportDispatcherClient.java:96)
        at com.bea.wli.sb.transports.TransportManagerImpl.receiveMessage(TransportManagerImpl.java:330)
        at com.bea.wli.sb.transports.http.generic.RequestHelperBase.invokePipeline(RequestHelperBase.java:253)
        at com.bea.wli.sb.transports.http.wls.HttpTransportServlet$RequestHelperWLS.invokePipeline(HttpTransportServlet.java:257)
        at com.bea.wli.sb.transports.http.generic.RequestHelperBase$1.run(RequestHelperBase.java:220)
        at com.bea.wli.sb.transports.http.generic.RequestHelperBase$1.run(RequestHelperBase.java:216)
        at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:386)
        at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:163)
        at com.bea.wli.sb.util.security.SecurityUtils.executeAs(SecurityUtils.java:102)
        at com.bea.wli.sb.transports.http.generic.RequestHelperBase.securedInvoke(RequestHelperBase.java:214)
        at com.bea.wli.sb.transports.http.generic.RequestHelperBase.service(RequestHelperBase.java:142)
        at com.bea.wli.sb.transports.http.wls.HttpTransportServlet.service(HttpTransportServlet.java:150)
        at weblogic.servlet.FutureResponseServlet.service(FutureResponseServlet.java:24)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
        at weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:295)
        at weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:260)
        at weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:137)
        at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:353)
        at weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:25)
        at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:78)
        at com.bea.wli.sb.transports.http.wls.RequestBodyLengthLimitFilter.handleNonChunkedTransfer(RequestBodyLengthLimitFilter.java:137)
        at com.bea.wli.sb.transports.http.wls.RequestBodyLengthLimitFilter.doFilter(RequestBodyLengthLimitFilter.java:123)
        at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:78)
        at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.wrapRun(WebAppServletContext.java:3797)
        at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3763)
        at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:344)
        at weblogic.security.service.SecurityManager.runAsForUserCode(SecurityManager.java:197)
        at weblogic.servlet.provider.WlsSecurityProvider.runAsForUserCode(WlsSecurityProvider.java:203)
        at weblogic.servlet.provider.WlsSubjectHandle.run(WlsSubjectHandle.java:71)
        at weblogic.servlet.internal.WebAppServletContext.doSecuredExecute(WebAppServletContext.java:2451)
        at weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2299)
        at weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:2277)
        at weblogic.servlet.internal.ServletRequestImpl.runInternal(ServletRequestImpl.java:1710)
        at weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1670)
        at weblogic.servlet.provider.ContainerSupportProviderImpl$WlsRequestExecutor.run(ContainerSupportProviderImpl.java:272)
        at weblogic.invocation.ComponentInvocationContextManager._runAs(ComponentInvocationContextManager.java:352)
        at weblogic.invocation.ComponentInvocationContextManager.runAs(ComponentInvocationContextManager.java:337)
        at weblogic.work.LivePartitionUtility.doRunWorkUnderContext(LivePartitionUtility.java:57)
        at weblogic.work.PartitionUtility.runWorkUnderContext(PartitionUtility.java:41)
        at weblogic.work.SelfTuningWorkManagerImpl.runWorkUnderContext(SelfTuningWorkManagerImpl.java:655)
        at weblogic.work.ExecuteThread.execute(ExecuteThread.java:420)
        at weblogic.work.ExecuteThread.run(ExecuteThread.java:360)
Caused by: java.sql.SQLException: ORA-01422: exact fetch returns more than requested number of rows
ORA-06512: at "NEWCO_CORE.NEWCO_CORE_PKG", line 277
ORA-01403: no data found
ORA-06512: at "NEWCO_CORE.NEWCO_CORE_PKG", line 267
ORA-01403: no data found
ORA-06512: at "NEWCO_CORE.NEWCO_CORE_PKG", line 258
ORA-06512: at "NEWCO_CORE.NEWCO_CORE_PKG", line 338
ORA-06512: at line 1

        at oracle.jdbc.driver.T4CTTIoer11.processError(T4CTTIoer11.java:510)
        at oracle.jdbc.driver.T4CTTIoer11.processError(T4CTTIoer11.java:462)
        at oracle.jdbc.driver.T4C8Oall.processError(T4C8Oall.java:1105)
        at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:551)
        at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:269)
        at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:656)
        at oracle.jdbc.driver.T4CCallableStatement.doOall8(T4CCallableStatement.java:266)
        at oracle.jdbc.driver.T4CCallableStatement.doOall8(T4CCallableStatement.java:87)
        at oracle.jdbc.driver.T4CCallableStatement.executeForRows(T4CCallableStatement.java:966)
        at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1280)
        at oracle.jdbc.driver.OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:3719)
        at oracle.jdbc.driver.T4CCallableStatement.executeInternal(T4CCallableStatement.java:1359)
        at oracle.jdbc.driver.OraclePreparedStatement.execute(OraclePreparedStatement.java:3831)
        at oracle.jdbc.driver.OracleCallableStatement.execute(OracleCallableStatement.java:4252)
        at oracle.jdbc.driver.OraclePreparedStatementWrapper.execute(OraclePreparedStatementWrapper.java:1082)
        at weblogic.jdbc.wrapper.PreparedStatement.execute(PreparedStatement.java:119)
        at oracle.tip.adapter.db.sp.AbstractStoredProcedure.execute(AbstractStoredProcedure.java:141)
        ... 312 more
Caused by: Error : 1422, Position : 0, Sql = BEGIN NEWCO_CORE.NEWCO_CORE_PKG.SP_GETFMWERRORCODEV1(IN_ACTION_REQUIRED=>:1 , IN_ORIGINATOR_SYSTEM=>:2 , IN_EXT_ERROR_CODE=>:3 , IN_FMW_ERROR_CODE=>:4 , IN_FMW_SERVICE_NAME=>:5 , IN_STAGE=>:6 , OUT_FMW_ERROR_CODE=>:7 , OUT_FMW_ERROR_DESCRIPTION=>:8 , OUT_FMW_ERROR_TYPE=>:9 , OUT_ACTION=>:10 , OUT_DEFAULT_ACTION=>:11 , OUT_MAX_RETRY=>:12 , OUT_RETRY_DELAY=>:13 , OUT_NOTIFICATION_TYPE=>:14 ); END;, OriginalSql = BEGIN NEWCO_CORE.NEWCO_CORE_PKG.SP_GETFMWERRORCODEV1(IN_ACTION_REQUIRED=>?, IN_ORIGINATOR_SYSTEM=>?, IN_EXT_ERROR_CODE=>?, IN_FMW_ERROR_CODE=>?, IN_FMW_SERVICE_NAME=>?, IN_STAGE=>?, OUT_FMW_ERROR_CODE=>?, OUT_FMW_ERROR_DESCRIPTION=>?, OUT_FMW_ERROR_TYPE=>?, OUT_ACTION=>?, OUT_DEFAULT_ACTION=>?, OUT_MAX_RETRY=>?, OUT_RETRY_DELAY=>?, OUT_NOTIFICATION_TYPE=>?); END;, Error Msg = ORA-01422: exact fetch returns more than requested number of rows
ORA-06512: at "NEWCO_CORE.NEWCO_CORE_PKG", line 277
ORA-01403: no data found
ORA-06512: at "NEWCO_CORE.NEWCO_CORE_PKG", line 267
ORA-01403: no data found
ORA-06512: at "NEWCO_CORE.NEWCO_CORE_PKG", line 258
ORA-06512: at "NEWCO_CORE.NEWCO_CORE_PKG", line 338
ORA-06512: at line 1

        at oracle.jdbc.driver.T4CTTIoer11.processError(T4CTTIoer11.java:514)
        ... 328 more
>
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@1eb1cf64
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@1eb1cf64

wlsanalytics log index peve45 --stdout
index_id    : peve45
log_file    : /u01/oracle/wlsanalytics/data/osb/osb_server8/logs/osb_server8.out38073
index_file  : /u01/oracle/wlsanalytics/data/index/wlsa-soaerrors-806.index

<Oct 24, 2023 9:22:12,685 AM UTC> <Error> <oracle.osb.transports.jca> <BEA-000000> <servicebus:/CommonUtility/FMWErrorManagement/DBAdapter/GetFMWError/GetFMWError.wsdl [ GetFMWError_ptt::GetFMWError(InputParameters,OutputParameters) ] - Rolling back JCA LocalTransaction>
DBTransaction.rollback() is called.
No write to database completed before the failure. Will not mark the transaction for rollback to prevent excessive rollbacks.  To force a rollback in this situation add <property name="AlwaysRollbackOnFailure" value="true"/> in the database adapter jca file in JDeveloper.
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@18d55a2a
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@18d55a2a
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@77ace13c
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@77ace13c
[#document: null]
ERROR2
ERROR3[oracle@k8s-registry logs]$

case 2


wlsanalytics log index doha84 --stdout
index_id    : doha84
log_file    : /u01/oracle/wlsanalytics/data/osb/osb_server2/logs/osb_server2.out27870
index_file  : /u01/oracle/wlsanalytics/data/index/wlsa-soaerrors-806.index

<Oct 24, 2023 9:00:02,756 AM UTC> <Error> <oracle.osb.pipeline.kernel.router> <OSB-382191> <Services/Industry/Communications/Southbound/EBS/BusinessEvent/jmsadapter/SIEBEL_TransferContact_JMSAdapter: Unhandled error caught by system-level error handler: com.bea.wli.sb.pipeline.PipelineException: OSB Assign action failed updating variable "logXML": Error parsing XML: {err}FORG0005: Expected exactly one item, got 0 items
com.bea.wli.sb.pipeline.PipelineException: OSB Assign action failed updating variable "logXML": Error parsing XML: {err}FORG0005: Expected exactly one item, got 0 items
        at stages.transform.runtime.AssignRuntimeStep.processMessage(AssignRuntimeStep.java:93)
        at com.bea.wli.sb.stages.StageMetadataImpl$WrapperRuntimeStep.processMessage(StageMetadataImpl.java:384)
        at com.bea.wli.sb.stages.impl.SequenceRuntimeStep.processMessage(SequenceRuntimeStep.java:33)
        at com.bea.wli.sb.pipeline.components.PipelineStage.processMessage(PipelineStage.java:89)
        at com.bea.wli.sb.pipeline.PipelineContextImpl.execute(PipelineContextImpl.java:902)
        at com.bea.wli.sb.pipeline.components.Pipeline.processMessage(Pipeline.java:158)
        at com.bea.wli.sb.pipeline.PipelineContextImpl.handleError(PipelineContextImpl.java:1013)
        at com.bea.wli.sb.pipeline.MessageProcessor.processRequest(MessageProcessor.java:105)
        at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher$1.run(PipelineDispatcher.java:143)
        at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher$1.run(PipelineDispatcher.java:138)
        at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:386)
        at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:163)
        at com.bea.wli.sb.util.security.SecurityUtils.executeAs(SecurityUtils.java:102)
        at com.bea.wli.sb.security.WLSSecurityContextService.executeAs(WLSSecurityContextService.java:55)
        at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher.dispatch(PipelineDispatcher.java:136)
        at com.bea.wli.sb.service.handlerchain.handlers.ServiceInvoker.dispatch(ServiceInvoker.java:163)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.UpdateInboundOperationalStatistics.dispatch(UpdateInboundOperationalStatistics.java:75)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.InboundMessageContentHandler.dispatch(InboundMessageContentHandler.java:170)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.CheckAccessControl.dispatch(CheckAccessControl.java:73)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.UpdateInboundTransportStatistics.dispatch(UpdateInboundTransportStatistics.java:64)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.DefaultInboundErrorHandler.dispatch(DefaultInboundErrorHandler.java:44)
        at com.bea.wli.sb.service.handlerchain.DefaultInboundHandlerChain.dispatch(DefaultInboundHandlerChain.java:135)
        at com.bea.wli.sb.transports.TransportDispatcherClient.dispatch(TransportDispatcherClient.java:96)
        at com.bea.wli.sb.transports.TransportManagerImpl.receiveMessage(TransportManagerImpl.java:330)
        at com.bea.wli.sb.transports.jms.JmsInboundMDB.onMessage(JmsInboundMDB.java:159)
        at weblogic.ejb.container.internal.MDListener.execute(MDListener.java:438)
        at weblogic.ejb.container.internal.MDListener.transactionalOnMessage(MDListener.java:361)
        at weblogic.ejb.container.internal.MDListener.onMessage(MDListener.java:297)
        at weblogic.jms.client.JMSSession.onMessage(JMSSession.java:5107)
        at weblogic.jms.client.JMSSession.execute(JMSSession.java:4778)
        at weblogic.jms.client.JMSSession.executeMessage(JMSSession.java:4173)
        at weblogic.jms.client.JMSSession.access$000(JMSSession.java:127)
        at weblogic.jms.client.JMSSession$UseForRunnable.run(JMSSession.java:5632)
        at weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:681)
        at weblogic.invocation.ComponentInvocationContextManager._runAs(ComponentInvocationContextManager.java:352)
        at weblogic.invocation.ComponentInvocationContextManager.runAs(ComponentInvocationContextManager.java:337)
        at weblogic.work.LivePartitionUtility.doRunWorkUnderContext(LivePartitionUtility.java:57)
        at weblogic.work.PartitionUtility.runWorkUnderContext(PartitionUtility.java:41)
        at weblogic.work.SelfTuningWorkManagerImpl.runWorkUnderContext(SelfTuningWorkManagerImpl.java:655)
        at weblogic.work.ExecuteThread.execute(ExecuteThread.java:420)
        at weblogic.work.ExecuteThread.run(ExecuteThread.java:360)
Caused By: com.bea.wli.sb.context.BindingLayerException: Error parsing XML: {err}FORG0005: Expected exactly one item, got 0 items
        at com.bea.wli.sb.context.ContextUtils.checkValue(ContextUtils.java:140)
        at com.bea.wli.sb.context.MessageContextImpl.setVariableValue(MessageContextImpl.java:249)
        at stages.transform.runtime.AssignRuntimeStep.processMessage(AssignRuntimeStep.java:75)
        at com.bea.wli.sb.stages.StageMetadataImpl$WrapperRuntimeStep.processMessage(StageMetadataImpl.java:384)
        at com.bea.wli.sb.stages.impl.SequenceRuntimeStep.processMessage(SequenceRuntimeStep.java:33)
        at com.bea.wli.sb.pipeline.components.PipelineStage.processMessage(PipelineStage.java:89)
        at com.bea.wli.sb.pipeline.PipelineContextImpl.execute(PipelineContextImpl.java:902)
        at com.bea.wli.sb.pipeline.components.Pipeline.processMessage(Pipeline.java:158)
        at com.bea.wli.sb.pipeline.PipelineContextImpl.handleError(PipelineContextImpl.java:1013)
        at com.bea.wli.sb.pipeline.MessageProcessor.processRequest(MessageProcessor.java:105)
        at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher$1.run(PipelineDispatcher.java:143)
        at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher$1.run(PipelineDispatcher.java:138)
        at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:386)
        at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:163)
        at com.bea.wli.sb.util.security.SecurityUtils.executeAs(SecurityUtils.java:102)
        at com.bea.wli.sb.security.WLSSecurityContextService.executeAs(WLSSecurityContextService.java:55)
        at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher.dispatch(PipelineDispatcher.java:136)
        at com.bea.wli.sb.service.handlerchain.handlers.ServiceInvoker.dispatch(ServiceInvoker.java:163)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.UpdateInboundOperationalStatistics.dispatch(UpdateInboundOperationalStatistics.java:75)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.InboundMessageContentHandler.dispatch(InboundMessageContentHandler.java:170)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.CheckAccessControl.dispatch(CheckAccessControl.java:73)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.UpdateInboundTransportStatistics.dispatch(UpdateInboundTransportStatistics.java:64)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.DefaultInboundErrorHandler.dispatch(DefaultInboundErrorHandler.java:44)
        at com.bea.wli.sb.service.handlerchain.DefaultInboundHandlerChain.dispatch(DefaultInboundHandlerChain.java:135)
        at com.bea.wli.sb.transports.TransportDispatcherClient.dispatch(TransportDispatcherClient.java:96)
        at com.bea.wli.sb.transports.TransportManagerImpl.receiveMessage(TransportManagerImpl.java:330)
        at com.bea.wli.sb.transports.jms.JmsInboundMDB.onMessage(JmsInboundMDB.java:159)
        at weblogic.ejb.container.internal.MDListener.execute(MDListener.java:438)
        at weblogic.ejb.container.internal.MDListener.transactionalOnMessage(MDListener.java:361)
        at weblogic.ejb.container.internal.MDListener.onMessage(MDListener.java:297)
        at weblogic.jms.client.JMSSession.onMessage(JMSSession.java:5107)
        at weblogic.jms.client.JMSSession.execute(JMSSession.java:4778)
        at weblogic.jms.client.JMSSession.executeMessage(JMSSession.java:4173)
        at weblogic.jms.client.JMSSession.access$000(JMSSession.java:127)
        at weblogic.jms.client.JMSSession$UseForRunnable.run(JMSSession.java:5632)
        at weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:681)
        at weblogic.invocation.ComponentInvocationContextManager._runAs(ComponentInvocationContextManager.java:352)
        at weblogic.invocation.ComponentInvocationContextManager.runAs(ComponentInvocationContextManager.java:337)
        at weblogic.work.LivePartitionUtility.doRunWorkUnderContext(LivePartitionUtility.java:57)
        at weblogic.work.PartitionUtility.runWorkUnderContext(PartitionUtility.java:41)
        at weblogic.work.SelfTuningWorkManagerImpl.runWorkUnderContext(SelfTuningWorkManagerImpl.java:655)
        at weblogic.work.ExecuteThread.execute(ExecuteThread.java:420)
        at weblogic.work.ExecuteThread.run(ExecuteThread.java:360)
Caused By: com.bea.wli.sb.stages.expressions.ExpressionException: Error parsing XML: {err}FORG0005: Expected exactly one item, got 0 items
        at com.bea.wli.sb.stages.expressions.xquery.x2004.XDBCResult.toObject(XDBCResult.java:64)
        at com.bea.wli.sb.context.ContextUtils.checkValue(ContextUtils.java:110)
        at com.bea.wli.sb.context.MessageContextImpl.setVariableValue(MessageContextImpl.java:249)
        at stages.transform.runtime.AssignRuntimeStep.processMessage(AssignRuntimeStep.java:75)
        at com.bea.wli.sb.stages.StageMetadataImpl$WrapperRuntimeStep.processMessage(StageMetadataImpl.java:384)
        at com.bea.wli.sb.stages.impl.SequenceRuntimeStep.processMessage(SequenceRuntimeStep.java:33)
        at com.bea.wli.sb.pipeline.components.PipelineStage.processMessage(PipelineStage.java:89)
        at com.bea.wli.sb.pipeline.PipelineContextImpl.execute(PipelineContextImpl.java:902)
        at com.bea.wli.sb.pipeline.components.Pipeline.processMessage(Pipeline.java:158)
        at com.bea.wli.sb.pipeline.PipelineContextImpl.handleError(PipelineContextImpl.java:1013)
        at com.bea.wli.sb.pipeline.MessageProcessor.processRequest(MessageProcessor.java:105)
        at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher$1.run(PipelineDispatcher.java:143)
        at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher$1.run(PipelineDispatcher.java:138)
        at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:386)
        at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:163)
        at com.bea.wli.sb.util.security.SecurityUtils.executeAs(SecurityUtils.java:102)
        at com.bea.wli.sb.security.WLSSecurityContextService.executeAs(WLSSecurityContextService.java:55)
        at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher.dispatch(PipelineDispatcher.java:136)
        at com.bea.wli.sb.service.handlerchain.handlers.ServiceInvoker.dispatch(ServiceInvoker.java:163)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.UpdateInboundOperationalStatistics.dispatch(UpdateInboundOperationalStatistics.java:75)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.InboundMessageContentHandler.dispatch(InboundMessageContentHandler.java:170)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.CheckAccessControl.dispatch(CheckAccessControl.java:73)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.UpdateInboundTransportStatistics.dispatch(UpdateInboundTransportStatistics.java:64)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.DefaultInboundErrorHandler.dispatch(DefaultInboundErrorHandler.java:44)
        at com.bea.wli.sb.service.handlerchain.DefaultInboundHandlerChain.dispatch(DefaultInboundHandlerChain.java:135)
        at com.bea.wli.sb.transports.TransportDispatcherClient.dispatch(TransportDispatcherClient.java:96)
        at com.bea.wli.sb.transports.TransportManagerImpl.receiveMessage(TransportManagerImpl.java:330)
        at com.bea.wli.sb.transports.jms.JmsInboundMDB.onMessage(JmsInboundMDB.java:159)
        at weblogic.ejb.container.internal.MDListener.execute(MDListener.java:438)
        at weblogic.ejb.container.internal.MDListener.transactionalOnMessage(MDListener.java:361)
        at weblogic.ejb.container.internal.MDListener.onMessage(MDListener.java:297)
        at weblogic.jms.client.JMSSession.onMessage(JMSSession.java:5107)
        at weblogic.jms.client.JMSSession.execute(JMSSession.java:4778)
        at weblogic.jms.client.JMSSession.executeMessage(JMSSession.java:4173)
        at weblogic.jms.client.JMSSession.access$000(JMSSession.java:127)
        at weblogic.jms.client.JMSSession$UseForRunnable.run(JMSSession.java:5632)
        at weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:681)
        at weblogic.invocation.ComponentInvocationContextManager._runAs(ComponentInvocationContextManager.java:352)
        at weblogic.invocation.ComponentInvocationContextManager.runAs(ComponentInvocationContextManager.java:337)
        at weblogic.work.LivePartitionUtility.doRunWorkUnderContext(LivePartitionUtility.java:57)
        at weblogic.work.PartitionUtility.runWorkUnderContext(PartitionUtility.java:41)
        at weblogic.work.SelfTuningWorkManagerImpl.runWorkUnderContext(SelfTuningWorkManagerImpl.java:655)
        at weblogic.work.ExecuteThread.execute(ExecuteThread.java:420)
        at weblogic.work.ExecuteThread.run(ExecuteThread.java:360)
Caused By: com.bea.wli.common.xquery.x2004.XQueryException: Error parsing XML: {err}FORG0005: Expected exactly one item, got 0 items
        at com.bea.wli.common.xquery.x2004.iterators.TokenIteratorFactory.getXmlObjectValue(TokenIteratorFactory.java:560)
        at com.bea.wli.common.xquery.x2004.iterators.TokenIteratorFactory.getSingleObject(TokenIteratorFactory.java:481)
        at com.bea.wli.common.xquery.x2004.iterators.TokenIteratorFactory.getObject(TokenIteratorFactory.java:426)
        at com.bea.wli.sb.stages.expressions.xquery.x2004.XDBCResult.toObject(XDBCResult.java:60)
        at com.bea.wli.sb.context.ContextUtils.checkValue(ContextUtils.java:110)
        at com.bea.wli.sb.context.MessageContextImpl.setVariableValue(MessageContextImpl.java:249)
        at stages.transform.runtime.AssignRuntimeStep.processMessage(AssignRuntimeStep.java:75)
        at com.bea.wli.sb.stages.StageMetadataImpl$WrapperRuntimeStep.processMessage(StageMetadataImpl.java:384)
        at com.bea.wli.sb.stages.impl.SequenceRuntimeStep.processMessage(SequenceRuntimeStep.java:33)
        at com.bea.wli.sb.pipeline.components.PipelineStage.processMessage(PipelineStage.java:89)
        at com.bea.wli.sb.pipeline.PipelineContextImpl.execute(PipelineContextImpl.java:902)
        at com.bea.wli.sb.pipeline.components.Pipeline.processMessage(Pipeline.java:158)
        at com.bea.wli.sb.pipeline.PipelineContextImpl.handleError(PipelineContextImpl.java:1013)
        at com.bea.wli.sb.pipeline.MessageProcessor.processRequest(MessageProcessor.java:105)
        at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher$1.run(PipelineDispatcher.java:143)
        at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher$1.run(PipelineDispatcher.java:138)
        at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:386)
        at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:163)
        at com.bea.wli.sb.util.security.SecurityUtils.executeAs(SecurityUtils.java:102)
        at com.bea.wli.sb.security.WLSSecurityContextService.executeAs(WLSSecurityContextService.java:55)
        at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher.dispatch(PipelineDispatcher.java:136)
        at com.bea.wli.sb.service.handlerchain.handlers.ServiceInvoker.dispatch(ServiceInvoker.java:163)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.UpdateInboundOperationalStatistics.dispatch(UpdateInboundOperationalStatistics.java:75)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.InboundMessageContentHandler.dispatch(InboundMessageContentHandler.java:170)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.CheckAccessControl.dispatch(CheckAccessControl.java:73)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.UpdateInboundTransportStatistics.dispatch(UpdateInboundTransportStatistics.java:64)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.DefaultInboundErrorHandler.dispatch(DefaultInboundErrorHandler.java:44)
        at com.bea.wli.sb.service.handlerchain.DefaultInboundHandlerChain.dispatch(DefaultInboundHandlerChain.java:135)
        at com.bea.wli.sb.transports.TransportDispatcherClient.dispatch(TransportDispatcherClient.java:96)
        at com.bea.wli.sb.transports.TransportManagerImpl.receiveMessage(TransportManagerImpl.java:330)
        at com.bea.wli.sb.transports.jms.JmsInboundMDB.onMessage(JmsInboundMDB.java:159)
        at weblogic.ejb.container.internal.MDListener.execute(MDListener.java:438)
        at weblogic.ejb.container.internal.MDListener.transactionalOnMessage(MDListener.java:361)
        at weblogic.ejb.container.internal.MDListener.onMessage(MDListener.java:297)
        at weblogic.jms.client.JMSSession.onMessage(JMSSession.java:5107)
        at weblogic.jms.client.JMSSession.execute(JMSSession.java:4778)
        at weblogic.jms.client.JMSSession.executeMessage(JMSSession.java:4173)
        at weblogic.jms.client.JMSSession.access$000(JMSSession.java:127)
        at weblogic.jms.client.JMSSession$UseForRunnable.run(JMSSession.java:5632)
        at weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:681)
        at weblogic.invocation.ComponentInvocationContextManager._runAs(ComponentInvocationContextManager.java:352)
        at weblogic.invocation.ComponentInvocationContextManager.runAs(ComponentInvocationContextManager.java:337)
        at weblogic.work.LivePartitionUtility.doRunWorkUnderContext(LivePartitionUtility.java:57)
        at weblogic.work.PartitionUtility.runWorkUnderContext(PartitionUtility.java:41)
        at weblogic.work.SelfTuningWorkManagerImpl.runWorkUnderContext(SelfTuningWorkManagerImpl.java:655)
        at weblogic.work.ExecuteThread.execute(ExecuteThread.java:420)
        at weblogic.work.ExecuteThread.run(ExecuteThread.java:360)
Caused By: weblogic.xml.query.exceptions.XQueryDynamicException: {err}FORG0005: Expected exactly one item, got 0 items
        at weblogic.xml.query.iterators.AbstractIterator.reportUserError(AbstractIterator.java:95)
        at weblogic.xml.query.iterators.AbstractIterator.reportUserError(AbstractIterator.java:159)
        at weblogic.xml.query.runtime.typing.SeqTypeMatching.checkOccurence(SeqTypeMatching.java:509)
        at weblogic.xml.query.runtime.typing.SeqTypeMatching.fetchNext(SeqTypeMatching.java:152)
        at weblogic.xml.query.iterators.GenericIterator.next(GenericIterator.java:104)
        at weblogic.xml.query.runtime.core.RTVariable.fetchNext(RTVariable.java:53)
        at weblogic.xml.query.iterators.GenericIterator.next(GenericIterator.java:104)
        at weblogic.xml.query.runtime.constructor.AtomicElementConstructor.fetchNext(AtomicElementConstructor.java:129)
        at weblogic.xml.query.iterators.GenericIterator.peekNext(GenericIterator.java:163)
        at weblogic.xml.query.runtime.constructor.SuperElementConstructor.getPhase2(SuperElementConstructor.java:388)
        at weblogic.xml.query.runtime.constructor.PartMatElemConstructor.fetchNext(PartMatElemConstructor.java:229)
        at weblogic.xml.query.iterators.GenericIterator.next(GenericIterator.java:104)
        at weblogic.xml.query.xdbc.iterators.ItemIterator.fetchNext(ItemIterator.java:86)
        at weblogic.xml.query.iterators.LegacyGenericIterator.next(LegacyGenericIterator.java:109)
        at weblogic.xml.query.runtime.qname.InsertNamespaces.fetchNext(InsertNamespaces.java:216)
        at weblogic.xml.query.iterators.GenericIterator.next(GenericIterator.java:104)
        at weblogic.xml.query.runtime.core.ExecutionWrapper.fetchNext(ExecutionWrapper.java:88)
        at weblogic.xml.query.iterators.GenericIterator.next(GenericIterator.java:104)
        at weblogic.xml.query.xdbc.iterators.ItemIterator.fetchNext(ItemIterator.java:86)
        at weblogic.xml.query.iterators.LegacyGenericIterator.next(LegacyGenericIterator.java:109)
        at org.apache.xmlbeans.impl.store.XqrlImpl$SegmentedIterator.next(XqrlImpl.java:1722)
        at org.apache.xmlbeans.impl.store.XqrlImpl.loadTokenStream(XqrlImpl.java:1415)
        at org.apache.xmlbeans.impl.store.XqrlImpl.loadTokenStream(XqrlImpl.java:1387)
        at org.apache.xmlbeans.impl.store.XqrlImpl.executeQueryToXmlObjects(XqrlImpl.java:1641)
        at org.apache.xmlbeans.impl.store.XqrlImpl.executeQueryToXmlObjects(XqrlImpl.java:1601)
        at weblogic.xml.query.xmlbeans.apache.ApacheXmlBeansUtil.toApacheXmlObjects(ApacheXmlBeansUtil.java:23)
        at com.bea.wli.common.xquery.x2004.iterators.TokenIteratorFactory.getXmlObjectValue(TokenIteratorFactory.java:545)
        at com.bea.wli.common.xquery.x2004.iterators.TokenIteratorFactory.getSingleObject(TokenIteratorFactory.java:481)
        at com.bea.wli.common.xquery.x2004.iterators.TokenIteratorFactory.getObject(TokenIteratorFactory.java:426)
        at com.bea.wli.sb.stages.expressions.xquery.x2004.XDBCResult.toObject(XDBCResult.java:60)
        at com.bea.wli.sb.context.ContextUtils.checkValue(ContextUtils.java:110)
        at com.bea.wli.sb.context.MessageContextImpl.setVariableValue(MessageContextImpl.java:249)
        at stages.transform.runtime.AssignRuntimeStep.processMessage(AssignRuntimeStep.java:75)
        at com.bea.wli.sb.stages.StageMetadataImpl$WrapperRuntimeStep.processMessage(StageMetadataImpl.java:384)
        at com.bea.wli.sb.stages.impl.SequenceRuntimeStep.processMessage(SequenceRuntimeStep.java:33)
        at com.bea.wli.sb.pipeline.components.PipelineStage.processMessage(PipelineStage.java:89)
        at com.bea.wli.sb.pipeline.PipelineContextImpl.execute(PipelineContextImpl.java:902)
        at com.bea.wli.sb.pipeline.components.Pipeline.processMessage(Pipeline.java:158)
        at com.bea.wli.sb.pipeline.PipelineContextImpl.handleError(PipelineContextImpl.java:1013)
        at com.bea.wli.sb.pipeline.MessageProcessor.processRequest(MessageProcessor.java:105)
        at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher$1.run(PipelineDispatcher.java:143)
        at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher$1.run(PipelineDispatcher.java:138)
        at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:386)
        at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:163)
        at com.bea.wli.sb.util.security.SecurityUtils.executeAs(SecurityUtils.java:102)
        at com.bea.wli.sb.security.WLSSecurityContextService.executeAs(WLSSecurityContextService.java:55)
        at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher.dispatch(PipelineDispatcher.java:136)
        at com.bea.wli.sb.service.handlerchain.handlers.ServiceInvoker.dispatch(ServiceInvoker.java:163)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.UpdateInboundOperationalStatistics.dispatch(UpdateInboundOperationalStatistics.java:75)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.InboundMessageContentHandler.dispatch(InboundMessageContentHandler.java:170)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.CheckAccessControl.dispatch(CheckAccessControl.java:73)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.UpdateInboundTransportStatistics.dispatch(UpdateInboundTransportStatistics.java:64)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.DefaultInboundErrorHandler.dispatch(DefaultInboundErrorHandler.java:44)
        at com.bea.wli.sb.service.handlerchain.DefaultInboundHandlerChain.dispatch(DefaultInboundHandlerChain.java:135)
        at com.bea.wli.sb.transports.TransportDispatcherClient.dispatch(TransportDispatcherClient.java:96)
        at com.bea.wli.sb.transports.TransportManagerImpl.receiveMessage(TransportManagerImpl.java:330)
        at com.bea.wli.sb.transports.jms.JmsInboundMDB.onMessage(JmsInboundMDB.java:159)
        at weblogic.ejb.container.internal.MDListener.execute(MDListener.java:438)
        at weblogic.ejb.container.internal.MDListener.transactionalOnMessage(MDListener.java:361)
        at weblogic.ejb.container.internal.MDListener.onMessage(MDListener.java:297)
        at weblogic.jms.client.JMSSession.onMessage(JMSSession.java:5107)
        at weblogic.jms.client.JMSSession.execute(JMSSession.java:4778)
        at weblogic.jms.client.JMSSession.executeMessage(JMSSession.java:4173)
        at weblogic.jms.client.JMSSession.access$000(JMSSession.java:127)
        at weblogic.jms.client.JMSSession$UseForRunnable.run(JMSSession.java:5632)
        at weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:681)
        at weblogic.invocation.ComponentInvocationContextManager._runAs(ComponentInvocationContextManager.java:352)
        at weblogic.invocation.ComponentInvocationContextManager.runAs(ComponentInvocationContextManager.java:337)
        at weblogic.work.LivePartitionUtility.doRunWorkUnderContext(LivePartitionUtility.java:57)
        at weblogic.work.PartitionUtility.runWorkUnderContext(PartitionUtility.java:41)
        at weblogic.work.SelfTuningWorkManagerImpl.runWorkUnderContext(SelfTuningWorkManagerImpl.java:655)
        at weblogic.work.ExecuteThread.execute(ExecuteThread.java:420)
        at weblogic.work.ExecuteThread.run(ExecuteThread.java:360)
>
xrefTable: XREF_CP_ACCOUNTID referenceColumnName: SEBL_VFACCOUNTNUMBER columnName: SEBL_01 referenceValue: 7082260758
DB Query Start : tableGUID :XREF_CP_ACCOUNTIDreferenceColumnGUID :SEBL_VFACCOUNTNUMBERreferenceValue : 7082260758columnGUID : SEBL_01needAnException :false
Data Source : weblogic.jdbc.common.internal.RmiDataSource@33a65a25 [weblogic.jdbc.wrapper.JTAConnection_weblogic_jdbc_wrapper_XAConnection_oracle_jdbc_driver_LogicalConnection-jdbc/xref-449262, oracle.jdbc.driver.LogicalConnection@6f5dbf74]
valueToReturn : 1-VAOWT6KR
xrefTable: XREF_CP_ACCOUNTID referenceColumnName: SEBL_VFACCOUNTNUMBER columnName: SEBL_01 referenceValue: 685886140
DB Query Start : tableGUID :XREF_CP_ACCOUNTIDreferenceColumnGUID :SEBL_VFACCOUNTNUMBERreferenceValue : 685886140columnGUID : SEBL_01needAnException :false
Data Source : weblogic.jdbc.common.internal.RmiDataSource@33a65a25 [weblogic.jdbc.wrapper.JTAConnection_weblogic_jdbc_wrapper_XAConnection_oracle_jdbc_driver_LogicalConnection-jdbc/xref-449264, oracle.jdbc.driver.LogicalConnection@4cae8bd9]
valueToReturn : 1-2IHYM-1134

[oracle@k8s-registry wlsanalytics]$ wlsanalytics log index doxo56 --stdout
index_id    : doxo56
log_file    : /u01/oracle/wlsanalytics/data/osb/osb_server5/logs/osb_server5.out37746
index_file  : /u01/oracle/wlsanalytics/data/index/wlsa-soaerrors-806.index

<Oct 24, 2023 9:00:03,155 AM UTC> <Error> <oracle.osb.pipeline.kernel.router> <OSB-382191> <Services/Industry/Communications/Southbound/EBS/BusinessEvent/jmsadapter/SIEBEL_TransferContact_JMSAdapter: Unhandled error caught by system-level error handler: com.bea.wli.sb.pipeline.PipelineException: OSB Assign action failed updating variable "logXML": Error parsing XML: {err}FORG0005: Expected exactly one item, got 0 items
com.bea.wli.sb.pipeline.PipelineException: OSB Assign action failed updating variable "logXML": Error parsing XML: {err}FORG0005: Expected exactly one item, got 0 items
        at stages.transform.runtime.AssignRuntimeStep.processMessage(AssignRuntimeStep.java:93)
        at com.bea.wli.sb.stages.StageMetadataImpl$WrapperRuntimeStep.processMessage(StageMetadataImpl.java:384)
        at com.bea.wli.sb.stages.impl.SequenceRuntimeStep.processMessage(SequenceRuntimeStep.java:33)
        at com.bea.wli.sb.pipeline.components.PipelineStage.processMessage(PipelineStage.java:89)
        at com.bea.wli.sb.pipeline.PipelineContextImpl.execute(PipelineContextImpl.java:902)
        at com.bea.wli.sb.pipeline.components.Pipeline.processMessage(Pipeline.java:158)
        at com.bea.wli.sb.pipeline.PipelineContextImpl.handleError(PipelineContextImpl.java:1013)
        at com.bea.wli.sb.pipeline.MessageProcessor.processRequest(MessageProcessor.java:105)
        at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher$1.run(PipelineDispatcher.java:143)
        at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher$1.run(PipelineDispatcher.java:138)
        at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:386)
        at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:163)
        at com.bea.wli.sb.util.security.SecurityUtils.executeAs(SecurityUtils.java:102)
        at com.bea.wli.sb.security.WLSSecurityContextService.executeAs(WLSSecurityContextService.java:55)
        at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher.dispatch(PipelineDispatcher.java:136)
        at com.bea.wli.sb.service.handlerchain.handlers.ServiceInvoker.dispatch(ServiceInvoker.java:163)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.UpdateInboundOperationalStatistics.dispatch(UpdateInboundOperationalStatistics.java:75)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.InboundMessageContentHandler.dispatch(InboundMessageContentHandler.java:170)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.CheckAccessControl.dispatch(CheckAccessControl.java:73)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.UpdateInboundTransportStatistics.dispatch(UpdateInboundTransportStatistics.java:64)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.DefaultInboundErrorHandler.dispatch(DefaultInboundErrorHandler.java:44)
        at com.bea.wli.sb.service.handlerchain.DefaultInboundHandlerChain.dispatch(DefaultInboundHandlerChain.java:135)
        at com.bea.wli.sb.transports.TransportDispatcherClient.dispatch(TransportDispatcherClient.java:96)
        at com.bea.wli.sb.transports.TransportManagerImpl.receiveMessage(TransportManagerImpl.java:330)
        at com.bea.wli.sb.transports.jms.JmsInboundMDB.onMessage(JmsInboundMDB.java:159)
        at weblogic.ejb.container.internal.MDListener.execute(MDListener.java:438)
        at weblogic.ejb.container.internal.MDListener.transactionalOnMessage(MDListener.java:361)
        at weblogic.ejb.container.internal.MDListener.onMessage(MDListener.java:297)
        at weblogic.jms.client.JMSSession.onMessage(JMSSession.java:5107)
        at weblogic.jms.client.JMSSession.execute(JMSSession.java:4778)
        at weblogic.jms.client.JMSSession.executeMessage(JMSSession.java:4173)
        at weblogic.jms.client.JMSSession.access$000(JMSSession.java:127)
        at weblogic.jms.client.JMSSession$UseForRunnable.run(JMSSession.java:5632)
        at weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:681)
        at weblogic.invocation.ComponentInvocationContextManager._runAs(ComponentInvocationContextManager.java:352)
        at weblogic.invocation.ComponentInvocationContextManager.runAs(ComponentInvocationContextManager.java:337)
        at weblogic.work.LivePartitionUtility.doRunWorkUnderContext(LivePartitionUtility.java:57)
        at weblogic.work.PartitionUtility.runWorkUnderContext(PartitionUtility.java:41)
        at weblogic.work.SelfTuningWorkManagerImpl.runWorkUnderContext(SelfTuningWorkManagerImpl.java:655)
        at weblogic.work.ExecuteThread.execute(ExecuteThread.java:420)
        at weblogic.work.ExecuteThread.run(ExecuteThread.java:360)
Caused By: com.bea.wli.sb.context.BindingLayerException: Error parsing XML: {err}FORG0005: Expected exactly one item, got 0 items
        at com.bea.wli.sb.context.ContextUtils.checkValue(ContextUtils.java:140)
        at com.bea.wli.sb.context.MessageContextImpl.setVariableValue(MessageContextImpl.java:249)
        at stages.transform.runtime.AssignRuntimeStep.processMessage(AssignRuntimeStep.java:75)
        at com.bea.wli.sb.stages.StageMetadataImpl$WrapperRuntimeStep.processMessage(StageMetadataImpl.java:384)
        at com.bea.wli.sb.stages.impl.SequenceRuntimeStep.processMessage(SequenceRuntimeStep.java:33)
        at com.bea.wli.sb.pipeline.components.PipelineStage.processMessage(PipelineStage.java:89)
        at com.bea.wli.sb.pipeline.PipelineContextImpl.execute(PipelineContextImpl.java:902)
        at com.bea.wli.sb.pipeline.components.Pipeline.processMessage(Pipeline.java:158)
        at com.bea.wli.sb.pipeline.PipelineContextImpl.handleError(PipelineContextImpl.java:1013)
        at com.bea.wli.sb.pipeline.MessageProcessor.processRequest(MessageProcessor.java:105)
        at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher$1.run(PipelineDispatcher.java:143)
        at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher$1.run(PipelineDispatcher.java:138)
        at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:386)
        at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:163)
        at com.bea.wli.sb.util.security.SecurityUtils.executeAs(SecurityUtils.java:102)
        at com.bea.wli.sb.security.WLSSecurityContextService.executeAs(WLSSecurityContextService.java:55)
        at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher.dispatch(PipelineDispatcher.java:136)
        at com.bea.wli.sb.service.handlerchain.handlers.ServiceInvoker.dispatch(ServiceInvoker.java:163)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.UpdateInboundOperationalStatistics.dispatch(UpdateInboundOperationalStatistics.java:75)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.InboundMessageContentHandler.dispatch(InboundMessageContentHandler.java:170)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.CheckAccessControl.dispatch(CheckAccessControl.java:73)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.UpdateInboundTransportStatistics.dispatch(UpdateInboundTransportStatistics.java:64)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.DefaultInboundErrorHandler.dispatch(DefaultInboundErrorHandler.java:44)
        at com.bea.wli.sb.service.handlerchain.DefaultInboundHandlerChain.dispatch(DefaultInboundHandlerChain.java:135)
        at com.bea.wli.sb.transports.TransportDispatcherClient.dispatch(TransportDispatcherClient.java:96)
        at com.bea.wli.sb.transports.TransportManagerImpl.receiveMessage(TransportManagerImpl.java:330)
        at com.bea.wli.sb.transports.jms.JmsInboundMDB.onMessage(JmsInboundMDB.java:159)
        at weblogic.ejb.container.internal.MDListener.execute(MDListener.java:438)
        at weblogic.ejb.container.internal.MDListener.transactionalOnMessage(MDListener.java:361)
        at weblogic.ejb.container.internal.MDListener.onMessage(MDListener.java:297)
        at weblogic.jms.client.JMSSession.onMessage(JMSSession.java:5107)
        at weblogic.jms.client.JMSSession.execute(JMSSession.java:4778)
        at weblogic.jms.client.JMSSession.executeMessage(JMSSession.java:4173)
        at weblogic.jms.client.JMSSession.access$000(JMSSession.java:127)
        at weblogic.jms.client.JMSSession$UseForRunnable.run(JMSSession.java:5632)
        at weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:681)
        at weblogic.invocation.ComponentInvocationContextManager._runAs(ComponentInvocationContextManager.java:352)
        at weblogic.invocation.ComponentInvocationContextManager.runAs(ComponentInvocationContextManager.java:337)
        at weblogic.work.LivePartitionUtility.doRunWorkUnderContext(LivePartitionUtility.java:57)
        at weblogic.work.PartitionUtility.runWorkUnderContext(PartitionUtility.java:41)
        at weblogic.work.SelfTuningWorkManagerImpl.runWorkUnderContext(SelfTuningWorkManagerImpl.java:655)
        at weblogic.work.ExecuteThread.execute(ExecuteThread.java:420)
        at weblogic.work.ExecuteThread.run(ExecuteThread.java:360)
Caused By: com.bea.wli.sb.stages.expressions.ExpressionException: Error parsing XML: {err}FORG0005: Expected exactly one item, got 0 items
        at com.bea.wli.sb.stages.expressions.xquery.x2004.XDBCResult.toObject(XDBCResult.java:64)
        at com.bea.wli.sb.context.ContextUtils.checkValue(ContextUtils.java:110)
        at com.bea.wli.sb.context.MessageContextImpl.setVariableValue(MessageContextImpl.java:249)
        at stages.transform.runtime.AssignRuntimeStep.processMessage(AssignRuntimeStep.java:75)
        at com.bea.wli.sb.stages.StageMetadataImpl$WrapperRuntimeStep.processMessage(StageMetadataImpl.java:384)
        at com.bea.wli.sb.stages.impl.SequenceRuntimeStep.processMessage(SequenceRuntimeStep.java:33)
        at com.bea.wli.sb.pipeline.components.PipelineStage.processMessage(PipelineStage.java:89)
        at com.bea.wli.sb.pipeline.PipelineContextImpl.execute(PipelineContextImpl.java:902)
        at com.bea.wli.sb.pipeline.components.Pipeline.processMessage(Pipeline.java:158)
        at com.bea.wli.sb.pipeline.PipelineContextImpl.handleError(PipelineContextImpl.java:1013)
        at com.bea.wli.sb.pipeline.MessageProcessor.processRequest(MessageProcessor.java:105)
        at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher$1.run(PipelineDispatcher.java:143)
        at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher$1.run(PipelineDispatcher.java:138)
        at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:386)
        at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:163)
        at com.bea.wli.sb.util.security.SecurityUtils.executeAs(SecurityUtils.java:102)
        at com.bea.wli.sb.security.WLSSecurityContextService.executeAs(WLSSecurityContextService.java:55)
        at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher.dispatch(PipelineDispatcher.java:136)
        at com.bea.wli.sb.service.handlerchain.handlers.ServiceInvoker.dispatch(ServiceInvoker.java:163)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.UpdateInboundOperationalStatistics.dispatch(UpdateInboundOperationalStatistics.java:75)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.InboundMessageContentHandler.dispatch(InboundMessageContentHandler.java:170)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.CheckAccessControl.dispatch(CheckAccessControl.java:73)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.UpdateInboundTransportStatistics.dispatch(UpdateInboundTransportStatistics.java:64)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.DefaultInboundErrorHandler.dispatch(DefaultInboundErrorHandler.java:44)
        at com.bea.wli.sb.service.handlerchain.DefaultInboundHandlerChain.dispatch(DefaultInboundHandlerChain.java:135)
        at com.bea.wli.sb.transports.TransportDispatcherClient.dispatch(TransportDispatcherClient.java:96)
        at com.bea.wli.sb.transports.TransportManagerImpl.receiveMessage(TransportManagerImpl.java:330)
        at com.bea.wli.sb.transports.jms.JmsInboundMDB.onMessage(JmsInboundMDB.java:159)
        at weblogic.ejb.container.internal.MDListener.execute(MDListener.java:438)
        at weblogic.ejb.container.internal.MDListener.transactionalOnMessage(MDListener.java:361)
        at weblogic.ejb.container.internal.MDListener.onMessage(MDListener.java:297)
        at weblogic.jms.client.JMSSession.onMessage(JMSSession.java:5107)
        at weblogic.jms.client.JMSSession.execute(JMSSession.java:4778)
        at weblogic.jms.client.JMSSession.executeMessage(JMSSession.java:4173)
        at weblogic.jms.client.JMSSession.access$000(JMSSession.java:127)
        at weblogic.jms.client.JMSSession$UseForRunnable.run(JMSSession.java:5632)
        at weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:681)
        at weblogic.invocation.ComponentInvocationContextManager._runAs(ComponentInvocationContextManager.java:352)
        at weblogic.invocation.ComponentInvocationContextManager.runAs(ComponentInvocationContextManager.java:337)
        at weblogic.work.LivePartitionUtility.doRunWorkUnderContext(LivePartitionUtility.java:57)
        at weblogic.work.PartitionUtility.runWorkUnderContext(PartitionUtility.java:41)
        at weblogic.work.SelfTuningWorkManagerImpl.runWorkUnderContext(SelfTuningWorkManagerImpl.java:655)
        at weblogic.work.ExecuteThread.execute(ExecuteThread.java:420)
        at weblogic.work.ExecuteThread.run(ExecuteThread.java:360)
Caused By: com.bea.wli.common.xquery.x2004.XQueryException: Error parsing XML: {err}FORG0005: Expected exactly one item, got 0 items
        at com.bea.wli.common.xquery.x2004.iterators.TokenIteratorFactory.getXmlObjectValue(TokenIteratorFactory.java:560)
        at com.bea.wli.common.xquery.x2004.iterators.TokenIteratorFactory.getSingleObject(TokenIteratorFactory.java:481)
        at com.bea.wli.common.xquery.x2004.iterators.TokenIteratorFactory.getObject(TokenIteratorFactory.java:426)
        at com.bea.wli.sb.stages.expressions.xquery.x2004.XDBCResult.toObject(XDBCResult.java:60)
        at com.bea.wli.sb.context.ContextUtils.checkValue(ContextUtils.java:110)
        at com.bea.wli.sb.context.MessageContextImpl.setVariableValue(MessageContextImpl.java:249)
        at stages.transform.runtime.AssignRuntimeStep.processMessage(AssignRuntimeStep.java:75)
        at com.bea.wli.sb.stages.StageMetadataImpl$WrapperRuntimeStep.processMessage(StageMetadataImpl.java:384)
        at com.bea.wli.sb.stages.impl.SequenceRuntimeStep.processMessage(SequenceRuntimeStep.java:33)
        at com.bea.wli.sb.pipeline.components.PipelineStage.processMessage(PipelineStage.java:89)
        at com.bea.wli.sb.pipeline.PipelineContextImpl.execute(PipelineContextImpl.java:902)
        at com.bea.wli.sb.pipeline.components.Pipeline.processMessage(Pipeline.java:158)
        at com.bea.wli.sb.pipeline.PipelineContextImpl.handleError(PipelineContextImpl.java:1013)
        at com.bea.wli.sb.pipeline.MessageProcessor.processRequest(MessageProcessor.java:105)
        at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher$1.run(PipelineDispatcher.java:143)
        at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher$1.run(PipelineDispatcher.java:138)
        at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:386)
        at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:163)
        at com.bea.wli.sb.util.security.SecurityUtils.executeAs(SecurityUtils.java:102)
        at com.bea.wli.sb.security.WLSSecurityContextService.executeAs(WLSSecurityContextService.java:55)
        at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher.dispatch(PipelineDispatcher.java:136)
        at com.bea.wli.sb.service.handlerchain.handlers.ServiceInvoker.dispatch(ServiceInvoker.java:163)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.UpdateInboundOperationalStatistics.dispatch(UpdateInboundOperationalStatistics.java:75)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.InboundMessageContentHandler.dispatch(InboundMessageContentHandler.java:170)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.CheckAccessControl.dispatch(CheckAccessControl.java:73)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.UpdateInboundTransportStatistics.dispatch(UpdateInboundTransportStatistics.java:64)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.DefaultInboundErrorHandler.dispatch(DefaultInboundErrorHandler.java:44)
        at com.bea.wli.sb.service.handlerchain.DefaultInboundHandlerChain.dispatch(DefaultInboundHandlerChain.java:135)
        at com.bea.wli.sb.transports.TransportDispatcherClient.dispatch(TransportDispatcherClient.java:96)
        at com.bea.wli.sb.transports.TransportManagerImpl.receiveMessage(TransportManagerImpl.java:330)
        at com.bea.wli.sb.transports.jms.JmsInboundMDB.onMessage(JmsInboundMDB.java:159)
        at weblogic.ejb.container.internal.MDListener.execute(MDListener.java:438)
        at weblogic.ejb.container.internal.MDListener.transactionalOnMessage(MDListener.java:361)
        at weblogic.ejb.container.internal.MDListener.onMessage(MDListener.java:297)
        at weblogic.jms.client.JMSSession.onMessage(JMSSession.java:5107)
        at weblogic.jms.client.JMSSession.execute(JMSSession.java:4778)
        at weblogic.jms.client.JMSSession.executeMessage(JMSSession.java:4173)
        at weblogic.jms.client.JMSSession.access$000(JMSSession.java:127)
        at weblogic.jms.client.JMSSession$UseForRunnable.run(JMSSession.java:5632)
        at weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:681)
        at weblogic.invocation.ComponentInvocationContextManager._runAs(ComponentInvocationContextManager.java:352)
        at weblogic.invocation.ComponentInvocationContextManager.runAs(ComponentInvocationContextManager.java:337)
        at weblogic.work.LivePartitionUtility.doRunWorkUnderContext(LivePartitionUtility.java:57)
        at weblogic.work.PartitionUtility.runWorkUnderContext(PartitionUtility.java:41)
        at weblogic.work.SelfTuningWorkManagerImpl.runWorkUnderContext(SelfTuningWorkManagerImpl.java:655)
        at weblogic.work.ExecuteThread.execute(ExecuteThread.java:420)
        at weblogic.work.ExecuteThread.run(ExecuteThread.java:360)
Caused By: weblogic.xml.query.exceptions.XQueryDynamicException: {err}FORG0005: Expected exactly one item, got 0 items
        at weblogic.xml.query.iterators.AbstractIterator.reportUserError(AbstractIterator.java:95)
        at weblogic.xml.query.iterators.AbstractIterator.reportUserError(AbstractIterator.java:159)
        at weblogic.xml.query.runtime.typing.SeqTypeMatching.checkOccurence(SeqTypeMatching.java:509)
        at weblogic.xml.query.runtime.typing.SeqTypeMatching.fetchNext(SeqTypeMatching.java:152)
        at weblogic.xml.query.iterators.GenericIterator.next(GenericIterator.java:104)
        at weblogic.xml.query.runtime.core.RTVariable.fetchNext(RTVariable.java:53)
        at weblogic.xml.query.iterators.GenericIterator.next(GenericIterator.java:104)
        at weblogic.xml.query.runtime.constructor.AtomicElementConstructor.fetchNext(AtomicElementConstructor.java:129)
        at weblogic.xml.query.iterators.GenericIterator.peekNext(GenericIterator.java:163)
        at weblogic.xml.query.runtime.constructor.SuperElementConstructor.getPhase2(SuperElementConstructor.java:388)
        at weblogic.xml.query.runtime.constructor.PartMatElemConstructor.fetchNext(PartMatElemConstructor.java:229)
        at weblogic.xml.query.iterators.GenericIterator.next(GenericIterator.java:104)
        at weblogic.xml.query.xdbc.iterators.ItemIterator.fetchNext(ItemIterator.java:86)
        at weblogic.xml.query.iterators.LegacyGenericIterator.next(LegacyGenericIterator.java:109)
        at weblogic.xml.query.runtime.qname.InsertNamespaces.fetchNext(InsertNamespaces.java:216)
        at weblogic.xml.query.iterators.GenericIterator.next(GenericIterator.java:104)
        at weblogic.xml.query.runtime.core.ExecutionWrapper.fetchNext(ExecutionWrapper.java:88)
        at weblogic.xml.query.iterators.GenericIterator.next(GenericIterator.java:104)
        at weblogic.xml.query.xdbc.iterators.ItemIterator.fetchNext(ItemIterator.java:86)
        at weblogic.xml.query.iterators.LegacyGenericIterator.next(LegacyGenericIterator.java:109)
        at org.apache.xmlbeans.impl.store.XqrlImpl$SegmentedIterator.next(XqrlImpl.java:1722)
        at org.apache.xmlbeans.impl.store.XqrlImpl.loadTokenStream(XqrlImpl.java:1415)
        at org.apache.xmlbeans.impl.store.XqrlImpl.loadTokenStream(XqrlImpl.java:1387)
        at org.apache.xmlbeans.impl.store.XqrlImpl.executeQueryToXmlObjects(XqrlImpl.java:1641)
        at org.apache.xmlbeans.impl.store.XqrlImpl.executeQueryToXmlObjects(XqrlImpl.java:1601)
        at weblogic.xml.query.xmlbeans.apache.ApacheXmlBeansUtil.toApacheXmlObjects(ApacheXmlBeansUtil.java:23)
        at com.bea.wli.common.xquery.x2004.iterators.TokenIteratorFactory.getXmlObjectValue(TokenIteratorFactory.java:545)
        at com.bea.wli.common.xquery.x2004.iterators.TokenIteratorFactory.getSingleObject(TokenIteratorFactory.java:481)
        at com.bea.wli.common.xquery.x2004.iterators.TokenIteratorFactory.getObject(TokenIteratorFactory.java:426)
        at com.bea.wli.sb.stages.expressions.xquery.x2004.XDBCResult.toObject(XDBCResult.java:60)
        at com.bea.wli.sb.context.ContextUtils.checkValue(ContextUtils.java:110)
        at com.bea.wli.sb.context.MessageContextImpl.setVariableValue(MessageContextImpl.java:249)
        at stages.transform.runtime.AssignRuntimeStep.processMessage(AssignRuntimeStep.java:75)
        at com.bea.wli.sb.stages.StageMetadataImpl$WrapperRuntimeStep.processMessage(StageMetadataImpl.java:384)
        at com.bea.wli.sb.stages.impl.SequenceRuntimeStep.processMessage(SequenceRuntimeStep.java:33)
        at com.bea.wli.sb.pipeline.components.PipelineStage.processMessage(PipelineStage.java:89)
        at com.bea.wli.sb.pipeline.PipelineContextImpl.execute(PipelineContextImpl.java:902)
        at com.bea.wli.sb.pipeline.components.Pipeline.processMessage(Pipeline.java:158)
        at com.bea.wli.sb.pipeline.PipelineContextImpl.handleError(PipelineContextImpl.java:1013)
        at com.bea.wli.sb.pipeline.MessageProcessor.processRequest(MessageProcessor.java:105)
        at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher$1.run(PipelineDispatcher.java:143)
        at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher$1.run(PipelineDispatcher.java:138)
        at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:386)
        at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:163)
        at com.bea.wli.sb.util.security.SecurityUtils.executeAs(SecurityUtils.java:102)
        at com.bea.wli.sb.security.WLSSecurityContextService.executeAs(WLSSecurityContextService.java:55)
        at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher.dispatch(PipelineDispatcher.java:136)
        at com.bea.wli.sb.service.handlerchain.handlers.ServiceInvoker.dispatch(ServiceInvoker.java:163)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.UpdateInboundOperationalStatistics.dispatch(UpdateInboundOperationalStatistics.java:75)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.InboundMessageContentHandler.dispatch(InboundMessageContentHandler.java:170)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.CheckAccessControl.dispatch(CheckAccessControl.java:73)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.UpdateInboundTransportStatistics.dispatch(UpdateInboundTransportStatistics.java:64)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:129)
        at com.bea.wli.sb.service.handlerchain.handlers.DefaultInboundErrorHandler.dispatch(DefaultInboundErrorHandler.java:44)
        at com.bea.wli.sb.service.handlerchain.DefaultInboundHandlerChain.dispatch(DefaultInboundHandlerChain.java:135)
        at com.bea.wli.sb.transports.TransportDispatcherClient.dispatch(TransportDispatcherClient.java:96)
        at com.bea.wli.sb.transports.TransportManagerImpl.receiveMessage(TransportManagerImpl.java:330)
        at com.bea.wli.sb.transports.jms.JmsInboundMDB.onMessage(JmsInboundMDB.java:159)
        at weblogic.ejb.container.internal.MDListener.execute(MDListener.java:438)
        at weblogic.ejb.container.internal.MDListener.transactionalOnMessage(MDListener.java:361)
        at weblogic.ejb.container.internal.MDListener.onMessage(MDListener.java:297)
        at weblogic.jms.client.JMSSession.onMessage(JMSSession.java:5107)
        at weblogic.jms.client.JMSSession.execute(JMSSession.java:4778)
        at weblogic.jms.client.JMSSession.executeMessage(JMSSession.java:4173)
        at weblogic.jms.client.JMSSession.access$000(JMSSession.java:127)
        at weblogic.jms.client.JMSSession$UseForRunnable.run(JMSSession.java:5632)
        at weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:681)
        at weblogic.invocation.ComponentInvocationContextManager._runAs(ComponentInvocationContextManager.java:352)
        at weblogic.invocation.ComponentInvocationContextManager.runAs(ComponentInvocationContextManager.java:337)
        at weblogic.work.LivePartitionUtility.doRunWorkUnderContext(LivePartitionUtility.java:57)
        at weblogic.work.PartitionUtility.runWorkUnderContext(PartitionUtility.java:41)
        at weblogic.work.SelfTuningWorkManagerImpl.runWorkUnderContext(SelfTuningWorkManagerImpl.java:655)
        at weblogic.work.ExecuteThread.execute(ExecuteThread.java:420)
        at weblogic.work.ExecuteThread.run(ExecuteThread.java:360)
>
xrefTable: XREF_CP_ACCOUNTID referenceColumnName: SEBL_01 columnName: SEBL_VFACCOUNTNUMBER referenceValue: 1-114DK-9
DB Query Start : tableGUID :XREF_CP_ACCOUNTIDreferenceColumnGUID :SEBL_01referenceValue : 1-114DK-9columnGUID : SEBL_VFACCOUNTNUMBERneedAnException :true
Data Source : weblogic.jdbc.common.internal.RmiDataSource@57a5872d [weblogic.jdbc.wrapper.JTAConnection_weblogic_jdbc_wrapper_XAConnection_oracle_jdbc_driver_LogicalConnection-jdbc/xref-449440, oracle.jdbc.driver.LogicalConnection@56acef23]
valueToReturn : 682502720
xrefTable: XREF_CP_ACCOUNTID referenceColumnName: SEBL_01 columnName: SEBL_VFACCOUNTNUMBER referenceValue: 1-114DK-9
DB Query Start : tableGUID :XREF_CP_ACCOUNTIDreferenceColumnGUID :SEBL_01referenceValue : 1-114DK-9columnGUID : SEBL_VFACCOUNTNUMBERneedAnException :true
Data Source : weblogic.jdbc.common.internal.RmiDataSource@57a5872d [weblogic.jdbc.wrapper.JTAConnection_weblogic_jdbc_wrapper_XAConnection_oracle_jdbc_driver_LogicalConnection-jdbc/xref-449442, oracle.jdbc.driver.LogicalConnection@5feba018]
valueToReturn : 682502720
xrefTable: XREF_CP_ACCOUNTID referenceColumnName: SEBL_01 columnName: SEBL_VFACCOUNTNUMBER referenceValue: 1-114DK-9
DB Query Start : tableGUID :XREF_CP_ACCOUNTIDreferenceColumnGUID :SEBL_01referenceValue : 1-114DK-9columnGUID : SEBL_VFACCOUNTNUMBERneedAnException :true
Data Source : weblogic.jdbc.common.internal.RmiDataSource@57a5872d [weblogic.jdbc.wrapper.JTAConnection_weblogic_jdbc_wrapper_XAConnection_oracle_jdbc_driver_LogicalConnection-jdbc/xref-449444, oracle.jdbc.driver.LogicalConnection@74bb57dd]
valueToReturn : 682502720
xrefTable: XREF_CP_ACCOUNTID referenceColumnName: SEBL_01 columnName: SEBL_VFACCOUNTNUMBER referenceValue: 1-114DK-9
DB Query Start : tableGUID :XREF_CP_ACCOUNTIDreferenceColumnGUID :SEBL_01referenceValue : 1-114DK-9columnGUID : SEBL_VFACCOUNTNUMBERneedAnException :true
Data Source : weblogic.jdbc.common.internal.RmiDataSource@57a5872d [weblogic.jdbc.wrapper.JTAConnection_weblogic_jdbc_wrapper_XAConnection_oracle_jdbc_driver_LogicalConnection-jdbc/xref-449446, oracle.jdbc.driver.LogicalConnection@45681b5f]
valueToReturn : 682502720
xrefTable: XREF_CP_ACCOUNTID referenceColumnName: SEBL_01 columnName: SEBL_VFACCOUNTNUMBER referenceValue: 1-114DK-9
DB Query Start : tableGUID :XREF_CP_ACCOUNTIDreferenceColumnGUID :SEBL_01referenceValue : 1-114DK-9columnGUID : SEBL_VFACCOUNTNUMBERneedAnException :true
Data Source : weblogic.jdbc.common.internal.RmiDataSource@57a5872d [weblogic.jdbc.wrapper.JTAConnection_weblogic_jdbc_wrapper_XAConnection_oracle_jdbc_driver_LogicalConnection-jdbc/xref-449448, oracle.jdbc.driver.LogicalConnection@574f3caf]
valueToReturn : 682502720
xrefTable: XREF_CP_ACCOUNTID referenceColumnName: SEBL_01 columnName: SEBL_VFACCOUNTNUMBER referenceValue: 1-114DK-9
DB Query Start : tableGUID :XREF_CP_ACCOUNTIDreferenceColumnGUID :SEBL_01referenceValue : 1-114DK-9columnGUID : SEBL_VFACCOUNTNUMBERneedAnException :true
Data Source : weblogic.jdbc.common.internal.RmiDataSource@57a5872d [weblogic.jdbc.wrapper.JTAConnection_weblogic_jdbc_wrapper_XAConnection_oracle_jdbc_driver_LogicalConnection-jdbc/xref-449450, oracle.jdbc.driver.LogicalConnection@323f15f2]
valueToReturn : 682502720
xrefTable: XREF_CP_ACCOUNTID referenceColumnName: SEBL_01 columnName: SEBL_VFACCOUNTNUMBER referenceValue: 1-114DK-9
DB Query Start : tableGUID :XREF_CP_ACCOUNTIDreferenceColumnGUID :SEBL_01referenceValue : 1-114DK-9columnGUID : SEBL_VFACCOUNTNUMBERneedAnException :true
Data Source : weblogic.jdbc.common.internal.RmiDataSource@57a5872d [weblogic.jdbc.wrapper.JTAConnection_weblogic_jdbc_wrapper_XAConnection_oracle_jdbc_driver_LogicalConnection-jdbc/xref-449452, oracle.jdbc.driver.LogicalConnection@604fd12a]
valueToReturn : 682502720
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@1c9e58ba
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@1c9e58ba
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@724e66bf
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@724e66bf
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@1037a811
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@1037a811
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@623a00be
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@623a00be
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@3d75bd1b
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@3d75bd1b
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@231e2d3d
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@231e2d3d
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@7ed612
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@7ed612
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@47b00480
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@47b00480
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@677394bb
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@677394bb
[#document: null]
ERROR2
ERROR3
xmlDoc :oracle.xml.parser.v2.XMLDocument@ed6957e
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@6e210726
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@6e210726
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@47ea92cc
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@47ea92cc
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@31656402
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@31656402
[#document: null]
ERROR2
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@66c39a02
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@66c39a02
ERROR3
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@5e2f9daf
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@5e2f9daf
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@4080ed0
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@4080ed0
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@58cb2712
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@58cb2712
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@140f18c1
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@140f18c1
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@a334e8e
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@a334e8e
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@60ee7c69
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@60ee7c69
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@707c59bf
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@707c59bf
[#document: null]
ERROR2
ERROR3
xrefTable: oramds:/apps/AIAMetaData/xref/ITEM_ITEMID.xref referenceColumnName: SEBL_01 columnName: INTEGRATION_ID referenceValue: 1-6RDM18A
In side DatabaseRepository.java xrefTable: oramds:/apps/AIAMetaData/xref/ITEM_ITEMID.xref referenceColumnName: SEBL_01 columnName: INTEGRATION_ID referenceValue: 1-6RDM18A
[weblogic.jdbc.wrapper.JTAConnection_weblogic_jdbc_wrapper_XAConnection_oracle_jdbc_driver_LogicalConnection-jdbc/xref-449454, oracle.jdbc.driver.LogicalConnection@5f0dc4ab]
xrefTable: oramds:/apps/AIAMetaData/xref/ITEM_ITEMID.xref referenceColumnName: SEBL_01 columnName: INTEGRATION_ID referenceValue: 1-6RDM18A
In side DatabaseRepository.java xrefTable: oramds:/apps/AIAMetaData/xref/ITEM_ITEMID.xref referenceColumnName: SEBL_01 columnName: INTEGRATION_ID referenceValue: 1-6RDM18A
[weblogic.jdbc.wrapper.JTAConnection_weblogic_jdbc_wrapper_XAConnection_oracle_jdbc_driver_LogicalConnection-jdbc/xref-449456, oracle.jdbc.driver.LogicalConnection@785418ae]
xrefTable: XREF_CP_ACCOUNTID referenceColumnName: SEBL_VFACCOUNTNUMBER columnName: SEBL_01 referenceValue: 7082220024
DB Query Start : tableGUID :XREF_CP_ACCOUNTIDreferenceColumnGUID :SEBL_VFACCOUNTNUMBERreferenceValue : 7082220024columnGUID : SEBL_01needAnException :false
Data Source : weblogic.jdbc.common.internal.RmiDataSource@57a5872d [weblogic.jdbc.wrapper.JTAConnection_weblogic_jdbc_wrapper_XAConnection_oracle_jdbc_driver_LogicalConnection-jdbc/xref-449458, oracle.jdbc.driver.LogicalConnection@3362807]
valueToReturn : 1-V97LC4J0
xrefTable: oramds:/apps/AIAMetaData/xref/ITEM_ITEMID.xref referenceColumnName: SEBL_01 columnName: INTEGRATION_ID referenceValue: 1-6RDM18A
In side DatabaseRepository.java xrefTable: oramds:/apps/AIAMetaData/xref/ITEM_ITEMID.xref referenceColumnName: SEBL_01 columnName: INTEGRATION_ID referenceValue: 1-6RDM18A
[weblogic.jdbc.wrapper.JTAConnection_weblogic_jdbc_wrapper_XAConnection_oracle_jdbc_driver_LogicalConnection-jdbc/xref-449460, oracle.jdbc.driver.LogicalConnection@20d65ed5]
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@58a783c0
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@58a783c0
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@7b354c6c
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@7b354c6c
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@6ba09b97
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@6ba09b97
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@71db5e11
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@71db5e11
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@6f1cf207
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@6f1cf207
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@4d390b11
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@4d390b11
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@2c7b69e6
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@2c7b69e6
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@63010dd
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@63010dd
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@5b975e46
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@5b975e46
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@6b41379c
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@6b41379c
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@661af2a3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@661af2a3
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@64ef6352
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@64ef6352
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@62414fa4
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@62414fa4
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@4caa13b4
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@4caa13b4
[#document: null]
ERROR2
ERROR3
xrefTable: XREF_CP_ACCOUNTID referenceColumnName: SEBL_VFACCOUNTNUMBER columnName: SEBL_01 referenceValue: 7026213698
DB Query Start : tableGUID :XREF_CP_ACCOUNTIDreferenceColumnGUID :SEBL_VFACCOUNTNUMBERreferenceValue : 7026213698columnGUID : SEBL_01needAnException :true
Data Source : weblogic.jdbc.common.internal.RmiDataSource@57a5872d [weblogic.jdbc.wrapper.JTAConnection_weblogic_jdbc_wrapper_XAConnection_oracle_jdbc_driver_LogicalConnection-jdbc/xref-449462, oracle.jdbc.driver.LogicalConnection@5ea149e1]
valueToReturn : 1-5WZVQZA9
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@41645ba3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@41645ba3
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@7542f754
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@7542f754
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@132339e0
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@132339e0
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@3bd05a21
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@3bd05a21
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@4aa04b14
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@4aa04b14
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@62994d8a
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@62994d8a
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@69811cfe
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@69811cfe
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@2ef89b29
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@2ef89b29
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@5f3f1e6a
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@5f3f1e6a
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@2a87ff6
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@2a87ff6
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@467eac0f
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@467eac0f
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@7c74886
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@7c74886
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@397f0879
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@397f0879
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@766b483
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@766b483
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@56a556d7
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@56a556d7
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@42714edc
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@42714edc
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@40031416
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@40031416
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@477cc4f0
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@477cc4f0
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@2441fac5
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@2441fac5
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@7b0ba84b
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@7b0ba84b
[#document: null]
ERROR2
ERROR3
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@7098e6fd
org.apache.xmlbeans.impl.store.Saver$InputStreamSaver@7098e6fd
[#document: null]
ERROR2
ERROR3
xmlDoc :oracle.xml.parser.v2.XMLDocument@6ade23b2
xmlDoc :oracle.xml.parser.v2.XMLDocument@1a289519

case#3

[oracle@k8s-registry wlsanalytics]$ wlsanalytics log index gade51 --stdout
index_id    : gade51
log_file    : /u01/oracle/wlsanalytics/data/osb/osb_server2/logs_bck/osb_server2.out00001
index_file  : /u01/oracle/wlsanalytics/data/index/wlsa-soaerrors-806.index

<Jul 23, 2021 10:20:04,450 AM UTC> <Error> <oracle.soa.adapter.db.inbound> <BEA-000000> <[service_name: Services/Industry/Communications/Northbound/RequestorABCS/SIEBEL/proxy/CheckReccuringProductsReqABCSV1] unable to build the TopLink Session> [oracle@k8s-registry wlsanalytics]$

Regards, Piotr

tomvit commented 8 months ago

The case 1 and case 2 should be fixed in https://github.com/ailog-analytics/wls-analytics/commit/88b2f2d907740b09f71a052594ba4a30521f1817.

For the case 3, there is the following pattern I use and it works fine in regexp101:

^\s*<\[service_name: ([A-Za-z\/0-9_]+)\]

Not sure why it does not work, will need to check directly with the data.

Michalski-Piotr commented 8 months ago

Hello, case 3 fix is working fine:


[oracle@k8s-registry wlsanalytics]$ wlsanalytics log out -c config/config.yaml -f "2021-07-23 10:20:00" -t "2021-07-23 10:21:26" osb --index
-- Time range: 2021-07-23 10:20:00 - 2021-07-23 10:21:26
-- The index will be created.
-- Searching files in the set 'osb'
-- Reading entries from 1 files:   1%|▏                        | 33.7k/4.20M [00:01<02:59, 24.4kB/s]
-- Completed in 1.44s
TIME                        SERVER       COMPONENT      CODE        SERVICE                          ERROR                        DETAIL
2021-07-23 10:20:04.446000  osb_server2  toplinkall     BEA-000000  CheckReccuringProductsReqABCSV1  NAME_NOT_FOUND_EXCEPTION     eis.SIE
2021-07-23 10:20:04.450000  osb_server2  inbound        BEA-000000  CheckReccuringProductsReqABCSV1  DB_ADAPTER_ERROR             CheckRe

But I noticed new issue, the Service is "The":


TIME                        SERVER       COMPONENT      CODE        SERVICE                          ERROR                        DETAIL
2021-07-23 10:20:31.919000  osb_server2  policymanager  WSM-02313   The                              WSM_POLICY_ERROR             LOCKED_

index:


[oracle@k8s-registry wlsanalytics]$ wlsanalytics log index copi43 --stdout
index_id    : copi43
log_file    : /u01/oracle/wlsanalytics/data/osb/osb_server2/logs_bck/osb_server2.out00001
index_file  : /u01/oracle/wlsanalytics/data/index/wlsa-56.index

<Jul 23, 2021 10:20:31,919 AM UTC> <Error> <oracle.wsm.resources.policymanager> <WSM-02313> <The documents used by a policy subject cannot be recorded due to underlying error "invoking method recordUsage(Ljava.lang.String;Ljava.util.Map;Ljava.util.Set;) caused java.io.IOException: WSM-04672 : The document "/policyAttachments/oracle/wss10_saml_token_client_policy" cannot be written to repository due to underlying error "oracle.mds.persistence.MDSIOException: MDS-00522: failure to save document /policyAttachments/oracle/wss10_saml_token_client_policy to the metadata repository
MDS-00557: Resource /policyAttachments/oracle/wss10_saml_token_client_policy is already locked or is being modified."., please check method's implementation for the cause ; nested exception is:
        java.io.IOException: WSM-04672 : The document "/policyAttachments/oracle/wss10_saml_token_client_policy" cannot be written to repository due to underlying error "oracle.mds.persistence.MDSIOException: MDS-00522: failure to save document /policyAttachments/oracle/wss10_saml_token_client_policy to the metadata repository
MDS-00557: Resource /policyAttachments/oracle/wss10_saml_token_client_policy is already locked or is being modified."."
java.rmi.UnmarshalException: invoking method recordUsage(Ljava.lang.String;Ljava.util.Map;Ljava.util.Set;) caused java.io.IOException: WSM-04672 : The document "/policyAttachments/oracle/wss10_saml_token_client_policy" cannot be written to repository due to underlying error "oracle.mds.persistence.MDSIOException: MDS-00522: failure to save document /policyAttachments/oracle/wss10_saml_token_client_policy to the metadata repository
MDS-00557: Resource /policyAttachments/oracle/wss10_saml_token_client_policy is already locked or is being modified."., please check method's implementation for the cause ; nested exception is:
        java.io.IOException: WSM-04672 : The document "/policyAttachments/oracle/wss10_saml_token_client_policy" cannot be written to repository due to underlying error "oracle.mds.persistence.MDSIOException: MDS-00522: failure to save document /policyAttachments/oracle/wss10_saml_token_client_policy to the metadata repository
MDS-00557: Resource /policyAttachments/oracle/wss10_saml_token_client_policy is already locked or is being modified.".
        at weblogic.rmi.cluster.ClusterableRemoteRef.invoke(ClusterableRemoteRef.java:564)
        at weblogic.rmi.cluster.ClusterableRemoteRef.invoke(ClusterableRemoteRef.java:313)
        at oracle.wsm.policymanager.bean.ejb.impl.UsageTracker_oi3aq7_IRemoteUsageTrackerImpl_12214_WLStub.recordUsage(Unknown Source)
        at oracle.wsm.policymanager.client.UsageTrackerDelegate$5.run(UsageTrackerDelegate.java:200)
        at java.security.AccessController.doPrivileged(Native Method)
        at oracle.security.jps.util.JpsSubject.doAsPrivileged(JpsSubject.java:314)
        at oracle.security.jps.internal.jaas.AccActionExecutor.execute(AccActionExecutor.java:70)
        at oracle.security.jps.internal.jaas.AbstractSubjectSecurity$ActionExecutorWrapper.execute(AbstractSubjectSecurity.java:282)
        at oracle.security.jps.internal.jaas.CascadeActionExecutor$SubjectPrivilegedExceptionAction.run(CascadeActionExecutor.java:82)
        at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:386)
        at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:163)
        at weblogic.security.Security.runAs(Security.java:62)
        at oracle.security.jps.wls.jaas.WlsActionExecutor.execute(WlsActionExecutor.java:50)
        at oracle.security.jps.internal.jaas.CascadeActionExecutor.execute(CascadeActionExecutor.java:55)
        at oracle.security.jps.internal.jaas.AbstractSubjectSecurity$ActionExecutorWrapper.execute(AbstractSubjectSecurity.java:282)
        at oracle.wsm.policymanager.client.UsageTrackerDelegate.recordUsage(UsageTrackerDelegate.java:197)
        at oracle.wsm.policymanager.accessor.BeanAccessor$3.invoke(BeanAccessor.java:2623)
        at oracle.wsm.policymanager.accessor.BeanAccessor$BeanInvoker.<init>(BeanAccessor.java:381)
        at oracle.wsm.policymanager.accessor.BeanAccessor$BeanInvoker.<init>(BeanAccessor.java:345)
        at oracle.wsm.policymanager.accessor.BeanAccessor$3.<init>(BeanAccessor.java:2617)
        at oracle.wsm.policymanager.accessor.BeanAccessor.persistUsage(BeanAccessor.java:2614)
        at oracle.wsm.policymanager.accessor.BeanAccessor.access$3400(BeanAccessor.java:275)
        at oracle.wsm.policymanager.accessor.BeanAccessor$UsageUpdaterTask.updateUsage(BeanAccessor.java:1204)
        at oracle.wsm.policymanager.accessor.BeanAccessor$UsageUpdaterTask.run(BeanAccessor.java:1192)
        at oracle.wsm.common.scheduler.TimerManagerWrapper$TimerListenerImpl.timerExpired(TimerManagerWrapper.java:66)
        at weblogic.timers.internal.commonj.ListenerWrap.timerExpired(ListenerWrap.java:37)
        at weblogic.timers.internal.TimerImpl.run(TimerImpl.java:301)
        at weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:681)
        at weblogic.invocation.ComponentInvocationContextManager._runAs(ComponentInvocationContextManager.java:352)
        at weblogic.invocation.ComponentInvocationContextManager.runAs(ComponentInvocationContextManager.java:337)
        at weblogic.work.LivePartitionUtility.doRunWorkUnderContext(LivePartitionUtility.java:57)
        at weblogic.work.PartitionUtility.runWorkUnderContext(PartitionUtility.java:41)
        at weblogic.work.SelfTuningWorkManagerImpl.runWorkUnderContext(SelfTuningWorkManagerImpl.java:655)
        at weblogic.work.ExecuteThread.execute(ExecuteThread.java:420)
        at weblogic.work.ExecuteThread.run(ExecuteThread.java:360)
Caused By: java.io.IOException: WSM-04672 : The document "/policyAttachments/oracle/wss10_saml_token_client_policy" cannot be written to repository due to underlying error "oracle.mds.persistence.MDSIOException: MDS-00522: failure to save document /policyAttachments/oracle/wss10_saml_token_client_policy to the metadata repository
MDS-00557: Resource /policyAttachments/oracle/wss10_saml_token_client_policy is already locked or is being modified.".
        at weblogic.rmi.internal.ServerRequest.sendReceive(ServerRequest.java:295)
        at weblogic.rmi.cluster.ClusterableRemoteRef.invoke(ClusterableRemoteRef.java:552)
        at weblogic.rmi.cluster.ClusterableRemoteRef.invoke(ClusterableRemoteRef.java:313)
        at oracle.wsm.policymanager.bean.ejb.impl.UsageTracker_oi3aq7_IRemoteUsageTrackerImpl_12214_WLStub.recordUsage(Unknown Source)
        at oracle.wsm.policymanager.client.UsageTrackerDelegate$5.run(UsageTrackerDelegate.java:200)
        at java.security.AccessController.doPrivileged(Native Method)
        at oracle.security.jps.util.JpsSubject.doAsPrivileged(JpsSubject.java:314)
        at oracle.security.jps.internal.jaas.AccActionExecutor.execute(AccActionExecutor.java:70)
        at oracle.security.jps.internal.jaas.AbstractSubjectSecurity$ActionExecutorWrapper.execute(AbstractSubjectSecurity.java:282)
        at oracle.security.jps.internal.jaas.CascadeActionExecutor$SubjectPrivilegedExceptionAction.run(CascadeActionExecutor.java:82)
        at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:386)
        at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:163)
        at weblogic.security.Security.runAs(Security.java:62)
        at oracle.security.jps.wls.jaas.WlsActionExecutor.execute(WlsActionExecutor.java:50)
        at oracle.security.jps.internal.jaas.CascadeActionExecutor.execute(CascadeActionExecutor.java:55)
        at oracle.security.jps.internal.jaas.AbstractSubjectSecurity$ActionExecutorWrapper.execute(AbstractSubjectSecurity.java:282)
        at oracle.wsm.policymanager.client.UsageTrackerDelegate.recordUsage(UsageTrackerDelegate.java:197)
        at oracle.wsm.policymanager.accessor.BeanAccessor$3.invoke(BeanAccessor.java:2623)
        at oracle.wsm.policymanager.accessor.BeanAccessor$BeanInvoker.<init>(BeanAccessor.java:381)
        at oracle.wsm.policymanager.accessor.BeanAccessor$BeanInvoker.<init>(BeanAccessor.java:345)
        at oracle.wsm.policymanager.accessor.BeanAccessor$3.<init>(BeanAccessor.java:2617)
        at oracle.wsm.policymanager.accessor.BeanAccessor.persistUsage(BeanAccessor.java:2614)
        at oracle.wsm.policymanager.accessor.BeanAccessor.access$3400(BeanAccessor.java:275)
        at oracle.wsm.policymanager.accessor.BeanAccessor$UsageUpdaterTask.updateUsage(BeanAccessor.java:1204)
        at oracle.wsm.policymanager.accessor.BeanAccessor$UsageUpdaterTask.run(BeanAccessor.java:1192)
        at oracle.wsm.common.scheduler.TimerManagerWrapper$TimerListenerImpl.timerExpired(TimerManagerWrapper.java:66)
        at weblogic.timers.internal.commonj.ListenerWrap.timerExpired(ListenerWrap.java:37)
        at weblogic.timers.internal.TimerImpl.run(TimerImpl.java:301)
        at weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:681)
        at weblogic.invocation.ComponentInvocationContextManager._runAs(ComponentInvocationContextManager.java:352)
        at weblogic.invocation.ComponentInvocationContextManager.runAs(ComponentInvocationContextManager.java:337)
        at weblogic.work.LivePartitionUtility.doRunWorkUnderContext(LivePartitionUtility.java:57)
        at weblogic.work.PartitionUtility.runWorkUnderContext(PartitionUtility.java:41)
        at weblogic.work.SelfTuningWorkManagerImpl.runWorkUnderContext(SelfTuningWorkManagerImpl.java:655)
        at weblogic.work.ExecuteThread.execute(ExecuteThread.java:420)
        at weblogic.work.ExecuteThread.run(ExecuteThread.java:360)

I will verify two remaining patterns.

Regards, Piotr

Michalski-Piotr commented 8 months ago

Hello,

[oracle@k8s-registry wlsanalytics]$ wlsanalytics log out -c config/config.yaml -f "2023-10-24 09:22:02" -t "2023-10-24 09:22:30" osb --index | grep "2023-10-24 09:22:12.684000" -- Reading entries from 9 files: 4%|▉ | 8.30M/233M [00:02<01:16, 3.07MB/s] 2023-10-24 09:22:12.684000 osb_server8 jca BEA-000000 GetFMWError OSB_SERVICE_ERROR_GetFMWError.wsdl ORA-01422 kopu39 [oracle@k8s-registry wlsanalytics]$


* case2 fix is working, entry ```2023-10-24 09:00:02.756000```:
```console
[oracle@k8s-registry wlsanalytics]$ wlsanalytics log out -c config/config.yaml -f "2023-10-24 09:00:00" -t "2023-10-24 09:01:00" osb --index
-- Time range: 2023-10-24 09:00:00 - 2023-10-24 09:01:00
-- The index will be created.
-- Searching files in the set 'osb'
-- Reading entries from 9 files:   4%|█                         | 9.87M/245M [00:03<01:18, 3.13MB/s]
-- Completed in 27.77s
TIME                        SERVER       COMPONENT       CODE        SERVICE                            ERROR                           D
2023-10-24 08:59:59.384000  osb_server6  router          OSB-382191  ProxyLogFilterV2                   INVALID_XML                     P
2023-10-24 09:00:00.883000  osb_server1  router          OSB-382191  ProxyLogFilterV2                   INVALID_XML                     P
2023-10-24 09:00:01.044000  osb_server2  router          OSB-382191  ProxyLogFilterV2                   INVALID_XML                     P
2023-10-24 09:00:02.465000  osb_server3  router          OSB-382191  ProxyLogFilterV2                   INVALID_XML                     P
2023-10-24 09:00:02.528000  osb_server8  router          OSB-382191  ProxyLogFilterV2                   INVALID_XML                     P
2023-10-24 09:00:02.756000  osb_server2  router          OSB-382191  SIEBEL_TransferContact_JMSAdapter  INVALID_XML                     S
2023-10-24 09:00:03.155000  osb_server5  router          OSB-382191  SIEBEL_TransferContact_JMSAdapter  INVALID_XML                     S

Regards, Piotr

Michalski-Piotr commented 7 months ago

Hello, I noticed two additional issues, service is "Exception" or service is "The" (this identified in the past):

> select * from osb_errors where "service"  = 'The'
name: osb_errors
time                 ServerName  bea_code  count detail                                                       error                        service
----                 ----------  --------  ----- ------                                                       -----                        -------
2023-11-24T11:14:00Z osb_server1 WSM-00279 1     http://ukcpp2crm1.vodafoneoci.com:80/eai_zd/start.swe?SWEExt EXTERNAL_SERVICE_UNAVAILABLE The
2023-11-24T11:34:00Z osb_server2 WSM-00279 1     http://ukcpp2crm1.vodafoneoci.com:80/eai_zd/start.swe?SWEExt EXTERNAL_SERVICE_UNAVAILABLE The
2023-11-24T11:37:00Z osb_server4 WSM-00279 1     http://ukcpp2crm1.vodafoneoci.com:80/eai_zd/start.swe?SWEExt EXTERNAL_SERVICE_UNAVAILABLE The
2023-11-24T14:58:00Z osb_server2 WSM-00279 1     http://ukcpp2crm1.vodafoneoci.com:80/eai_zd/start.swe?SWEExt EXTERNAL_SERVICE_UNAVAILABLE The
2023-11-24T14:58:00Z osb_server3 WSM-00279 4     http://ukcpp2crm1.vodafoneoci.com:80/eai_zd/start.swe?SWEExt EXTERNAL_SERVICE_UNAVAILABLE The
2023-11-24T14:58:00Z osb_server4 WSM-00279 1     http://ukcpp2crm1.vodafoneoci.com:80/eai_zd/start.swe?SWEExt EXTERNAL_SERVICE_UNAVAILABLE The
2023-11-24T14:59:00Z osb_server1 WSM-00279 1     http://ukcpp2crm1.vodafoneoci.com:80/eai_zd/start.swe?SWEExt EXTERNAL_SERVICE_UNAVAILABLE The

> select * from osb_errors where "service" = 'Exception'
name: osb_errors
time                 ServerName  bea_code   count detail                                                  error          service
----                 ----------  --------   ----- ------                                                  -----          -------
2023-11-23T14:21:00Z osb_server1 OSB-381304 1     HttpOutboundMessageContext.RetrieveHttpResponseWork.run SOCKET_TIMEOUT Exception
2023-11-23T15:43:00Z osb_server3 OSB-381304 1     HttpOutboundMessageContext.RetrieveHttpResponseWork.run SOCKET_TIMEOUT Exception
2023-11-24T16:52:00Z osb_server4 OSB-381304 1     HttpOutboundMessageContext.RetrieveHttpResponseWork.run SOCKET_TIMEOUT Exception
2023-11-24T16:53:00Z osb_server3 OSB-381304 1     HttpOutboundMessageContext.RetrieveHttpResponseWork.run SOCKET_TIMEOUT Exception
2023-11-24T16:53:00Z osb_server4 OSB-381304 1     HttpOutboundMessageContext.RetrieveHttpResponseWork.run SOCKET_TIMEOUT Exception
2023-11-24T16:54:00Z osb_server1 OSB-381304 3     HttpOutboundMessageContext.RetrieveHttpResponseWork.run SOCKET_TIMEOUT Exception
2023-11-24T16:54:00Z osb_server2 OSB-381304 2     HttpOutboundMessageContext.RetrieveHttpResponseWork.run SOCKET_TIMEOUT Exception
2023-11-24T16:54:00Z osb_server3 OSB-381304 1     HttpOutboundMessageContext.RetrieveHttpResponseWork.run SOCKET_TIMEOUT Exception
2023-11-24T16:54:00Z osb_server4 OSB-381304 2     HttpOutboundMessageContext.RetrieveHttpResponseWork.run SOCKET_TIMEOUT Exception
2023-11-24T16:54:00Z osb_server5 OSB-381304 2     HttpOutboundMessageContext.RetrieveHttpResponseWork.run SOCKET_TIMEOUT Exception
2023-11-24T16:57:00Z osb_server1 OSB-381304 1     HttpOutboundMessageContext.RetrieveHttpResponseWork.run SOCKET_TIMEOUT Exception
2023-11-24T16:57:00Z osb_server2 OSB-381304 2     HttpOutboundMessageContext.RetrieveHttpResponseWork.run SOCKET_TIMEOUT Exception
2023-11-24T16:57:00Z osb_server3 OSB-381304 4     HttpOutboundMessageContext.RetrieveHttpResponseWork.run SOCKET_TIMEOUT Exception
2023-11-24T16:57:00Z osb_server4 OSB-381304 1     HttpOutboundMessageContext.RetrieveHttpResponseWork.run SOCKET_TIMEOUT Exception
2023-11-24T16:57:00Z osb_server5 OSB-381304 1     HttpOutboundMessageContext.RetrieveHttpResponseWork.run SOCKET_TIMEOUT Exception
2023-11-24T17:47:00Z osb_server1 OSB-381304 1     HttpOutboundMessageContext.RetrieveHttpResponseWork.run SOCKET_TIMEOUT Exception
2023-11-27T07:13:00Z osb_server3 OSB-381304 3     HttpOutboundMessageContext.RetrieveHttpResponseWork.run SOCKET_TIMEOUT Exception
2023-11-27T07:13:00Z osb_server4 OSB-381304 2     HttpOutboundMessageContext.RetrieveHttpResponseWork.run SOCKET_TIMEOUT Exception
2023-11-27T07:13:00Z osb_server5 OSB-381304 1     HttpOutboundMessageContext.RetrieveHttpResponseWork.run SOCKET_TIMEOUT Exception
2023-11-27T07:14:00Z osb_server2 OSB-381304 2     HttpOutboundMessageContext.RetrieveHttpResponseWork.run SOCKET_TIMEOUT Exception
2023-11-27T07:27:00Z osb_server1 OSB-381304 1     HttpOutboundMessageContext.RetrieveHttpResponseWork.run SOCKET_TIMEOUT Exception
2023-11-27T07:27:00Z osb_server2 OSB-381304 1     HttpOutboundMessageContext.RetrieveHttpResponseWork.run SOCKET_TIMEOUT Exception
2023-11-27T07:27:00Z osb_server3 OSB-381304 1     HttpOutboundMessageContext.RetrieveHttpResponseWork.run SOCKET_TIMEOUT Exception
2023-11-27T07:27:00Z osb_server5 OSB-381304 1     HttpOutboundMessageContext.RetrieveHttpResponseWork.run SOCKET_TIMEOUT Exception
2023-11-27T07:42:00Z osb_server1 OSB-381304 1     HttpOutboundMessageContext.RetrieveHttpResponseWork.run SOCKET_TIMEOUT Exception

Query useful to identify all such cases (even in future):


> show tag values from osb_errors with key="service"
name: osb_errors
key     value
---     -----
service Aggregation
service BusinessEventEBSV1
service Exception
service OSM_BusinessEvent_JMSAdapter
service ProxyLogFilterV2
service SIEBEL_TransferContact_JMSAdapter
service Scheduler_HP_V1
service Scheduler_MP_V1
service The
>

Regards, Piotr

Michalski-Piotr commented 7 months ago

Hello,


<Dec 4, 2023 6:08:24,294 PM UTC> <Error> <oracle.osb.transports.main.httptransport> <OSB-381304> <Exception in HttpOutboundMessageContext.RetrieveHttpResponseWork.run: java.net.SocketTimeoutException
java.net.SocketTimeoutException
        at weblogic.net.http.SocketTimeoutNotification.<clinit>(SocketTimeoutNotification.java:27)
        at weblogic.net.http.AsyncResponseHandler$MuxableSocketHTTPAsyncResponse.handleTimeout(AsyncResponseHandler.java:409)
        at weblogic.net.http.AsyncResponseHandler$MuxableSocketHTTPAsyncResponse.timeout(AsyncResponseHandler.java:521)
        at weblogic.socket.SocketMuxer$TimerListenerImpl.timerExpired(SocketMuxer.java:1096)
        at weblogic.timers.internal.TimerImpl.run(TimerImpl.java:301)
        at weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:681)
        at weblogic.invocation.ComponentInvocationContextManager._runAs(ComponentInvocationContextManager.java:352)
        at weblogic.invocation.ComponentInvocationContextManager.runAs(ComponentInvocationContextManager.java:337)
        at weblogic.work.LivePartitionUtility.doRunWorkUnderContext(LivePartitionUtility.java:57)
        at weblogic.work.PartitionUtility.runWorkUnderContext(PartitionUtility.java:41)
        at weblogic.work.SelfTuningWorkManagerImpl.runWorkUnderContext(SelfTuningWorkManagerImpl.java:655)
        at weblogic.work.ExecuteThread.execute(ExecuteThread.java:420)
        at weblogic.work.ExecuteThread.run(ExecuteThread.java:360)
>

Regards, Piotr

tomvit commented 7 months ago

I fixed this in https://github.com/ailog-analytics/wls-analytics/commit/350b3d423117b2f7a3e88ebe063f598ee69411ab by parsing the service name only when the component is in oracle.osb.pipeline namespace.

Michalski-Piotr commented 6 months ago

Hello, The fix has been deployed 2 weeks ago and it is working fine:


> show tag values from osb_errors with key="service"
name: osb_errors
key     value
---     -----
service BusinessEventEBSV1
service OSM_BusinessEvent_JMSAdapter
service OSM_ServiceRequest_jmsAdapter
service ProxyLogFilterV2
service SIEBEL_TransferContact_JMSAdapter
service Unknown
service XRefEBSV1
>

Regards, Piotr