thegridman / coherence-k8s-example

0 stars 1 forks source link

Addition of Provision of Runtime Creation of Caches. #9

Open viju2008 opened 3 years ago

viju2008 commented 3 years ago

Hello

I started the older version of Student Storage Example and tried to go into one of the pods.

As per our functional Requirements we need Floating Caches also for storing java objects . Request to please add the same to this example.

I tried to create a new cache "newtest" and do a BULKPUT but it failed.

kubectl exec -it -n coherence-example student-storage-0 /coherence-operator/utils/runner console

Map (test): cache newtest

Cache Configuration: newtest SchemeName: db-scheme AutoStart: true ServiceName: StorageService ServiceDependencies EventDispatcherThreadPriority: 10 ThreadPriority: 10 WorkerThreadsMax: 2147483647 WorkerThreadsMin: 1 WorkerPriority: 5 ActionPolicyBuilder RulesArray (ArrayList of QuorumRule) [0] RuleElementName: distribution-quorum RuleMask: 1 [1] RuleElementName: restore-quorum RuleMask: 2 [2] RuleElementName: recover-quorum RuleMask: 16 [3] RuleElementName: read-quorum RuleMask: 4 [4] RuleElementName: write-quorum RuleMask: 8 Backups: 1 DistributionAggressiveness: 20 DistributionSynchronized: true Partitions: 257 BldrsPartitionListener AssignmentStrategyBuilder Strategy: simple TransferThreshold: 524288 DepsPersistence PersistenceBuilder: Mode: on-demand Active Location: /root/coherence/active Snapshot Location:/root/coherence/snapshots Trash Location:/root/coherence/trash Mode: on-demand StrictPartitioning: true BackingMapScheme InnerScheme (ReadWriteBackingMapScheme) CacheStoreScheme CacheStoreBuilder (ClassScheme) CustomBuilder FactoryClassName: com.oracle.coherence.examples.storage.CacheStoreFactory FactoryMethodName: createCacheStore MethodParametersList (ResolvableParameterList of Value) [0] : Value{newtest} [1] : Value{null} InternalScheme (LocalScheme) UnitFactor: 1 ExprfRollbackCacheStoreFailures: true WriteMaxBatchSize: 128

### Map (newtest): bulkput 10000 100 0 100 Sun Oct 04 12:37:04 GMT 2020: adding 10000 items (starting with #0) each 100 bytes ... 2020-10-04 12:37:04.936/127.286 Oracle Coherence CE 20.06.1 (thread=main, member=4): com.tangosol.net.RequestIncompleteException: Partial failure at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.partitionedService.PartitionedCache$BinaryMap.validatePartialResponse(PartitionedCache.CDB:56) at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.partitionedService.PartitionedCache$BinaryMap.putAll(PartitionedCache.CDB:123) at com.tangosol.util.ConverterCollections$ConverterMap.putAll(ConverterCollections.java:1803) at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.partitionedService.PartitionedCache$ViewMap.putAll(PartitionedCache.CDB:5) at com.tangosol.coherence.component.util.SafeNamedCache.putAll(SafeNamedCache.CDB:1) at com.tangosol.coherence.component.application.console.Coherence.doBulkPut(Coherence.CDB:118) at com.tangosol.coherence.component.application.console.Coherence.processCommand(Coherence.CDB:211) at com.tangosol.coherence.component.application.console.Coherence.run(Coherence.CDB:41) at com.tangosol.coherence.component.application.console.Coherence.main(Coherence.CDB:3) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:566) at com.tangosol.net.CacheFactory.main(CacheFactory.java:1058) Caused by: Portable(com.tangosol.util.WrapperException): (Wrapped: Failed request execution for StorageService service on Member(Id=3, Timestamp=2020-10-04 12:25:25.779, Address=10.244.1.27:35339, MachineId=9682, Location=site:AP-MUMBAI-1-AD-1,rack:AP-MUMBAI-1-AD-1,machine:10.0.10.4,process:29,member:student-storage-0, Role=student-storage)) null at com.tangosol.util.Base.ensureRuntimeException(Base.java:250) at com.tangosol.coherence.component.util.daemon.queueProcessor.service.Grid.tagException(Grid.CDB:61) at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.partitionedService.PartitionedCache.onPartialCommit(PartitionedCache.CDB:7) at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.partitionedService.PartitionedCache.onPutAllRequest(PartitionedCache.CDB:122) at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.partitionedService.PartitionedCache$PutAllRequest.run(PartitionedCache.CDB:1) at com.tangosol.coherence.component.util.DaemonPool$WrapperTask.run(DaemonPool.CDB:1) at com.tangosol.coherence.component.util.DaemonPool$WrapperTask.run(DaemonPool.CDB:32) at com.tangosol.coherence.component.util.daemon.queueProcessor.Service$DaemonPool$WrapperTask.run(Service.CDB:12) at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.PartitionedService$DaemonPool$WrapperTask.run(PartitionedService.CDB:1) at com.tangosol.coherence.component.util.DaemonPool$Daemon.onNotify(DaemonPool.CDB:66) at com.tangosol.coherence.component.util.Daemon.run(Daemon.CDB:54) at java.base/java.lang.Thread.run(Thread.java:834) at at com.tangosol.io.pof.ThrowablePofSerializer.deserialize(ThrowablePofSerializer.java:57) at com.tangosol.io.pof.PofBufferReader.readAsObject(PofBufferReader.java:3625) at com.tangosol.io.pof.PofBufferReader.readObject(PofBufferReader.java:2896) at com.tangosol.io.pof.ConfigurablePofContext.deserialize(ConfigurablePofContext.java:386) at com.tangosol.coherence.component.util.daemon.queueProcessor.Service.readObject(Service.CDB:1) at com.tangosol.coherence.component.net.Message.readObject(Message.CDB:1) at com.tangosol.coherence.component.net.message.responseMessage.DistributedPartialResponse.read(DistributedPartialResponse.CDB:12) at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.partitionedService.PartitionedCache$PartialValueResponse.read(PartitionedCache.CDB:4) at com.tangosol.coherence.component.util.daemon.queueProcessor.service.Grid.deserializeMessage(Grid.CDB:25) at com.tangosol.coherence.component.net.MessageHandler$Connection.prepareMessage(MessageHandler.CDB:52) at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.TransportService$MessageHandler$Connection.prepareMessage(TransportService.CDB:3) at com.tangosol.coherence.component.net.MessageHandler.processMessage(MessageHandler.CDB:31) at com.tangosol.coherence.component.net.MessageHandler$EventCollector.add(MessageHandler.CDB:51) at com.oracle.coherence.common.internal.net.socketbus.AbstractSocketBus.addEvent(AbstractSocketBus.java:857) at com.oracle.coherence.common.internal.net.socketbus.SocketMessageBus$MessageConnection$ReadBatch.onReady(SocketMessageBus.java:803) at com.oracle.coherence.common.internal.net.socketbus.SocketMessageBus$MessageConnection$ReadBatch.read(SocketMessageBus.java:645) at com.oracle.coherence.common.internal.net.socketbus.SocketMessageBus$MessageConnection.processReads(SocketMessageBus.java:212) at com.oracle.coherence.common.internal.net.socketbus.BufferedSocketBus$BufferedConnection.onReadySafe(BufferedSocketBus.java:706) at com.oracle.coherence.common.internal.net.socketbus.AbstractSocketBus$Connection.onReady(AbstractSocketBus.java:2148) at com.oracle.coherence.common.internal.net.RunnableSelectionService.process(RunnableSelectionService.java:407) at com.oracle.coherence.common.internal.net.RunnableSelectionService.run(RunnableSelectionService.java:280) at com.oracle.coherence.common.internal.net.ResumableSelectionService.run(ResumableSelectionService.java:139) at java.base/java.lang.Thread.run(Thread.java:834) Caused by: Portable(java.lang.UnsupportedOperationException) at java.base/java.util.AbstractMap.put(AbstractMap.java:209) at java.base/java.util.AbstractMap.putAll(AbstractMap.java:281) at com.tangosol.util.WrapperObservableMap.putAll(WrapperObservableMap.java:191) at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.partitionedService.PartitionedCache$Storage.putAllPrimaryResource(PartitionedCache.CDB:7) at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.partitionedService.PartitionedCache$Storage.postPutAll(PartitionedCache.CDB:27) at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.partitionedService.PartitionedCache$Storage.putAll(PartitionedCache.CDB:28) at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.partitionedService.PartitionedCache.onPutAllRequest(PartitionedCache.CDB:99) at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.partitionedService.PartitionedCache$PutAllRequest.run(PartitionedCache.CDB:1) at com.tangosol.coherence.component.util.DaemonPool$WrapperTask.run(DaemonPool.CDB:1) at com.tangosol.coherence.component.util.DaemonPool$WrapperTask.run(DaemonPool.CDB:32) at com.tangosol.coherence.component.util.daemon.queueProcessor.Service$DaemonPool$WrapperTask.run(Service.CDB:12) at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.PartitionedService$DaemonPool$WrapperTask.run(PartitionedService.CDB:1) at com.tangosol.coherence.component.util.DaemonPool$Daemon.onNotify(DaemonPool.CDB:66) at com.tangosol.coherence.component.util.Daemon.run(Daemon.CDB:54) at java.base/java.lang.Thread.run(Thread.java:834) at at com.tangosol.io.pof.ThrowablePofSerializer.deserialize(ThrowablePofSerializer.java:57) at com.tangosol.io.pof.PofBufferReader.readAsObject(PofBufferReader.java:3625) at com.tangosol.io.pof.PofBufferReader.readObject(PofBufferReader.java:2896) at com.tangosol.io.pof.PortableException.readExternal(PortableException.java:202) at com.tangosol.io.pof.ThrowablePofSerializer.deserialize(ThrowablePofSerializer.java:59) at com.tangosol.io.pof.PofBufferReader.readAsObject(PofBufferReader.java:3625) at com.tangosol.io.pof.PofBufferReader.readObject(PofBufferReader.java:2896) at com.tangosol.io.pof.ConfigurablePofContext.deserialize(ConfigurablePofContext.java:386) at com.tangosol.coherence.component.util.daemon.queueProcessor.Service.readObject(Service.CDB:1) at com.tangosol.coherence.component.net.Message.readObject(Message.CDB:1) at com.tangosol.coherence.component.net.message.responseMessage.DistributedPartialResponse.read(DistributedPartialResponse.CDB:12) at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.partitionedService.PartitionedCache$PartialValueResponse.read(PartitionedCache.CDB:4) at com.tangosol.coherence.component.util.daemon.queueProcessor.service.Grid.deserializeMessage(Grid.CDB:25) at com.tangosol.coherence.component.net.MessageHandler$Connection.prepareMessage(MessageHandler.CDB:52) at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.TransportService$MessageHandler$Connection.prepareMessage(TransportService.CDB:3) at com.tangosol.coherence.component.net.MessageHandler.processMessage(MessageHandler.CDB:31) at com.tangosol.coherence.component.net.MessageHandler$EventCollector.add(MessageHandler.CDB:51) at com.oracle.coherence.common.internal.net.socketbus.AbstractSocketBus.addEvent(AbstractSocketBus.java:857) at com.oracle.coherence.common.internal.net.socketbus.SocketMessageBus$MessageConnection$ReadBatch.onReady(SocketMessageBus.java:803) at com.oracle.coherence.common.internal.net.socketbus.SocketMessageBus$MessageConnection$ReadBatch.read(SocketMessageBus.java:645) at com.oracle.coherence.common.internal.net.socketbus.SocketMessageBus$MessageConnection.processReads(SocketMessageBus.java:212) at com.oracle.coherence.common.internal.net.socketbus.BufferedSocketBus$BufferedConnection.onReadySafe(BufferedSocketBus.java:706) at com.oracle.coherence.common.internal.net.socketbus.AbstractSocketBus$Connection.onReady(AbstractSocketBus.java:2148) at com.oracle.coherence.common.internal.net.RunnableSelectionService.process(RunnableSelectionService.java:407) at com.oracle.coherence.common.internal.net.RunnableSelectionService.run(RunnableSelectionService.java:280) at com.oracle.coherence.common.internal.net.ResumableSelectionService.run(ResumableSelectionService.java:139) at java.base/java.lang.Thread.run(Thread.java:834)

Map (newtest): 2020-10-04 12:37:25.638/147.987 Oracle Coherence CE 20.06.1 (thread=Cluster, member=4): Member(Id=2, Timestamp=2020-10-04 12:37:25.637, Address=10.244.0.40:38087, MachineId=9681, Location=site:AP-MUMBAI-1-AD-1,rack:AP-MUMBAI-1-AD-1,machine:10.0.10.3,process:30,member:student-storage-2, Role=student-storage) left Cluster with senior member 1 2020-10-04 12:37:25.639/147.988 Oracle Coherence CE 20.06.1 (thread=Invocation:Management, member=4): Member 2 left service Management with senior member 1 2020-10-04 12:37:25.640/147.989 Oracle Coherence CE 20.06.1 (thread=DistributedCache:StorageService, member=4): Member 2 left service StorageService with senior member 1

Map (newtest): 2020-10-04 12:37:25.651/148.000 Oracle Coherence CE 20.06.1 (thread=Transport:TransportService, member=4): Member 2 left service TransportService with senior member 1 2020-10-04 12:37:25.657/148.006 Oracle Coherence CE 20.06.1 (thread=Cluster, member=4): MemberLeft notification for Member(Id=2, Timestamp=2020-10-04 12:37:25.637, Address=10.244.0.40:38087, MachineId=9681, Location=site:AP-MUMBAI-1-AD-1,rack:AP-MUMBAI-1-AD-1,machine:10.0.10.3,process:30,member:student-storage-2, Role=student-storage) received from Member(Id=3, Timestamp=2020-10-04 12:25:25.779, Address=10.244.1.27:35339, MachineId=9682, Location=site:AP-MUMBAI-1-AD-1,rack:AP-MUMBAI-1-AD-1,machine:10.0.10.4,process:29,member:student-storage-0, Role=student-storage)