search

eclipse-ditto / ditto

Eclipse Ditto™: Digital Twin framework of Eclipse IoT - main repository
https://eclipse.dev/ditto/
Eclipse Public License 2.0
667 stars 218 forks source link

[Thing service] Publisher crashes with cast exception #1004

Closed mvniekerk closed 3 years ago

mvniekerk commented 3 years ago

I'm getting updater publisher crashes after each update:

2021-03-15 10:32:41,513 INFO  [] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Successfully persisted Event <things.events:featurePropertyModified>.
2021-03-15 10:32:41,516 ERROR [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - Publisher unavailable. Dropping <org.eclipse.ditto.services.utils.pubsub.actors.Publisher$Publish@d5fa7e5f>
2021-03-15 10:32:41,516 ERROR [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - Publisher unavailable. Dropping <org.eclipse.ditto.services.utils.pubsub.actors.Publisher$Publish@d5fa7e5f>
2021-03-15 10:32:43,787 DEBUG [] o.e.d.s.u.p.a.PubUpdater akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor/pubUpdater57 - started (org.eclipse.ditto.services.utils.pubsub.actors.PubUpdater@496c0f3a)
2021-03-15 10:32:43,787 DEBUG [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - now supervising Actor[akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor/pubUpdater57#-1795954696]
2021-03-15 10:32:43,787 DEBUG [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - now supervising Actor[akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor/publisher58#2118356483]
2021-03-15 10:32:43,787 DEBUG [] o.e.d.s.u.p.a.PubUpdater akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor/pubUpdater57 - now watched by Actor[akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor#-1978375204]
2021-03-15 10:32:43,787 DEBUG [] o.e.d.s.u.p.a.Publisher akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor/publisher58 - started (org.eclipse.ditto.services.utils.pubsub.actors.Publisher@fe32a091)
2021-03-15 10:32:43,788 DEBUG [] o.e.d.s.u.p.a.Publisher akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor/publisher58 - now watched by Actor[akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor#-1978375204]
2021-03-15 10:32:43,788 DEBUG [] o.e.d.s.u.p.a.Publisher akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor/publisher58 - now watched by Actor[akka://ditto-cluster/user/thingsRoot/acks-aware-ack-supervisor/ackUpdater1#1400304943]
2021-03-15 10:32:43,788 DEBUG [] o.e.d.s.u.p.a.Publisher akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor/publisher58 - now watched by Actor[akka://ditto-cluster/user/thing-event-aware-replicator#-1624380656]
2021-03-15 10:32:43,789 INFO  [] o.e.d.s.u.p.a.PubUpdater akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor/pubUpdater57 - Got <CurrentClusterState(TreeSet(Member(address = akka://ditto-cluster@10.244.0.174:2551, status = Up, roles = HashSet(thing-event-aware, acks-aware, live-signal-aware, dc-default, connectivity)), Member(address = akka://ditto-cluster@10.244.0.80:2551, status = Up, roles = Set(things, thing-event-aware, acks-aware, dc-default)), Member(address = akka://ditto-cluster@10.244.1.10:2551, status = Up, roles = HashSet(acks-aware, live-signal-aware, blocked-namespaces-aware, concierge, dc-default)), Member(address = akka://ditto-cluster@10.244.1.103:2551, status = Up, roles = Set(policies, dc-default)), Member(address = akka://ditto-cluster@10.244.1.123:2551, status = Up, roles = HashSet(thing-event-aware, acks-aware, live-signal-aware, gateway, dc-default)), Member(address = akka://ditto-cluster@10.244.1.34:2551, status = Up, roles = Set(things-search, blocked-namespaces-aware, thing-event-aware, dc-default))), Set(), HashSet(akka://ditto-cluster@10.244.1.123:2551, akka://ditto-cluster@10.244.1.103:2551, akka://ditto-cluster@10.244.0.174:2551, akka://ditto-cluster@10.244.1.10:2551, akka://ditto-cluster@10.244.1.34:2551, akka://ditto-cluster@10.244.0.80:2551), Some(akka://ditto-cluster@10.244.0.174:2551), HashMap(things-search -> Some(akka://ditto-cluster@10.244.1.34:2551), thing-event-aware -> Some(akka://ditto-cluster@10.244.0.174:2551), acks-aware -> Some(akka://ditto-cluster@10.244.0.174:2551), live-signal-aware -> Some(akka://ditto-cluster@10.244.0.174:2551), blocked-namespaces-aware -> Some(akka://ditto-cluster@10.244.1.10:2551), gateway -> Some(akka://ditto-cluster@10.244.1.123:2551), concierge -> Some(akka://ditto-cluster@10.244.1.10:2551), things -> Some(akka://ditto-cluster@10.244.0.80:2551), dc-default -> Some(akka://ditto-cluster@10.244.0.174:2551), connectivity -> Some(akka://ditto-cluster@10.244.0.174:2551), policies -> Some(akka://ditto-cluster@10.244.1.103:2551)))>
2021-03-15 10:32:43,789 DEBUG [] o.e.d.s.u.p.a.PubUpdater akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor/pubUpdater57 - now watched by Actor[akka://ditto-cluster/system/eventStreamUnsubscriber-1#-1119856457]
2021-03-15 10:32:44,167 ERROR [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - Child <Actor[akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor/publisher58#2118356483]> crashed. Restarting all children after <PT10S>
java.lang.ClassCastException: akka.util.ByteString$ByteString1C incompatible with java.lang.String
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher$$Lambda$2141/0x00000000a24369b0.apply(Unknown Source)
    at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
    at java.base/java.util.Iterator.forEachRemaining(Iterator.java:133)
    at scala.collection.convert.JavaCollectionWrappers$SetWrapper$$anon$1.forEachRemaining(JavaCollectionWrappers.scala:146)
    at java.base/java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
    at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:497)
    at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:487)
    at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
    at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:239)
    at java.base/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578)
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher.deserializeGroupedHashes(Publisher.java:190)
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher.lambda$topicSubscribersChanged$3(Publisher.java:178)
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher$$Lambda$2138/0x00000000a2407d10.apply(Unknown Source)
    at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
    at java.base/java.util.Iterator.forEachRemaining(Iterator.java:133)
    at scala.collection.convert.JavaCollectionWrappers$MapWrapper$$anon$2$$anon$3.forEachRemaining(JavaCollectionWrappers.scala:232)
    at java.base/java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
    at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:497)
    at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:487)
    at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
    at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:239)
    at java.base/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578)
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher.topicSubscribersChanged(Publisher.java:179)
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher$$Lambda$1921/0x00000000304933b0.apply(Unknown Source)
    at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
    at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
    at scala.PartialFunction.applyOrElse(PartialFunction.scala:187)
    at scala.PartialFunction.applyOrElse$(PartialFunction.scala:186)
    at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
    at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:241)
    at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:242)
    at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:242)
    at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:242)
    at akka.actor.Actor.aroundReceive(Actor.scala:537)
    at akka.actor.Actor.aroundReceive$(Actor.scala:535)
    at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
    at akka.actor.ActorCell.receiveMessage(ActorCell.scala:577)
    at akka.actor.ActorCell.invoke(ActorCell.scala:547)
    at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
    at akka.dispatch.Mailbox.run(Mailbox.scala:231)
    at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
    at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:290)
    at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1020)
    at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1656)
    at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1594)
    at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:183)
2021-03-15 10:32:44,168 ERROR [] a.a.AllForOneStrategy akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor/publisher58 - akka.util.ByteString$ByteString1C incompatible with java.lang.String
java.lang.ClassCastException: akka.util.ByteString$ByteString1C incompatible with java.lang.String
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher$$Lambda$2141/0x00000000a24369b0.apply(Unknown Source)
    at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
    at java.base/java.util.Iterator.forEachRemaining(Iterator.java:133)
    at scala.collection.convert.JavaCollectionWrappers$SetWrapper$$anon$1.forEachRemaining(JavaCollectionWrappers.scala:146)
    at java.base/java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
    at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:497)
    at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:487)
    at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
    at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:239)
    at java.base/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578)
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher.deserializeGroupedHashes(Publisher.java:190)
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher.lambda$topicSubscribersChanged$3(Publisher.java:178)
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher$$Lambda$2138/0x00000000a2407d10.apply(Unknown Source)
    at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
    at java.base/java.util.Iterator.forEachRemaining(Iterator.java:133)
    at scala.collection.convert.JavaCollectionWrappers$MapWrapper$$anon$2$$anon$3.forEachRemaining(JavaCollectionWrappers.scala:232)
    at java.base/java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
    at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:497)
    at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:487)
    at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
    at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:239)
    at java.base/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578)
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher.topicSubscribersChanged(Publisher.java:179)
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher$$Lambda$1921/0x00000000304933b0.apply(Unknown Source)
    at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
    at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
    at scala.PartialFunction.applyOrElse(PartialFunction.scala:187)
    at scala.PartialFunction.applyOrElse$(PartialFunction.scala:186)
    at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
    at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:241)
    at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:242)
    at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:242)
    at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:242)
    at akka.actor.Actor.aroundReceive(Actor.scala:537)
    at akka.actor.Actor.aroundReceive$(Actor.scala:535)
    at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
    at akka.actor.ActorCell.receiveMessage(ActorCell.scala:577)
    at akka.actor.ActorCell.invoke(ActorCell.scala:547)
    at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
    at akka.dispatch.Mailbox.run(Mailbox.scala:231)
    at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
    at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:290)
    at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1020)
    at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1656)
    at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1594)
    at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:183)
2021-03-15 10:32:44,168 DEBUG [] o.e.d.s.u.p.a.PubUpdater akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor/pubUpdater57 - stopped
2021-03-15 10:32:44,168 DEBUG [] o.e.d.s.u.p.a.Publisher akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor/publisher58 - stopped
2021-03-15 10:32:44,168 ERROR [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - Updater terminated, restart scheduled: <Actor[akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor/pubUpdater57#-1795954696]>
2021-03-15 10:32:44,167 ERROR [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - Child <Actor[akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor/publisher58#2118356483]> crashed. Restarting all children after <PT10S>
java.lang.ClassCastException: akka.util.ByteString$ByteString1C incompatible with java.lang.String
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher$$Lambda$2141/0x00000000a24369b0.apply(Unknown Source)
    at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
    at java.base/java.util.Iterator.forEachRemaining(Iterator.java:133)
    at scala.collection.convert.JavaCollectionWrappers$SetWrapper$$anon$1.forEachRemaining(JavaCollectionWrappers.scala:146)
    at java.base/java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
    at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:497)
    at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:487)
    at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
    at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:239)
    at java.base/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578)
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher.deserializeGroupedHashes(Publisher.java:190)
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher.lambda$topicSubscribersChanged$3(Publisher.java:178)
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher$$Lambda$2138/0x00000000a2407d10.apply(Unknown Source)
    at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
    at java.base/java.util.Iterator.forEachRemaining(Iterator.java:133)
    at scala.collection.convert.JavaCollectionWrappers$MapWrapper$$anon$2$$anon$3.forEachRemaining(JavaCollectionWrappers.scala:232)
    at java.base/java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
    at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:497)
    at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:487)
    at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
    at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:239)
    at java.base/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578)
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher.topicSubscribersChanged(Publisher.java:179)
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher$$Lambda$1921/0x00000000304933b0.apply(Unknown Source)
    at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
    at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
    at scala.PartialFunction.applyOrElse(PartialFunction.scala:187)
    at scala.PartialFunction.applyOrElse$(PartialFunction.scala:186)
    at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
    at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:241)
    at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:242)
    at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:242)
    at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:242)
    at akka.actor.Actor.aroundReceive(Actor.scala:537)
    at akka.actor.Actor.aroundReceive$(Actor.scala:535)
    at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
    at akka.actor.ActorCell.receiveMessage(ActorCell.scala:577)
    at akka.actor.ActorCell.invoke(ActorCell.scala:547)
    at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
    at akka.dispatch.Mailbox.run(Mailbox.scala:231)
    at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
    at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:290)
    at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1020)
    at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1656)
    at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1594)
    at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:183)
2021-03-15 10:32:44,168 ERROR [] a.a.AllForOneStrategy akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor/publisher58 - akka.util.ByteString$ByteString1C incompatible with java.lang.String
java.lang.ClassCastException: akka.util.ByteString$ByteString1C incompatible with java.lang.String
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher$$Lambda$2141/0x00000000a24369b0.apply(Unknown Source)
    at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
    at java.base/java.util.Iterator.forEachRemaining(Iterator.java:133)
    at scala.collection.convert.JavaCollectionWrappers$SetWrapper$$anon$1.forEachRemaining(JavaCollectionWrappers.scala:146)
    at java.base/java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
    at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:497)
    at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:487)
    at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
    at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:239)
    at java.base/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578)
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher.deserializeGroupedHashes(Publisher.java:190)
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher.lambda$topicSubscribersChanged$3(Publisher.java:178)
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher$$Lambda$2138/0x00000000a2407d10.apply(Unknown Source)
    at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
    at java.base/java.util.Iterator.forEachRemaining(Iterator.java:133)
    at scala.collection.convert.JavaCollectionWrappers$MapWrapper$$anon$2$$anon$3.forEachRemaining(JavaCollectionWrappers.scala:232)
    at java.base/java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
    at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:497)
    at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:487)
    at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
    at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:239)
    at java.base/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578)
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher.topicSubscribersChanged(Publisher.java:179)
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher$$Lambda$1921/0x00000000304933b0.apply(Unknown Source)
    at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
    at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
    at scala.PartialFunction.applyOrElse(PartialFunction.scala:187)
    at scala.PartialFunction.applyOrElse$(PartialFunction.scala:186)
    at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
    at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:241)
    at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:242)
    at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:242)
    at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:242)
    at akka.actor.Actor.aroundReceive(Actor.scala:537)
    at akka.actor.Actor.aroundReceive$(Actor.scala:535)
    at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
    at akka.actor.ActorCell.receiveMessage(ActorCell.scala:577)
    at akka.actor.ActorCell.invoke(ActorCell.scala:547)
    at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
    at akka.dispatch.Mailbox.run(Mailbox.scala:231)
    at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
    at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:290)
    at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1020)
    at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1656)
    at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1594)
    at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:183)
2021-03-15 10:32:44,168 ERROR [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - Updater terminated, restart scheduled: <Actor[akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor/pubUpdater57#-1795954696]>

This causes https://github.com/eclipse/ditto/issues/1001

mvniekerk commented 3 years ago

Trace logs - (I couldn't find an attach button so not to clog this page with logs)

2021-03-15 10:40:33,654 TRACE [] o.e.d.s.u.c.AbstractJsonifiableWithDittoHeadersSerializer  - fromBinary CBOR which got 'in': A26C646974746F48656164657273AE686D7174742E716F736130781B646974746F2D726561642D7265766F6B65642D7375626A65637473806E636F7272656C6174696F6E2D6964782432343262376261662D313133652D343661662D623334362D3739636363366564666338646B6D7174742E72657461696E6566616C73656A6D7174742E746F706963782E6170706C69636174696F6E2F312F6465766963652F356530636661643537346163323737322F6576656E742F75706E7265717565737465642D61636B73806C646974746F2D6F726967696E781E6368697270737461636B2D636F6E6E656374696F6E2D7669612D6D717474781C646974746F2D696E626F756E642D7061796C6F61642D6D6170706572726368697270737461636B2D6D617070696E676849662D4D61746368612A71726573706F6E73652D7265717569726564F470646974746F2D6F726967696E61746F72782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D64663537343431323038326172646974746F2D617574682D636F6E74657874A26474797065781C7072652D61757468656E746963617465642D636F6E6E656374696F6E687375626A6563747381782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D64663537343431323038326173646974746F2D726561642D7375626A6563747382782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D646635373434313230383261782F617574687A3170726F643A39316632386433372D353765322D343963322D383136352D3437353361663564333639626F646974746F2D656E746974792D6964783D7A612E636F2E61677269696F2E7069766F743A70726F64312D66666135313538652D343562612D343134352D383338612D303064626561383466353738677061796C6F6164A46474797065781D7468696E67732E636F6D6D616E64733A6D6F6469667946656174757265677468696E674964783D7A612E636F2E61677269696F2E7069766F743A70726F64312D66666135313538652D343562612D343134352D383338612D303064626561383466353738696665617475726549646573706565646766656174757265A26F5F5F736368656D6156657273696F6E026A70726F70657274696573A16D636F6E66696775726174696F6EA3626F6EF4687468726F74746C65183263776574F4
2021-03-15 10:40:33,656 DEBUG [] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Handling by strategy: <ModifyFeature [type=things.commands:modifyFeature, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=242b7baf-113e-46af-b346-79ccc6edfc8d, mqtt.retain=false, mqtt.topic=application/1/device/5e0cfad574ac2772/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, feature=ImmutableFeature [featureId=speed, definition=null, properties={"configuration":{"on":false,"throttle":50,"wet":false}}, desiredProperties=null]]>
2021-03-15 10:40:33,656 DEBUG [242b7baf-113e-46af-b346-79ccc6edfc8d] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Applying command <ModifyFeature [type=things.commands:modifyFeature, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=242b7baf-113e-46af-b346-79ccc6edfc8d, mqtt.retain=false, mqtt.topic=application/1/device/5e0cfad574ac2772/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, feature=ImmutableFeature [featureId=speed, definition=null, properties={"configuration":{"on":false,"throttle":50,"wet":false}}, desiredProperties=null]]>
2021-03-15 10:40:33,656 DEBUG [242b7baf-113e-46af-b346-79ccc6edfc8d] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Applying command <ModifyFeature [type=things.commands:modifyFeature, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=242b7baf-113e-46af-b346-79ccc6edfc8d, mqtt.retain=false, mqtt.topic=application/1/device/5e0cfad574ac2772/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, feature=ImmutableFeature [featureId=speed, definition=null, properties={"configuration":{"on":false,"throttle":50,"wet":false}}, desiredProperties=null]]>
2021-03-15 10:40:33,670 ERROR [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - Publisher unavailable. Dropping <org.eclipse.ditto.services.utils.pubsub.actors.Publisher$Publish@5c316a8>
2021-03-15 10:40:33,657 DEBUG [242b7baf-113e-46af-b346-79ccc6edfc8d] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Validating conditional headers with currentETagValue <"hash:678c629f"> on command <ModifyFeature [type=things.commands:modifyFeature, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=242b7baf-113e-46af-b346-79ccc6edfc8d, mqtt.retain=false, mqtt.topic=application/1/device/5e0cfad574ac2772/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, feature=ImmutableFeature [featureId=speed, definition=null, properties={"configuration":{"on":false,"throttle":50,"wet":false}}, desiredProperties=null]]>.
2021-03-15 10:40:33,657 DEBUG [242b7baf-113e-46af-b346-79ccc6edfc8d] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Validating conditional headers succeeded.
2021-03-15 10:40:33,657 DEBUG [242b7baf-113e-46af-b346-79ccc6edfc8d] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Applying command <ModifyFeature [type=things.commands:modifyFeature, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=242b7baf-113e-46af-b346-79ccc6edfc8d, mqtt.retain=false, mqtt.topic=application/1/device/5e0cfad574ac2772/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, feature=ImmutableFeature [featureId=speed, definition=null, properties={"configuration":{"on":false,"throttle":50,"wet":false}}, desiredProperties=null]]>
2021-03-15 10:40:33,659 TRACE [] o.e.d.s.u.c.AbstractJsonifiableWithDittoHeadersSerializer  - fromBinary CBOR which got 'in': A26C646974746F48656164657273AE686D7174742E716F736130781B646974746F2D726561642D7265766F6B65642D7375626A65637473806E636F7272656C6174696F6E2D6964782462616135333036652D613635342D346237382D623833652D3466333164336134623662626B6D7174742E72657461696E6566616C73656A6D7174742E746F706963782E6170706C69636174696F6E2F312F6465766963652F356530636661643537346163323737322F6576656E742F75706E7265717565737465642D61636B73806C646974746F2D6F726967696E781E6368697270737461636B2D636F6E6E656374696F6E2D7669612D6D717474781C646974746F2D696E626F756E642D7061796C6F61642D6D6170706572726368697270737461636B2D6D617070696E676849662D4D61746368612A71726573706F6E73652D7265717569726564F470646974746F2D6F726967696E61746F72782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D64663537343431323038326172646974746F2D617574682D636F6E74657874A26474797065781C7072652D61757468656E746963617465642D636F6E6E656374696F6E687375626A6563747381782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D64663537343431323038326173646974746F2D726561642D7375626A6563747382782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D646635373434313230383261782F617574687A3170726F643A39316632386433372D353765322D343963322D383136352D3437353361663564333639626F646974746F2D656E746974792D6964783D7A612E636F2E61677269696F2E7069766F743A70726F64312D66666135313538652D343562612D343134352D383338612D303064626561383466353738677061796C6F6164A46474797065781D7468696E67732E636F6D6D616E64733A6D6F6469667946656174757265677468696E674964783D7A612E636F2E61677269696F2E7069766F743A70726F64312D66666135313538652D343562612D343134352D383338612D303064626561383466353738696665617475726549646870726573737572656766656174757265A26F5F5F736368656D6156657273696F6E026A70726F70657274696573A36576616C7565FB3FE162FC844A7CFC687761726E5F6C6F77F4697761726E5F68696768F4
2021-03-15 10:40:33,661 DEBUG [242b7baf-113e-46af-b346-79ccc6edfc8d] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Persisting Event <things.events:featureModified>.
2021-03-15 10:40:33,667 TRACE [] o.e.d.s.u.c.AbstractJsonifiableWithDittoHeadersSerializer  - fromBinary CBOR which got 'in': A26C646974746F48656164657273AE686D7174742E716F736130781B646974746F2D726561642D7265766F6B65642D7375626A65637473806E636F7272656C6174696F6E2D6964782464363935623231352D306366642D346132662D386638342D3930383332313762613062616B6D7174742E72657461696E6566616C73656A6D7174742E746F706963782E6170706C69636174696F6E2F312F6465766963652F356530636661643537346163323737322F6576656E742F75706E7265717565737465642D61636B73806C646974746F2D6F726967696E781E6368697270737461636B2D636F6E6E656374696F6E2D7669612D6D717474781C646974746F2D696E626F756E642D7061796C6F61642D6D6170706572726368697270737461636B2D6D617070696E676849662D4D61746368612A71726573706F6E73652D7265717569726564F470646974746F2D6F726967696E61746F72782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D64663537343431323038326172646974746F2D617574682D636F6E74657874A26474797065781C7072652D61757468656E746963617465642D636F6E6E656374696F6E687375626A6563747381782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D64663537343431323038326173646974746F2D726561642D7375626A6563747382782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D646635373434313230383261782F617574687A3170726F643A39316632386433372D353765322D343963322D383136352D3437353361663564333639626F646974746F2D656E746974792D6964783D7A612E636F2E61677269696F2E7069766F743A70726F64312D66666135313538652D343562612D343134352D383338612D303064626561383466353738677061796C6F6164A5647479706578257468696E67732E636F6D6D616E64733A6D6F646966794665617475726550726F7065727479677468696E674964783D7A612E636F2E61677269696F2E7069766F743A70726F64312D66666135313538652D343562612D343134352D383338612D3030646265613834663537386966656174757265496469646972656374696F6E6870726F706572747978182F636F6E66696775726174696F6E2F636C6F636B776973656576616C7565F5
2021-03-15 10:40:33,668 TRACE [] o.e.d.s.u.m.i.t.StoppedKamonTimer  - Timer with name <akka-persistence-mongo.journal.scala-official.write.append> and segment <overall> was stopped after <5319567> nanoseconds
2021-03-15 10:40:33,668 INFO  [] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Successfully persisted Event <things.events:featureModified>.
2021-03-15 10:40:33,670 ERROR [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - Publisher unavailable. Dropping <org.eclipse.ditto.services.utils.pubsub.actors.Publisher$Publish@5c316a8>
2021-03-15 10:40:33,670 DEBUG [] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Handling by strategy: <ModifyFeature [type=things.commands:modifyFeature, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=baa5306e-a654-4b78-b83e-4f31d3a4b6bb, mqtt.retain=false, mqtt.topic=application/1/device/5e0cfad574ac2772/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, feature=ImmutableFeature [featureId=pressure, definition=null, properties={"value":0.5433333,"warn_low":false,"warn_high":false}, desiredProperties=null]]>
2021-03-15 10:40:33,670 DEBUG [baa5306e-a654-4b78-b83e-4f31d3a4b6bb] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Applying command <ModifyFeature [type=things.commands:modifyFeature, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=baa5306e-a654-4b78-b83e-4f31d3a4b6bb, mqtt.retain=false, mqtt.topic=application/1/device/5e0cfad574ac2772/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, feature=ImmutableFeature [featureId=pressure, definition=null, properties={"value":0.5433333,"warn_low":false,"warn_high":false}, desiredProperties=null]]>
2021-03-15 10:40:33,670 DEBUG [baa5306e-a654-4b78-b83e-4f31d3a4b6bb] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Applying command <ModifyFeature [type=things.commands:modifyFeature, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=baa5306e-a654-4b78-b83e-4f31d3a4b6bb, mqtt.retain=false, mqtt.topic=application/1/device/5e0cfad574ac2772/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, feature=ImmutableFeature [featureId=pressure, definition=null, properties={"value":0.5433333,"warn_low":false,"warn_high":false}, desiredProperties=null]]>
2021-03-15 10:40:33,671 DEBUG [baa5306e-a654-4b78-b83e-4f31d3a4b6bb] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Validating conditional headers with currentETagValue <"hash:c39846ac"> on command <ModifyFeature [type=things.commands:modifyFeature, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=baa5306e-a654-4b78-b83e-4f31d3a4b6bb, mqtt.retain=false, mqtt.topic=application/1/device/5e0cfad574ac2772/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, feature=ImmutableFeature [featureId=pressure, definition=null, properties={"value":0.5433333,"warn_low":false,"warn_high":false}, desiredProperties=null]]>.
2021-03-15 10:40:33,671 DEBUG [baa5306e-a654-4b78-b83e-4f31d3a4b6bb] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Validating conditional headers succeeded.
2021-03-15 10:40:33,671 DEBUG [baa5306e-a654-4b78-b83e-4f31d3a4b6bb] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Applying command <ModifyFeature [type=things.commands:modifyFeature, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=baa5306e-a654-4b78-b83e-4f31d3a4b6bb, mqtt.retain=false, mqtt.topic=application/1/device/5e0cfad574ac2772/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, feature=ImmutableFeature [featureId=pressure, definition=null, properties={"value":0.5433333,"warn_low":false,"warn_high":false}, desiredProperties=null]]>
2021-03-15 10:40:33,673 DEBUG [baa5306e-a654-4b78-b83e-4f31d3a4b6bb] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Persisting Event <things.events:featureModified>.
2021-03-15 10:40:33,678 TRACE [] o.e.d.s.u.m.i.t.StoppedKamonTimer  - Timer with name <akka-persistence-mongo.journal.scala-official.write.append> and segment <overall> was stopped after <4243993> nanoseconds
2021-03-15 10:40:33,679 INFO  [] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Successfully persisted Event <things.events:featureModified>.
2021-03-15 10:40:33,680 ERROR [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - Publisher unavailable. Dropping <org.eclipse.ditto.services.utils.pubsub.actors.Publisher$Publish@35355a3c>
2021-03-15 10:40:33,680 DEBUG [] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Handling by strategy: <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=d695b215-0cfd-4a2f-8f84-9083217ba0ba, mqtt.retain=false, mqtt.topic=application/1/device/5e0cfad574ac2772/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, featureId=direction, propertyPointer=/configuration/clockwise, propertyValue=true]>
2021-03-15 10:40:33,680 DEBUG [d695b215-0cfd-4a2f-8f84-9083217ba0ba] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Applying command <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=d695b215-0cfd-4a2f-8f84-9083217ba0ba, mqtt.retain=false, mqtt.topic=application/1/device/5e0cfad574ac2772/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, featureId=direction, propertyPointer=/configuration/clockwise, propertyValue=true]>
2021-03-15 10:40:33,681 DEBUG [d695b215-0cfd-4a2f-8f84-9083217ba0ba] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Applying command <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=d695b215-0cfd-4a2f-8f84-9083217ba0ba, mqtt.retain=false, mqtt.topic=application/1/device/5e0cfad574ac2772/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, featureId=direction, propertyPointer=/configuration/clockwise, propertyValue=true]>
2021-03-15 10:40:33,681 DEBUG [d695b215-0cfd-4a2f-8f84-9083217ba0ba] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Validating conditional headers with currentETagValue <"hash:4ee"> on command <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=d695b215-0cfd-4a2f-8f84-9083217ba0ba, mqtt.retain=false, mqtt.topic=application/1/device/5e0cfad574ac2772/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, featureId=direction, propertyPointer=/configuration/clockwise, propertyValue=true]>.
2021-03-15 10:40:33,681 DEBUG [d695b215-0cfd-4a2f-8f84-9083217ba0ba] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Validating conditional headers succeeded.
2021-03-15 10:40:33,682 DEBUG [d695b215-0cfd-4a2f-8f84-9083217ba0ba] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Applying command <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=d695b215-0cfd-4a2f-8f84-9083217ba0ba, mqtt.retain=false, mqtt.topic=application/1/device/5e0cfad574ac2772/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, featureId=direction, propertyPointer=/configuration/clockwise, propertyValue=true]>
2021-03-15 10:40:33,684 DEBUG [d695b215-0cfd-4a2f-8f84-9083217ba0ba] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Persisting Event <things.events:featurePropertyModified>.
2021-03-15 10:40:33,680 ERROR [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - Publisher unavailable. Dropping <org.eclipse.ditto.services.utils.pubsub.actors.Publisher$Publish@35355a3c>
2021-03-15 10:40:33,690 TRACE [] o.e.d.s.u.m.i.t.StoppedKamonTimer  - Timer with name <akka-persistence-mongo.journal.scala-official.write.append> and segment <overall> was stopped after <4795099> nanoseconds
2021-03-15 10:40:33,692 INFO  [] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Successfully persisted Event <things.events:featurePropertyModified>.
2021-03-15 10:40:33,694 ERROR [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - Publisher unavailable. Dropping <org.eclipse.ditto.services.utils.pubsub.actors.Publisher$Publish@6687638f>
2021-03-15 10:40:33,694 ERROR [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - Publisher unavailable. Dropping <org.eclipse.ditto.services.utils.pubsub.actors.Publisher$Publish@6687638f>
2021-03-15 10:40:37,737 TRACE [] o.e.d.s.u.c.AbstractJsonifiableWithDittoHeadersSerializer  - fromBinary CBOR which got 'in': A26C646974746F48656164657273AE686D7174742E716F736130781B646974746F2D726561642D7265766F6B65642D7375626A65637473806E636F7272656C6174696F6E2D6964782462303663326439312D386232392D343232372D613133382D3833373435343030643337666B6D7174742E72657461696E6566616C73656A6D7174742E746F706963782E6170706C69636174696F6E2F312F6465766963652F633434333330323433663039313562322F6576656E742F75706E7265717565737465642D61636B73806C646974746F2D6F726967696E781E6368697270737461636B2D636F6E6E656374696F6E2D7669612D6D717474781C646974746F2D696E626F756E642D7061796C6F61642D6D6170706572726368697270737461636B2D6D617070696E676849662D4D61746368612A71726573706F6E73652D7265717569726564F470646974746F2D6F726967696E61746F72782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D64663537343431323038326172646974746F2D617574682D636F6E74657874A26474797065781C7072652D61757468656E746963617465642D636F6E6E656374696F6E687375626A6563747381782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D64663537343431323038326173646974746F2D726561642D7375626A6563747382782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D646635373434313230383261782F617574687A3170726F643A39316632386433372D353765322D343963322D383136352D3437353361663564333639626F646974746F2D656E746974792D6964783D7A612E636F2E61677269696F2E7069766F743A70726F64312D66666135313538652D343562612D343134352D383338612D303064626561383466353738677061796C6F6164A46474797065781D7468696E67732E636F6D6D616E64733A6D6F6469667946656174757265677468696E674964783D7A612E636F2E61677269696F2E7069766F743A70726F64312D66666135313538652D343562612D343134352D383338612D30306462656138346635373869666561747572654964686C6F636174696F6E6766656174757265A26F5F5F736368656D6156657273696F6E026A70726F70657274696573A2696C6F6E676974756465FB403A7E4D7F0ED3D8686C61746974756465FBC03B482DE00D1B71
2021-03-15 10:40:37,739 DEBUG [] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Handling by strategy: <ModifyFeature [type=things.commands:modifyFeature, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=b06c2d91-8b29-4227-a138-83745400d37f, mqtt.retain=false, mqtt.topic=application/1/device/c44330243f0915b2/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, feature=ImmutableFeature [featureId=location, definition=null, properties={"longitude":26.49337,"latitude":-27.28195}, desiredProperties=null]]>
2021-03-15 10:40:37,739 DEBUG [b06c2d91-8b29-4227-a138-83745400d37f] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Applying command <ModifyFeature [type=things.commands:modifyFeature, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=b06c2d91-8b29-4227-a138-83745400d37f, mqtt.retain=false, mqtt.topic=application/1/device/c44330243f0915b2/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, feature=ImmutableFeature [featureId=location, definition=null, properties={"longitude":26.49337,"latitude":-27.28195}, desiredProperties=null]]>
2021-03-15 10:40:37,739 DEBUG [b06c2d91-8b29-4227-a138-83745400d37f] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Applying command <ModifyFeature [type=things.commands:modifyFeature, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=b06c2d91-8b29-4227-a138-83745400d37f, mqtt.retain=false, mqtt.topic=application/1/device/c44330243f0915b2/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, feature=ImmutableFeature [featureId=location, definition=null, properties={"longitude":26.49337,"latitude":-27.28195}, desiredProperties=null]]>
2021-03-15 10:40:37,739 DEBUG [b06c2d91-8b29-4227-a138-83745400d37f] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Validating conditional headers with currentETagValue <"hash:b646f388"> on command <ModifyFeature [type=things.commands:modifyFeature, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=b06c2d91-8b29-4227-a138-83745400d37f, mqtt.retain=false, mqtt.topic=application/1/device/c44330243f0915b2/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, feature=ImmutableFeature [featureId=location, definition=null, properties={"longitude":26.49337,"latitude":-27.28195}, desiredProperties=null]]>.
2021-03-15 10:40:37,740 TRACE [] o.e.d.s.u.c.AbstractJsonifiableWithDittoHeadersSerializer  - fromBinary CBOR which got 'in': A26C646974746F48656164657273AE686D7174742E716F736130781B646974746F2D726561642D7265766F6B65642D7375626A65637473806E636F7272656C6174696F6E2D6964782437636566373966642D633432622D343339652D623432322D6461346439383735653064386B6D7174742E72657461696E6566616C73656A6D7174742E746F706963782E6170706C69636174696F6E2F312F6465766963652F633434333330323433663039313562322F6576656E742F75706E7265717565737465642D61636B73806C646974746F2D6F726967696E781E6368697270737461636B2D636F6E6E656374696F6E2D7669612D6D717474781C646974746F2D696E626F756E642D7061796C6F61642D6D6170706572726368697270737461636B2D6D617070696E676849662D4D61746368612A71726573706F6E73652D7265717569726564F470646974746F2D6F726967696E61746F72782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D64663537343431323038326172646974746F2D617574682D636F6E74657874A26474797065781C7072652D61757468656E746963617465642D636F6E6E656374696F6E687375626A6563747381782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D64663537343431323038326173646974746F2D726561642D7375626A6563747382782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D646635373434313230383261782F617574687A3170726F643A39316632386433372D353765322D343963322D383136352D3437353361663564333639626F646974746F2D656E746974792D6964783D7A612E636F2E61677269696F2E7069766F743A70726F64312D66666135313538652D343562612D343134352D383338612D303064626561383466353738677061796C6F6164A5647479706578257468696E67732E636F6D6D616E64733A6D6F646966794665617475726550726F7065727479677468696E674964783D7A612E636F2E61677269696F2E7069766F743A70726F64312D66666135313538652D343562612D343134352D383338612D3030646265613834663537386966656174757265496469646972656374696F6E6870726F7065727479672F7374617475736576616C7565A269646972656374696F6EFB405F7CEF34D6A1626C7061737365645F706F696E74F4
2021-03-15 10:40:37,740 DEBUG [b06c2d91-8b29-4227-a138-83745400d37f] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Validating conditional headers succeeded.
2021-03-15 10:40:37,740 DEBUG [b06c2d91-8b29-4227-a138-83745400d37f] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Applying command <ModifyFeature [type=things.commands:modifyFeature, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=b06c2d91-8b29-4227-a138-83745400d37f, mqtt.retain=false, mqtt.topic=application/1/device/c44330243f0915b2/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, feature=ImmutableFeature [featureId=location, definition=null, properties={"longitude":26.49337,"latitude":-27.28195}, desiredProperties=null]]>
2021-03-15 10:40:37,746 TRACE [] o.e.d.s.u.c.AbstractJsonifiableWithDittoHeadersSerializer  - fromBinary CBOR which got 'in': A26C646974746F48656164657273AE686D7174742E716F736130781B646974746F2D726561642D7265766F6B65642D7375626A65637473806E636F7272656C6174696F6E2D6964782465613031633135392D666362632D343263332D386136322D3036623932656263633563306B6D7174742E72657461696E6566616C73656A6D7174742E746F706963782E6170706C69636174696F6E2F312F6465766963652F633434333330323433663039313562322F6576656E742F75706E7265717565737465642D61636B73806C646974746F2D6F726967696E781E6368697270737461636B2D636F6E6E656374696F6E2D7669612D6D717474781C646974746F2D696E626F756E642D7061796C6F61642D6D6170706572726368697270737461636B2D6D617070696E676849662D4D61746368612A71726573706F6E73652D7265717569726564F470646974746F2D6F726967696E61746F72782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D64663537343431323038326172646974746F2D617574682D636F6E74657874A26474797065781C7072652D61757468656E746963617465642D636F6E6E656374696F6E687375626A6563747381782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D64663537343431323038326173646974746F2D726561642D7375626A6563747382782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D646635373434313230383261782F617574687A3170726F643A39316632386433372D353765322D343963322D383136352D3437353361663564333639626F646974746F2D656E746974792D6964783D7A612E636F2E61677269696F2E7069766F743A70726F64312D66666135313538652D343562612D343134352D383338612D303064626561383466353738677061796C6F6164A5647479706578257468696E67732E636F6D6D616E64733A6D6F646966794665617475726550726F7065727479677468696E674964783D7A612E636F2E61677269696F2E7069766F743A70726F64312D66666135313538652D343562612D343134352D383338612D3030646265613834663537386966656174757265496469646972656374696F6E6870726F7065727479781A2F636F6E66696775726174696F6E2F6D6964506F736974696F6E6576616C7565A2696C6F6E676974756465FB403A7F0110A137F4686C61746974756465FBC03B489F40A2877F
2021-03-15 10:40:37,749 DEBUG [b06c2d91-8b29-4227-a138-83745400d37f] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Persisting Event <things.events:featureModified>.
2021-03-15 10:40:37,756 TRACE [] o.e.d.s.u.c.AbstractJsonifiableWithDittoHeadersSerializer  - fromBinary CBOR which got 'in': A26C646974746F48656164657273AE686D7174742E716F736130781B646974746F2D726561642D7265766F6B65642D7375626A65637473806E636F7272656C6174696F6E2D6964782461633763333562372D353938362D343666302D383732352D6666326565313135353064646B6D7174742E72657461696E6566616C73656A6D7174742E746F706963782E6170706C69636174696F6E2F312F6465766963652F633434333330323433663039313562322F6576656E742F75706E7265717565737465642D61636B73806C646974746F2D6F726967696E781E6368697270737461636B2D636F6E6E656374696F6E2D7669612D6D717474781C646974746F2D696E626F756E642D7061796C6F61642D6D6170706572726368697270737461636B2D6D617070696E676849662D4D61746368612A71726573706F6E73652D7265717569726564F470646974746F2D6F726967696E61746F72782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D64663537343431323038326172646974746F2D617574682D636F6E74657874A26474797065781C7072652D61757468656E746963617465642D636F6E6E656374696F6E687375626A6563747381782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D64663537343431323038326173646974746F2D726561642D7375626A6563747382782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D646635373434313230383261782F617574687A3170726F643A39316632386433372D353765322D343963322D383136352D3437353361663564333639626F646974746F2D656E746974792D6964783D7A612E636F2E61677269696F2E7069766F743A70726F64312D66666135313538652D343562612D343134352D383338612D303064626561383466353738677061796C6F6164A5647479706578257468696E67732E636F6D6D616E64733A6D6F646966794665617475726550726F7065727479677468696E674964783D7A612E636F2E61677269696F2E7069766F743A70726F64312D66666135313538652D343562612D343134352D383338612D3030646265613834663537386966656174757265496469646972656374696F6E6870726F7065727479781A2F636F6E66696775726174696F6E2F656E64506F736974696F6E6576616C756500
2021-03-15 10:40:37,761 TRACE [] o.e.d.s.u.c.AbstractJsonifiableWithDittoHeadersSerializer  - fromBinary CBOR which got 'in': A26C646974746F48656164657273AE686D7174742E716F736130781B646974746F2D726561642D7265766F6B65642D7375626A65637473806E636F7272656C6174696F6E2D6964782439356138316333312D316334362D343038322D383631622D3937666466396566363730336B6D7174742E72657461696E6566616C73656A6D7174742E746F706963782E6170706C69636174696F6E2F312F6465766963652F633434333330323433663039313562322F6576656E742F75706E7265717565737465642D61636B73806C646974746F2D6F726967696E781E6368697270737461636B2D636F6E6E656374696F6E2D7669612D6D717474781C646974746F2D696E626F756E642D7061796C6F61642D6D6170706572726368697270737461636B2D6D617070696E676849662D4D61746368612A71726573706F6E73652D7265717569726564F470646974746F2D6F726967696E61746F72782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D64663537343431323038326172646974746F2D617574682D636F6E74657874A26474797065781C7072652D61757468656E746963617465642D636F6E6E656374696F6E687375626A6563747381782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D64663537343431323038326173646974746F2D726561642D7375626A6563747382782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D646635373434313230383261782F617574687A3170726F643A39316632386433372D353765322D343963322D383136352D3437353361663564333639626F646974746F2D656E746974792D6964783D7A612E636F2E61677269696F2E7069766F743A70726F64312D66666135313538652D343562612D343134352D383338612D303064626561383466353738677061796C6F6164A5647479706578257468696E67732E636F6D6D616E64733A6D6F646966794665617475726550726F7065727479677468696E674964783D7A612E636F2E61677269696F2E7069766F743A70726F64312D66666135313538652D343562612D343134352D383338612D3030646265613834663537386966656174757265496469646972656374696F6E6870726F7065727479752F636F6E66696775726174696F6E2F6F66667365746576616C7565390112
2021-03-15 10:40:37,766 TRACE [] o.e.d.s.u.m.i.t.StoppedKamonTimer  - Timer with name <akka-persistence-mongo.journal.scala-official.write.append> and segment <overall> was stopped after <14540276> nanoseconds
2021-03-15 10:40:37,768 INFO  [] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Successfully persisted Event <things.events:featureModified>.
2021-03-15 10:40:37,769 ERROR [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - Publisher unavailable. Dropping <org.eclipse.ditto.services.utils.pubsub.actors.Publisher$Publish@3cfca4c3>
2021-03-15 10:40:37,769 ERROR [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - Publisher unavailable. Dropping <org.eclipse.ditto.services.utils.pubsub.actors.Publisher$Publish@3cfca4c3>
2021-03-15 10:40:37,770 DEBUG [] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Handling by strategy: <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=7cef79fd-c42b-439e-b422-da4d9875e0d8, mqtt.retain=false, mqtt.topic=application/1/device/c44330243f0915b2/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, featureId=direction, propertyPointer=/status, propertyValue={"direction":125.9521,"passed_point":false}]>
2021-03-15 10:40:37,770 DEBUG [7cef79fd-c42b-439e-b422-da4d9875e0d8] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Applying command <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=7cef79fd-c42b-439e-b422-da4d9875e0d8, mqtt.retain=false, mqtt.topic=application/1/device/c44330243f0915b2/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, featureId=direction, propertyPointer=/status, propertyValue={"direction":125.9521,"passed_point":false}]>
2021-03-15 10:40:37,772 DEBUG [7cef79fd-c42b-439e-b422-da4d9875e0d8] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Applying command <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=7cef79fd-c42b-439e-b422-da4d9875e0d8, mqtt.retain=false, mqtt.topic=application/1/device/c44330243f0915b2/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, featureId=direction, propertyPointer=/status, propertyValue={"direction":125.9521,"passed_point":false}]>
2021-03-15 10:40:37,772 DEBUG [7cef79fd-c42b-439e-b422-da4d9875e0d8] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Validating conditional headers with currentETagValue <"hash:7abccca3"> on command <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=7cef79fd-c42b-439e-b422-da4d9875e0d8, mqtt.retain=false, mqtt.topic=application/1/device/c44330243f0915b2/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, featureId=direction, propertyPointer=/status, propertyValue={"direction":125.9521,"passed_point":false}]>.
2021-03-15 10:40:37,772 DEBUG [7cef79fd-c42b-439e-b422-da4d9875e0d8] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Validating conditional headers succeeded.
2021-03-15 10:40:37,773 DEBUG [7cef79fd-c42b-439e-b422-da4d9875e0d8] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Applying command <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=7cef79fd-c42b-439e-b422-da4d9875e0d8, mqtt.retain=false, mqtt.topic=application/1/device/c44330243f0915b2/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, featureId=direction, propertyPointer=/status, propertyValue={"direction":125.9521,"passed_point":false}]>
2021-03-15 10:40:37,782 DEBUG [7cef79fd-c42b-439e-b422-da4d9875e0d8] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Persisting Event <things.events:featurePropertyModified>.
2021-03-15 10:40:37,792 TRACE [] o.e.d.s.u.m.i.t.StoppedKamonTimer  - Timer with name <akka-persistence-mongo.journal.scala-official.write.append> and segment <overall> was stopped after <7749937> nanoseconds
2021-03-15 10:40:37,793 INFO  [] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Successfully persisted Event <things.events:featurePropertyModified>.
2021-03-15 10:40:37,794 ERROR [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - Publisher unavailable. Dropping <org.eclipse.ditto.services.utils.pubsub.actors.Publisher$Publish@f878caca>
2021-03-15 10:40:37,794 DEBUG [] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Handling by strategy: <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=ea01c159-fcbc-42c3-8a62-06b92ebcc5c0, mqtt.retain=false, mqtt.topic=application/1/device/c44330243f0915b2/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, featureId=direction, propertyPointer=/configuration/midPosition, propertyValue={"longitude":26.49611,"latitude":-27.28368}]>
2021-03-15 10:40:37,795 DEBUG [ea01c159-fcbc-42c3-8a62-06b92ebcc5c0] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Applying command <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=ea01c159-fcbc-42c3-8a62-06b92ebcc5c0, mqtt.retain=false, mqtt.topic=application/1/device/c44330243f0915b2/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, featureId=direction, propertyPointer=/configuration/midPosition, propertyValue={"longitude":26.49611,"latitude":-27.28368}]>
2021-03-15 10:40:37,795 DEBUG [ea01c159-fcbc-42c3-8a62-06b92ebcc5c0] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Applying command <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=ea01c159-fcbc-42c3-8a62-06b92ebcc5c0, mqtt.retain=false, mqtt.topic=application/1/device/c44330243f0915b2/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, featureId=direction, propertyPointer=/configuration/midPosition, propertyValue={"longitude":26.49611,"latitude":-27.28368}]>
2021-03-15 10:40:37,795 DEBUG [ea01c159-fcbc-42c3-8a62-06b92ebcc5c0] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Validating conditional headers with currentETagValue <"hash:f8248921"> on command <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=ea01c159-fcbc-42c3-8a62-06b92ebcc5c0, mqtt.retain=false, mqtt.topic=application/1/device/c44330243f0915b2/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, featureId=direction, propertyPointer=/configuration/midPosition, propertyValue={"longitude":26.49611,"latitude":-27.28368}]>.
2021-03-15 10:40:37,795 DEBUG [ea01c159-fcbc-42c3-8a62-06b92ebcc5c0] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Validating conditional headers succeeded.
2021-03-15 10:40:37,795 DEBUG [ea01c159-fcbc-42c3-8a62-06b92ebcc5c0] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Applying command <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=ea01c159-fcbc-42c3-8a62-06b92ebcc5c0, mqtt.retain=false, mqtt.topic=application/1/device/c44330243f0915b2/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, featureId=direction, propertyPointer=/configuration/midPosition, propertyValue={"longitude":26.49611,"latitude":-27.28368}]>
2021-03-15 10:40:37,794 ERROR [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - Publisher unavailable. Dropping <org.eclipse.ditto.services.utils.pubsub.actors.Publisher$Publish@f878caca>
2021-03-15 10:40:37,798 DEBUG [ea01c159-fcbc-42c3-8a62-06b92ebcc5c0] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Persisting Event <things.events:featurePropertyModified>.
2021-03-15 10:40:37,804 TRACE [] o.e.d.s.u.m.i.t.StoppedKamonTimer  - Timer with name <akka-persistence-mongo.journal.scala-official.write.append> and segment <overall> was stopped after <4951369> nanoseconds
2021-03-15 10:40:37,805 INFO  [] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Successfully persisted Event <things.events:featurePropertyModified>.
2021-03-15 10:40:37,806 ERROR [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - Publisher unavailable. Dropping <org.eclipse.ditto.services.utils.pubsub.actors.Publisher$Publish@fb042aa2>
2021-03-15 10:40:37,807 DEBUG [] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Handling by strategy: <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=ac7c35b7-5986-46f0-8725-ff2ee11550dd, mqtt.retain=false, mqtt.topic=application/1/device/c44330243f0915b2/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, featureId=direction, propertyPointer=/configuration/endPosition, propertyValue=0]>
2021-03-15 10:40:37,807 DEBUG [ac7c35b7-5986-46f0-8725-ff2ee11550dd] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Applying command <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=ac7c35b7-5986-46f0-8725-ff2ee11550dd, mqtt.retain=false, mqtt.topic=application/1/device/c44330243f0915b2/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, featureId=direction, propertyPointer=/configuration/endPosition, propertyValue=0]>
2021-03-15 10:40:37,807 DEBUG [ac7c35b7-5986-46f0-8725-ff2ee11550dd] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Applying command <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=ac7c35b7-5986-46f0-8725-ff2ee11550dd, mqtt.retain=false, mqtt.topic=application/1/device/c44330243f0915b2/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, featureId=direction, propertyPointer=/configuration/endPosition, propertyValue=0]>
2021-03-15 10:40:37,807 DEBUG [ac7c35b7-5986-46f0-8725-ff2ee11550dd] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Validating conditional headers with currentETagValue <"hash:0"> on command <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=ac7c35b7-5986-46f0-8725-ff2ee11550dd, mqtt.retain=false, mqtt.topic=application/1/device/c44330243f0915b2/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, featureId=direction, propertyPointer=/configuration/endPosition, propertyValue=0]>.
2021-03-15 10:40:37,807 DEBUG [ac7c35b7-5986-46f0-8725-ff2ee11550dd] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Validating conditional headers succeeded.
2021-03-15 10:40:37,807 DEBUG [ac7c35b7-5986-46f0-8725-ff2ee11550dd] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Applying command <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=ac7c35b7-5986-46f0-8725-ff2ee11550dd, mqtt.retain=false, mqtt.topic=application/1/device/c44330243f0915b2/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, featureId=direction, propertyPointer=/configuration/endPosition, propertyValue=0]>
2021-03-15 10:40:37,806 ERROR [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - Publisher unavailable. Dropping <org.eclipse.ditto.services.utils.pubsub.actors.Publisher$Publish@fb042aa2>
2021-03-15 10:40:37,810 DEBUG [ac7c35b7-5986-46f0-8725-ff2ee11550dd] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Persisting Event <things.events:featurePropertyModified>.
2021-03-15 10:40:37,821 TRACE [] o.e.d.s.u.m.i.t.StoppedKamonTimer  - Timer with name <akka-persistence-mongo.journal.scala-official.write.append> and segment <overall> was stopped after <10569472> nanoseconds
2021-03-15 10:40:37,823 INFO  [] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Successfully persisted Event <things.events:featurePropertyModified>.
2021-03-15 10:40:37,825 ERROR [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - Publisher unavailable. Dropping <org.eclipse.ditto.services.utils.pubsub.actors.Publisher$Publish@dfd10225>
2021-03-15 10:40:37,825 ERROR [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - Publisher unavailable. Dropping <org.eclipse.ditto.services.utils.pubsub.actors.Publisher$Publish@dfd10225>
2021-03-15 10:40:37,825 DEBUG [] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Handling by strategy: <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=95a81c31-1c46-4082-861b-97fdf9ef6703, mqtt.retain=false, mqtt.topic=application/1/device/c44330243f0915b2/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, featureId=direction, propertyPointer=/configuration/offset, propertyValue=-275]>
2021-03-15 10:40:37,826 DEBUG [95a81c31-1c46-4082-861b-97fdf9ef6703] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Applying command <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=95a81c31-1c46-4082-861b-97fdf9ef6703, mqtt.retain=false, mqtt.topic=application/1/device/c44330243f0915b2/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, featureId=direction, propertyPointer=/configuration/offset, propertyValue=-275]>
2021-03-15 10:40:37,840 ERROR [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - Publisher unavailable. Dropping <org.eclipse.ditto.services.utils.pubsub.actors.Publisher$Publish@f8323f45>
2021-03-15 10:40:37,826 DEBUG [95a81c31-1c46-4082-861b-97fdf9ef6703] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Applying command <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=95a81c31-1c46-4082-861b-97fdf9ef6703, mqtt.retain=false, mqtt.topic=application/1/device/c44330243f0915b2/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, featureId=direction, propertyPointer=/configuration/offset, propertyValue=-275]>
2021-03-15 10:40:37,826 DEBUG [95a81c31-1c46-4082-861b-97fdf9ef6703] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Validating conditional headers with currentETagValue <"hash:fffffeed"> on command <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=95a81c31-1c46-4082-861b-97fdf9ef6703, mqtt.retain=false, mqtt.topic=application/1/device/c44330243f0915b2/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, featureId=direction, propertyPointer=/configuration/offset, propertyValue=-275]>.
2021-03-15 10:40:37,827 DEBUG [95a81c31-1c46-4082-861b-97fdf9ef6703] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Validating conditional headers succeeded.
2021-03-15 10:40:37,827 DEBUG [95a81c31-1c46-4082-861b-97fdf9ef6703] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Applying command <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=95a81c31-1c46-4082-861b-97fdf9ef6703, mqtt.retain=false, mqtt.topic=application/1/device/c44330243f0915b2/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, featureId=direction, propertyPointer=/configuration/offset, propertyValue=-275]>
2021-03-15 10:40:37,832 DEBUG [95a81c31-1c46-4082-861b-97fdf9ef6703] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Persisting Event <things.events:featurePropertyModified>.
2021-03-15 10:40:37,837 TRACE [] o.e.d.s.u.m.i.t.StoppedKamonTimer  - Timer with name <akka-persistence-mongo.journal.scala-official.write.append> and segment <overall> was stopped after <4811245> nanoseconds
2021-03-15 10:40:37,838 INFO  [] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Successfully persisted Event <things.events:featurePropertyModified>.
2021-03-15 10:40:37,840 ERROR [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - Publisher unavailable. Dropping <org.eclipse.ditto.services.utils.pubsub.actors.Publisher$Publish@f8323f45>
2021-03-15 10:40:39,004 DEBUG [] o.e.d.s.u.p.a.PubUpdater akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor/pubUpdater13 - started (org.eclipse.ditto.services.utils.pubsub.actors.PubUpdater@3c4a03e2)
2021-03-15 10:40:39,005 DEBUG [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - now supervising Actor[akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor/pubUpdater13#1236384876]
2021-03-15 10:40:39,005 DEBUG [] o.e.d.s.u.p.a.PubUpdater akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor/pubUpdater13 - now watched by Actor[akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor#-1713157646]
2021-03-15 10:40:39,005 DEBUG [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - now supervising Actor[akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor/publisher14#-264690097]
2021-03-15 10:40:39,005 DEBUG [] o.e.d.s.u.p.a.Publisher akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor/publisher14 - started (org.eclipse.ditto.services.utils.pubsub.actors.Publisher@1b37d40b)
2021-03-15 10:40:39,005 DEBUG [] o.e.d.s.u.p.a.Publisher akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor/publisher14 - now watched by Actor[akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor#-1713157646]
2021-03-15 10:40:39,005 DEBUG [] o.e.d.s.u.p.a.Publisher akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor/publisher14 - now watched by Actor[akka://ditto-cluster/user/thingsRoot/acks-aware-ack-supervisor/ackUpdater1#1979099173]
2021-03-15 10:40:39,006 DEBUG [] o.e.d.s.u.p.a.Publisher akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor/publisher14 - now watched by Actor[akka://ditto-cluster/user/thing-event-aware-replicator#-975100306]
2021-03-15 10:40:39,006 INFO  [] o.e.d.s.u.p.a.PubUpdater akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor/pubUpdater13 - Got <CurrentClusterState(TreeSet(Member(address = akka://ditto-cluster@10.244.0.174:2551, status = Up, roles = HashSet(thing-event-aware, acks-aware, live-signal-aware, dc-default, connectivity)), Member(address = akka://ditto-cluster@10.244.1.10:2551, status = Up, roles = HashSet(acks-aware, live-signal-aware, blocked-namespaces-aware, concierge, dc-default)), Member(address = akka://ditto-cluster@10.244.1.103:2551, status = Up, roles = Set(policies, dc-default)), Member(address = akka://ditto-cluster@10.244.1.123:2551, status = Up, roles = HashSet(thing-event-aware, acks-aware, live-signal-aware, gateway, dc-default)), Member(address = akka://ditto-cluster@10.244.1.34:2551, status = Up, roles = Set(things-search, blocked-namespaces-aware, thing-event-aware, dc-default)), Member(address = akka://ditto-cluster@10.244.1.35:2551, status = Up, roles = Set(things, thing-event-aware, acks-aware, dc-default))), Set(), HashSet(akka://ditto-cluster@10.244.1.123:2551, akka://ditto-cluster@10.244.1.103:2551, akka://ditto-cluster@10.244.0.174:2551, akka://ditto-cluster@10.244.1.10:2551, akka://ditto-cluster@10.244.1.35:2551, akka://ditto-cluster@10.244.1.34:2551), Some(akka://ditto-cluster@10.244.0.174:2551), HashMap(things-search -> Some(akka://ditto-cluster@10.244.1.34:2551), thing-event-aware -> Some(akka://ditto-cluster@10.244.0.174:2551), acks-aware -> Some(akka://ditto-cluster@10.244.0.174:2551), live-signal-aware -> Some(akka://ditto-cluster@10.244.0.174:2551), blocked-namespaces-aware -> Some(akka://ditto-cluster@10.244.1.10:2551), gateway -> Some(akka://ditto-cluster@10.244.1.123:2551), concierge -> Some(akka://ditto-cluster@10.244.1.10:2551), things -> Some(akka://ditto-cluster@10.244.1.35:2551), dc-default -> Some(akka://ditto-cluster@10.244.0.174:2551), connectivity -> Some(akka://ditto-cluster@10.244.0.174:2551), policies -> Some(akka://ditto-cluster@10.244.1.103:2551)))>
2021-03-15 10:40:39,006 DEBUG [] o.e.d.s.u.p.a.PubUpdater akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor/pubUpdater13 - now watched by Actor[akka://ditto-cluster/system/eventStreamUnsubscriber-1#-44248250]
2021-03-15 10:40:39,385 ERROR [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - Child <Actor[akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor/publisher14#-264690097]> crashed. Restarting all children after <PT10S>
java.lang.ClassCastException: akka.util.ByteString$ByteString1C incompatible with java.lang.String
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher$$Lambda$2151/0x000000000c059b80.apply(Unknown Source)
    at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
    at java.base/java.util.Iterator.forEachRemaining(Iterator.java:133)
    at scala.collection.convert.JavaCollectionWrappers$SetWrapper$$anon$1.forEachRemaining(JavaCollectionWrappers.scala:146)
    at java.base/java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
    at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:497)
    at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:487)
    at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
    at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:239)
    at java.base/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578)
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher.deserializeGroupedHashes(Publisher.java:190)
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher.lambda$topicSubscribersChanged$3(Publisher.java:178)
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher$$Lambda$2145/0x000000000c057a90.apply(Unknown Source)
    at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
    at java.base/java.util.Iterator.forEachRemaining(Iterator.java:133)
    at scala.collection.convert.JavaCollectionWrappers$MapWrapper$$anon$2$$anon$3.forEachRemaining(JavaCollectionWrappers.scala:232)
    at java.base/java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
    at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:497)
    at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:487)
    at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
    at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:239)
    at java.base/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578)
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher.topicSubscribersChanged(Publisher.java:179)
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher$$Lambda$2014/0x000000001c07d530.apply(Unknown Source)
    at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
    at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
    at scala.PartialFunction.applyOrElse(PartialFunction.scala:187)
    at scala.PartialFunction.applyOrElse$(PartialFunction.scala:186)
    at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
    at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:241)
    at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:242)
    at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:242)
    at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:242)
    at akka.actor.Actor.aroundReceive(Actor.scala:537)
    at akka.actor.Actor.aroundReceive$(Actor.scala:535)
    at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
    at akka.actor.ActorCell.receiveMessage(ActorCell.scala:577)
    at akka.actor.ActorCell.invoke(ActorCell.scala:547)
    at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
    at akka.dispatch.Mailbox.run(Mailbox.scala:231)
    at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
    at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:290)
    at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1020)
    at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1656)
    at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1594)
    at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:183)
2021-03-15 10:40:39,386 ERROR [] a.a.AllForOneStrategy akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor/publisher14 - akka.util.ByteString$ByteString1C incompatible with java.lang.String
java.lang.ClassCastException: akka.util.ByteString$ByteString1C incompatible with java.lang.String
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher$$Lambda$2151/0x000000000c059b80.apply(Unknown Source)
    at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
    at java.base/java.util.Iterator.forEachRemaining(Iterator.java:133)
    at scala.collection.convert.JavaCollectionWrappers$SetWrapper$$anon$1.forEachRemaining(JavaCollectionWrappers.scala:146)
    at java.base/java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
    at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:497)
    at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:487)
    at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
    at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:239)
    at java.base/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578)
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher.deserializeGroupedHashes(Publisher.java:190)
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher.lambda$topicSubscribersChanged$3(Publisher.java:178)
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher$$Lambda$2145/0x000000000c057a90.apply(Unknown Source)
    at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
    at java.base/java.util.Iterator.forEachRemaining(Iterator.java:133)
    at scala.collection.convert.JavaCollectionWrappers$MapWrapper$$anon$2$$anon$3.forEachRemaining(JavaCollectionWrappers.scala:232)
    at java.base/java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
    at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:497)
    at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:487)
    at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
    at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:239)
    at java.base/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578)
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher.topicSubscribersChanged(Publisher.java:179)
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher$$Lambda$2014/0x000000001c07d530.apply(Unknown Source)
    at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
    at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
    at scala.PartialFunction.applyOrElse(PartialFunction.scala:187)
    at scala.PartialFunction.applyOrElse$(PartialFunction.scala:186)
    at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
    at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:241)
    at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:242)
    at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:242)
    at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:242)
    at akka.actor.Actor.aroundReceive(Actor.scala:537)
    at akka.actor.Actor.aroundReceive$(Actor.scala:535)
    at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
    at akka.actor.ActorCell.receiveMessage(ActorCell.scala:577)
    at akka.actor.ActorCell.invoke(ActorCell.scala:547)
    at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
    at akka.dispatch.Mailbox.run(Mailbox.scala:231)
    at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
    at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:290)
    at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1020)
    at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1656)
    at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1594)
    at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:183)
2021-03-15 10:40:39,387 DEBUG [] o.e.d.s.u.p.a.PubUpdater akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor/pubUpdater13 - stopped
2021-03-15 10:40:39,387 DEBUG [] o.e.d.s.u.p.a.Publisher akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor/publisher14 - stopped
2021-03-15 10:40:39,387 ERROR [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - Updater terminated, restart scheduled: <Actor[akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor/pubUpdater13#1236384876]>
2021-03-15 10:40:39,385 ERROR [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - Child <Actor[akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor/publisher14#-264690097]> crashed. Restarting all children after <PT10S>
java.lang.ClassCastException: akka.util.ByteString$ByteString1C incompatible with java.lang.String
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher$$Lambda$2151/0x000000000c059b80.apply(Unknown Source)
    at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
    at java.base/java.util.Iterator.forEachRemaining(Iterator.java:133)
    at scala.collection.convert.JavaCollectionWrappers$SetWrapper$$anon$1.forEachRemaining(JavaCollectionWrappers.scala:146)
    at java.base/java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
    at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:497)
    at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:487)
    at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
    at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:239)
    at java.base/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578)
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher.deserializeGroupedHashes(Publisher.java:190)
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher.lambda$topicSubscribersChanged$3(Publisher.java:178)
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher$$Lambda$2145/0x000000000c057a90.apply(Unknown Source)
    at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
    at java.base/java.util.Iterator.forEachRemaining(Iterator.java:133)
    at scala.collection.convert.JavaCollectionWrappers$MapWrapper$$anon$2$$anon$3.forEachRemaining(JavaCollectionWrappers.scala:232)
    at java.base/java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
    at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:497)
    at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:487)
    at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
    at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:239)
    at java.base/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578)
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher.topicSubscribersChanged(Publisher.java:179)
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher$$Lambda$2014/0x000000001c07d530.apply(Unknown Source)
    at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
    at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
    at scala.PartialFunction.applyOrElse(PartialFunction.scala:187)
    at scala.PartialFunction.applyOrElse$(PartialFunction.scala:186)
    at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
    at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:241)
    at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:242)
    at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:242)
    at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:242)
    at akka.actor.Actor.aroundReceive(Actor.scala:537)
    at akka.actor.Actor.aroundReceive$(Actor.scala:535)
    at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
    at akka.actor.ActorCell.receiveMessage(ActorCell.scala:577)
    at akka.actor.ActorCell.invoke(ActorCell.scala:547)
    at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
    at akka.dispatch.Mailbox.run(Mailbox.scala:231)
    at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
    at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:290)
    at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1020)
    at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1656)
    at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1594)
    at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:183)
2021-03-15 10:40:39,386 ERROR [] a.a.AllForOneStrategy akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor/publisher14 - akka.util.ByteString$ByteString1C incompatible with java.lang.String
java.lang.ClassCastException: akka.util.ByteString$ByteString1C incompatible with java.lang.String
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher$$Lambda$2151/0x000000000c059b80.apply(Unknown Source)
    at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
    at java.base/java.util.Iterator.forEachRemaining(Iterator.java:133)
    at scala.collection.convert.JavaCollectionWrappers$SetWrapper$$anon$1.forEachRemaining(JavaCollectionWrappers.scala:146)
    at java.base/java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
    at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:497)
    at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:487)
    at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
    at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:239)
    at java.base/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578)
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher.deserializeGroupedHashes(Publisher.java:190)
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher.lambda$topicSubscribersChanged$3(Publisher.java:178)
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher$$Lambda$2145/0x000000000c057a90.apply(Unknown Source)
    at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
    at java.base/java.util.Iterator.forEachRemaining(Iterator.java:133)
    at scala.collection.convert.JavaCollectionWrappers$MapWrapper$$anon$2$$anon$3.forEachRemaining(JavaCollectionWrappers.scala:232)
    at java.base/java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
    at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:497)
    at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:487)
    at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
    at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:239)
    at java.base/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578)
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher.topicSubscribersChanged(Publisher.java:179)
    at org.eclipse.ditto.services.utils.pubsub.actors.Publisher$$Lambda$2014/0x000000001c07d530.apply(Unknown Source)
    at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
    at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
    at scala.PartialFunction.applyOrElse(PartialFunction.scala:187)
    at scala.PartialFunction.applyOrElse$(PartialFunction.scala:186)
    at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
    at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:241)
    at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:242)
    at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:242)
    at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:242)
    at akka.actor.Actor.aroundReceive(Actor.scala:537)
    at akka.actor.Actor.aroundReceive$(Actor.scala:535)
    at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
    at akka.actor.ActorCell.receiveMessage(ActorCell.scala:577)
    at akka.actor.ActorCell.invoke(ActorCell.scala:547)
    at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
    at akka.dispatch.Mailbox.run(Mailbox.scala:231)
    at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
    at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:290)
    at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1020)
    at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1656)
    at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1594)
    at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:183)
2021-03-15 10:40:39,387 ERROR [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - Updater terminated, restart scheduled: <Actor[akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor/pubUpdater13#1236384876]>
2021-03-15 10:40:41,949 TRACE [] o.e.d.s.u.c.AbstractJsonifiableWithDittoHeadersSerializer  - fromBinary CBOR which got 'in': A26C646974746F48656164657273AE686D7174742E716F736130781B646974746F2D726561642D7265766F6B65642D7375626A65637473806E636F7272656C6174696F6E2D6964782461313136373162372D333138642D343664332D613439362D6564373130323538343437346B6D7174742E72657461696E6566616C73656A6D7174742E746F706963782E6170706C69636174696F6E2F342F6465766963652F373266613536653563393563343731392F6576656E742F75706E7265717565737465642D61636B73806C646974746F2D6F726967696E781E6368697270737461636B2D636F6E6E656374696F6E2D7669612D6D717474781C646974746F2D696E626F756E642D7061796C6F61642D6D6170706572726368697270737461636B2D6D617070696E676849662D4D61746368612A71726573706F6E73652D7265717569726564F470646974746F2D6F726967696E61746F72782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D64663537343431323038326172646974746F2D617574682D636F6E74657874A26474797065781C7072652D61757468656E746963617465642D636F6E6E656374696F6E687375626A6563747381782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D64663537343431323038326173646974746F2D726561642D7375626A6563747382782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D646635373434313230383261782F617574687A3170726F643A32316439636365382D386232632D343161352D393263302D3161346433316431643936366F646974746F2D656E746974792D6964783D7A612E636F2E61677269696F2E7069766F743A70726F64312D32613030613832622D303134662D346563642D623862652D633235666265633539303266677061796C6F6164A46474797065781D7468696E67732E636F6D6D616E64733A6D6F6469667946656174757265677468696E674964783D7A612E636F2E61677269696F2E7069766F743A70726F64312D32613030613832622D303134662D346563642D623862652D63323566626563353930326669666561747572654964686C6F636174696F6E6766656174757265A26F5F5F736368656D6156657273696F6E026A70726F70657274696573A2696C6F6E67697475646500686C6174697475646500
2021-03-15 10:40:41,951 DEBUG [] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/9/za.co.agriio.pivot%3Aprod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f/pa - Handling by strategy: <ModifyFeature [type=things.commands:modifyFeature, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=a11671b7-318d-46d3-a496-ed7102584474, mqtt.retain=false, mqtt.topic=application/4/device/72fa56e5c95c4719/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:21d9cce8-8b2c-41a5-92c0-1a4d31d1d966"], ditto-entity-id=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f}], thingId=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f, feature=ImmutableFeature [featureId=location, definition=null, properties={"longitude":0,"latitude":0}, desiredProperties=null]]>
2021-03-15 10:40:41,951 DEBUG [a11671b7-318d-46d3-a496-ed7102584474] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/9/za.co.agriio.pivot%3Aprod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f/pa - Applying command <ModifyFeature [type=things.commands:modifyFeature, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=a11671b7-318d-46d3-a496-ed7102584474, mqtt.retain=false, mqtt.topic=application/4/device/72fa56e5c95c4719/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:21d9cce8-8b2c-41a5-92c0-1a4d31d1d966"], ditto-entity-id=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f}], thingId=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f, feature=ImmutableFeature [featureId=location, definition=null, properties={"longitude":0,"latitude":0}, desiredProperties=null]]>
2021-03-15 10:40:41,951 DEBUG [a11671b7-318d-46d3-a496-ed7102584474] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/9/za.co.agriio.pivot%3Aprod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f/pa - Applying command <ModifyFeature [type=things.commands:modifyFeature, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=a11671b7-318d-46d3-a496-ed7102584474, mqtt.retain=false, mqtt.topic=application/4/device/72fa56e5c95c4719/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:21d9cce8-8b2c-41a5-92c0-1a4d31d1d966"], ditto-entity-id=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f}], thingId=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f, feature=ImmutableFeature [featureId=location, definition=null, properties={"longitude":0,"latitude":0}, desiredProperties=null]]>
2021-03-15 10:40:41,952 DEBUG [a11671b7-318d-46d3-a496-ed7102584474] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/9/za.co.agriio.pivot%3Aprod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f/pa - Validating conditional headers with currentETagValue <"hash:e224c717"> on command <ModifyFeature [type=things.commands:modifyFeature, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=a11671b7-318d-46d3-a496-ed7102584474, mqtt.retain=false, mqtt.topic=application/4/device/72fa56e5c95c4719/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:21d9cce8-8b2c-41a5-92c0-1a4d31d1d966"], ditto-entity-id=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f}], thingId=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f, feature=ImmutableFeature [featureId=location, definition=null, properties={"longitude":0,"latitude":0}, desiredProperties=null]]>.
2021-03-15 10:40:41,952 DEBUG [a11671b7-318d-46d3-a496-ed7102584474] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/9/za.co.agriio.pivot%3Aprod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f/pa - Validating conditional headers succeeded.
2021-03-15 10:40:41,952 DEBUG [a11671b7-318d-46d3-a496-ed7102584474] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/9/za.co.agriio.pivot%3Aprod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f/pa - Applying command <ModifyFeature [type=things.commands:modifyFeature, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=a11671b7-318d-46d3-a496-ed7102584474, mqtt.retain=false, mqtt.topic=application/4/device/72fa56e5c95c4719/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:21d9cce8-8b2c-41a5-92c0-1a4d31d1d966"], ditto-entity-id=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f}], thingId=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f, feature=ImmutableFeature [featureId=location, definition=null, properties={"longitude":0,"latitude":0}, desiredProperties=null]]>
2021-03-15 10:40:41,954 DEBUG [a11671b7-318d-46d3-a496-ed7102584474] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/9/za.co.agriio.pivot%3Aprod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f/pa - Persisting Event <things.events:featureModified>.
2021-03-15 10:40:41,958 TRACE [] o.e.d.s.u.c.AbstractJsonifiableWithDittoHeadersSerializer  - fromBinary CBOR which got 'in': A26C646974746F48656164657273AE686D7174742E716F736130781B646974746F2D726561642D7265766F6B65642D7375626A65637473806E636F7272656C6174696F6E2D6964782435396538386537392D373536632D343435382D393765392D3739373038396338616161386B6D7174742E72657461696E6566616C73656A6D7174742E746F706963782E6170706C69636174696F6E2F342F6465766963652F373266613536653563393563343731392F6576656E742F75706E7265717565737465642D61636B73806C646974746F2D6F726967696E781E6368697270737461636B2D636F6E6E656374696F6E2D7669612D6D717474781C646974746F2D696E626F756E642D7061796C6F61642D6D6170706572726368697270737461636B2D6D617070696E676849662D4D61746368612A71726573706F6E73652D7265717569726564F470646974746F2D6F726967696E61746F72782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D64663537343431323038326172646974746F2D617574682D636F6E74657874A26474797065781C7072652D61757468656E746963617465642D636F6E6E656374696F6E687375626A6563747381782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D64663537343431323038326173646974746F2D726561642D7375626A6563747382782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D646635373434313230383261782F617574687A3170726F643A32316439636365382D386232632D343161352D393263302D3161346433316431643936366F646974746F2D656E746974792D6964783D7A612E636F2E61677269696F2E7069766F743A70726F64312D32613030613832622D303134662D346563642D623862652D633235666265633539303266677061796C6F6164A5647479706578257468696E67732E636F6D6D616E64733A6D6F646966794665617475726550726F7065727479677468696E674964783D7A612E636F2E61677269696F2E7069766F743A70726F64312D32613030613832622D303134662D346563642D623862652D6332356662656335393032666966656174757265496469646972656374696F6E6870726F7065727479672F7374617475736576616C7565A269646972656374696F6E006C7061737365645F706F696E74F4
2021-03-15 10:40:41,962 TRACE [] o.e.d.s.u.c.AbstractJsonifiableWithDittoHeadersSerializer  - fromBinary CBOR which got 'in': A26C646974746F48656164657273AE686D7174742E716F736130781B646974746F2D726561642D7265766F6B65642D7375626A65637473806E636F7272656C6174696F6E2D6964782462343065633938392D643061622D343433302D616336632D3635393266643837373434636B6D7174742E72657461696E6566616C73656A6D7174742E746F706963782E6170706C69636174696F6E2F342F6465766963652F373266613536653563393563343731392F6576656E742F75706E7265717565737465642D61636B73806C646974746F2D6F726967696E781E6368697270737461636B2D636F6E6E656374696F6E2D7669612D6D717474781C646974746F2D696E626F756E642D7061796C6F61642D6D6170706572726368697270737461636B2D6D617070696E676849662D4D61746368612A71726573706F6E73652D7265717569726564F470646974746F2D6F726967696E61746F72782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D64663537343431323038326172646974746F2D617574682D636F6E74657874A26474797065781C7072652D61757468656E746963617465642D636F6E6E656374696F6E687375626A6563747381782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D64663537343431323038326173646974746F2D726561642D7375626A6563747382782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D646635373434313230383261782F617574687A3170726F643A32316439636365382D386232632D343161352D393263302D3161346433316431643936366F646974746F2D656E746974792D6964783D7A612E636F2E61677269696F2E7069766F743A70726F64312D32613030613832622D303134662D346563642D623862652D633235666265633539303266677061796C6F6164A5647479706578257468696E67732E636F6D6D616E64733A6D6F646966794665617475726550726F7065727479677468696E674964783D7A612E636F2E61677269696F2E7069766F743A70726F64312D32613030613832622D303134662D346563642D623862652D6332356662656335393032666966656174757265496469646972656374696F6E6870726F7065727479781A2F636F6E66696775726174696F6E2F6D6964506F736974696F6E6576616C7565A2696C6F6E676974756465FB403A86A550870111686C61746974756465FBC03B59D1F601797D
2021-03-15 10:40:41,975 TRACE [] o.e.d.s.u.m.i.t.StoppedKamonTimer  - Timer with name <akka-persistence-mongo.journal.scala-official.write.append> and segment <overall> was stopped after <13490570> nanoseconds
2021-03-15 10:40:41,976 INFO  [] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/9/za.co.agriio.pivot%3Aprod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f/pa - Successfully persisted Event <things.events:featureModified>.
2021-03-15 10:40:41,977 ERROR [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - Publisher unavailable. Dropping <org.eclipse.ditto.services.utils.pubsub.actors.Publisher$Publish@8607f0d1>
2021-03-15 10:40:41,977 ERROR [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - Publisher unavailable. Dropping <org.eclipse.ditto.services.utils.pubsub.actors.Publisher$Publish@8607f0d1>
2021-03-15 10:40:41,978 DEBUG [] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/9/za.co.agriio.pivot%3Aprod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f/pa - Handling by strategy: <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=59e88e79-756c-4458-97e9-797089c8aaa8, mqtt.retain=false, mqtt.topic=application/4/device/72fa56e5c95c4719/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:21d9cce8-8b2c-41a5-92c0-1a4d31d1d966"], ditto-entity-id=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f}], thingId=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f, featureId=direction, propertyPointer=/status, propertyValue={"direction":0,"passed_point":false}]>
2021-03-15 10:40:41,978 DEBUG [59e88e79-756c-4458-97e9-797089c8aaa8] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/9/za.co.agriio.pivot%3Aprod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f/pa - Applying command <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=59e88e79-756c-4458-97e9-797089c8aaa8, mqtt.retain=false, mqtt.topic=application/4/device/72fa56e5c95c4719/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:21d9cce8-8b2c-41a5-92c0-1a4d31d1d966"], ditto-entity-id=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f}], thingId=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f, featureId=direction, propertyPointer=/status, propertyValue={"direction":0,"passed_point":false}]>
2021-03-15 10:40:41,979 DEBUG [59e88e79-756c-4458-97e9-797089c8aaa8] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/9/za.co.agriio.pivot%3Aprod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f/pa - Applying command <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=59e88e79-756c-4458-97e9-797089c8aaa8, mqtt.retain=false, mqtt.topic=application/4/device/72fa56e5c95c4719/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:21d9cce8-8b2c-41a5-92c0-1a4d31d1d966"], ditto-entity-id=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f}], thingId=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f, featureId=direction, propertyPointer=/status, propertyValue={"direction":0,"passed_point":false}]>
2021-03-15 10:40:41,979 DEBUG [59e88e79-756c-4458-97e9-797089c8aaa8] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/9/za.co.agriio.pivot%3Aprod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f/pa - Validating conditional headers with currentETagValue <"hash:ff32eb30"> on command <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=59e88e79-756c-4458-97e9-797089c8aaa8, mqtt.retain=false, mqtt.topic=application/4/device/72fa56e5c95c4719/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:21d9cce8-8b2c-41a5-92c0-1a4d31d1d966"], ditto-entity-id=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f}], thingId=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f, featureId=direction, propertyPointer=/status, propertyValue={"direction":0,"passed_point":false}]>.
2021-03-15 10:40:41,979 DEBUG [59e88e79-756c-4458-97e9-797089c8aaa8] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/9/za.co.agriio.pivot%3Aprod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f/pa - Validating conditional headers succeeded.
2021-03-15 10:40:41,979 DEBUG [59e88e79-756c-4458-97e9-797089c8aaa8] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/9/za.co.agriio.pivot%3Aprod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f/pa - Applying command <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=59e88e79-756c-4458-97e9-797089c8aaa8, mqtt.retain=false, mqtt.topic=application/4/device/72fa56e5c95c4719/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:21d9cce8-8b2c-41a5-92c0-1a4d31d1d966"], ditto-entity-id=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f}], thingId=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f, featureId=direction, propertyPointer=/status, propertyValue={"direction":0,"passed_point":false}]>
2021-03-15 10:40:41,981 DEBUG [59e88e79-756c-4458-97e9-797089c8aaa8] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/9/za.co.agriio.pivot%3Aprod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f/pa - Persisting Event <things.events:featurePropertyModified>.
2021-03-15 10:40:41,986 TRACE [] o.e.d.s.u.c.AbstractJsonifiableWithDittoHeadersSerializer  - fromBinary CBOR which got 'in': A26C646974746F48656164657273AE686D7174742E716F736130781B646974746F2D726561642D7265766F6B65642D7375626A65637473806E636F7272656C6174696F6E2D6964782439666335313730302D303535642D346337302D393932342D3161333635393735663033316B6D7174742E72657461696E6566616C73656A6D7174742E746F706963782E6170706C69636174696F6E2F342F6465766963652F373266613536653563393563343731392F6576656E742F75706E7265717565737465642D61636B73806C646974746F2D6F726967696E781E6368697270737461636B2D636F6E6E656374696F6E2D7669612D6D717474781C646974746F2D696E626F756E642D7061796C6F61642D6D6170706572726368697270737461636B2D6D617070696E676849662D4D61746368612A71726573706F6E73652D7265717569726564F470646974746F2D6F726967696E61746F72782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D64663537343431323038326172646974746F2D617574682D636F6E74657874A26474797065781C7072652D61757468656E746963617465642D636F6E6E656374696F6E687375626A6563747381782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D64663537343431323038326173646974746F2D726561642D7375626A6563747382782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D646635373434313230383261782F617574687A3170726F643A32316439636365382D386232632D343161352D393263302D3161346433316431643936366F646974746F2D656E746974792D6964783D7A612E636F2E61677269696F2E7069766F743A70726F64312D32613030613832622D303134662D346563642D623862652D633235666265633539303266677061796C6F6164A5647479706578257468696E67732E636F6D6D616E64733A6D6F646966794665617475726550726F7065727479677468696E674964783D7A612E636F2E61677269696F2E7069766F743A70726F64312D32613030613832622D303134662D346563642D623862652D6332356662656335393032666966656174757265496469646972656374696F6E6870726F7065727479781A2F636F6E66696775726174696F6E2F656E64506F736974696F6E6576616C756500
2021-03-15 10:40:41,987 TRACE [] o.e.d.s.u.m.i.t.StoppedKamonTimer  - Timer with name <akka-persistence-mongo.journal.scala-official.write.append> and segment <overall> was stopped after <4391212> nanoseconds
2021-03-15 10:40:41,988 INFO  [] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/9/za.co.agriio.pivot%3Aprod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f/pa - Successfully persisted Event <things.events:featurePropertyModified>.
2021-03-15 10:40:41,989 ERROR [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - Publisher unavailable. Dropping <org.eclipse.ditto.services.utils.pubsub.actors.Publisher$Publish@8a983ff8>
2021-03-15 10:40:41,989 ERROR [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - Publisher unavailable. Dropping <org.eclipse.ditto.services.utils.pubsub.actors.Publisher$Publish@8a983ff8>
2021-03-15 10:40:41,989 DEBUG [] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/9/za.co.agriio.pivot%3Aprod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f/pa - Handling by strategy: <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=b40ec989-d0ab-4430-ac6c-6592fd87744c, mqtt.retain=false, mqtt.topic=application/4/device/72fa56e5c95c4719/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:21d9cce8-8b2c-41a5-92c0-1a4d31d1d966"], ditto-entity-id=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f}], thingId=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f, featureId=direction, propertyPointer=/configuration/midPosition, propertyValue={"longitude":26.52596,"latitude":-27.35086}]>
2021-03-15 10:40:41,990 DEBUG [b40ec989-d0ab-4430-ac6c-6592fd87744c] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/9/za.co.agriio.pivot%3Aprod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f/pa - Applying command <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=b40ec989-d0ab-4430-ac6c-6592fd87744c, mqtt.retain=false, mqtt.topic=application/4/device/72fa56e5c95c4719/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:21d9cce8-8b2c-41a5-92c0-1a4d31d1d966"], ditto-entity-id=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f}], thingId=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f, featureId=direction, propertyPointer=/configuration/midPosition, propertyValue={"longitude":26.52596,"latitude":-27.35086}]>
2021-03-15 10:40:41,990 DEBUG [b40ec989-d0ab-4430-ac6c-6592fd87744c] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/9/za.co.agriio.pivot%3Aprod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f/pa - Applying command <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=b40ec989-d0ab-4430-ac6c-6592fd87744c, mqtt.retain=false, mqtt.topic=application/4/device/72fa56e5c95c4719/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:21d9cce8-8b2c-41a5-92c0-1a4d31d1d966"], ditto-entity-id=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f}], thingId=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f, featureId=direction, propertyPointer=/configuration/midPosition, propertyValue={"longitude":26.52596,"latitude":-27.35086}]>
2021-03-15 10:40:41,990 DEBUG [b40ec989-d0ab-4430-ac6c-6592fd87744c] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/9/za.co.agriio.pivot%3Aprod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f/pa - Validating conditional headers with currentETagValue <"hash:826e57f6"> on command <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=b40ec989-d0ab-4430-ac6c-6592fd87744c, mqtt.retain=false, mqtt.topic=application/4/device/72fa56e5c95c4719/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:21d9cce8-8b2c-41a5-92c0-1a4d31d1d966"], ditto-entity-id=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f}], thingId=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f, featureId=direction, propertyPointer=/configuration/midPosition, propertyValue={"longitude":26.52596,"latitude":-27.35086}]>.
2021-03-15 10:40:41,990 DEBUG [b40ec989-d0ab-4430-ac6c-6592fd87744c] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/9/za.co.agriio.pivot%3Aprod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f/pa - Validating conditional headers succeeded.
2021-03-15 10:40:41,991 DEBUG [b40ec989-d0ab-4430-ac6c-6592fd87744c] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/9/za.co.agriio.pivot%3Aprod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f/pa - Applying command <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=b40ec989-d0ab-4430-ac6c-6592fd87744c, mqtt.retain=false, mqtt.topic=application/4/device/72fa56e5c95c4719/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:21d9cce8-8b2c-41a5-92c0-1a4d31d1d966"], ditto-entity-id=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f}], thingId=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f, featureId=direction, propertyPointer=/configuration/midPosition, propertyValue={"longitude":26.52596,"latitude":-27.35086}]>
2021-03-15 10:40:41,994 TRACE [] o.e.d.s.u.c.AbstractJsonifiableWithDittoHeadersSerializer  - fromBinary CBOR which got 'in': A26C646974746F48656164657273AE686D7174742E716F736130781B646974746F2D726561642D7265766F6B65642D7375626A65637473806E636F7272656C6174696F6E2D6964782462333663333831332D333462342D343831322D393334302D6235626163323234323037356B6D7174742E72657461696E6566616C73656A6D7174742E746F706963782E6170706C69636174696F6E2F342F6465766963652F373266613536653563393563343731392F6576656E742F75706E7265717565737465642D61636B73806C646974746F2D6F726967696E781E6368697270737461636B2D636F6E6E656374696F6E2D7669612D6D717474781C646974746F2D696E626F756E642D7061796C6F61642D6D6170706572726368697270737461636B2D6D617070696E676849662D4D61746368612A71726573706F6E73652D7265717569726564F470646974746F2D6F726967696E61746F72782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D64663537343431323038326172646974746F2D617574682D636F6E74657874A26474797065781C7072652D61757468656E746963617465642D636F6E6E656374696F6E687375626A6563747381782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D64663537343431323038326173646974746F2D726561642D7375626A6563747382782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D646635373434313230383261782F617574687A3170726F643A32316439636365382D386232632D343161352D393263302D3161346433316431643936366F646974746F2D656E746974792D6964783D7A612E636F2E61677269696F2E7069766F743A70726F64312D32613030613832622D303134662D346563642D623862652D633235666265633539303266677061796C6F6164A5647479706578257468696E67732E636F6D6D616E64733A6D6F646966794665617475726550726F7065727479677468696E674964783D7A612E636F2E61677269696F2E7069766F743A70726F64312D32613030613832622D303134662D346563642D623862652D6332356662656335393032666966656174757265496469646972656374696F6E6870726F7065727479752F636F6E66696775726174696F6E2F6F66667365746576616C7565187D
2021-03-15 10:40:41,995 DEBUG [b40ec989-d0ab-4430-ac6c-6592fd87744c] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/9/za.co.agriio.pivot%3Aprod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f/pa - Persisting Event <things.events:featurePropertyModified>.
2021-03-15 10:40:42,004 TRACE [] o.e.d.s.u.m.i.t.StoppedKamonTimer  - Timer with name <akka-persistence-mongo.journal.scala-official.write.append> and segment <overall> was stopped after <7476903> nanoseconds
2021-03-15 10:40:42,005 INFO  [] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/9/za.co.agriio.pivot%3Aprod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f/pa - Successfully persisted Event <things.events:featurePropertyModified>.
2021-03-15 10:40:42,005 DEBUG [] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/9/za.co.agriio.pivot%3Aprod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f/pa - Handling by strategy: <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=9fc51700-055d-4c70-9924-1a365975f031, mqtt.retain=false, mqtt.topic=application/4/device/72fa56e5c95c4719/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:21d9cce8-8b2c-41a5-92c0-1a4d31d1d966"], ditto-entity-id=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f}], thingId=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f, featureId=direction, propertyPointer=/configuration/endPosition, propertyValue=0]>
2021-03-15 10:40:42,006 ERROR [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - Publisher unavailable. Dropping <org.eclipse.ditto.services.utils.pubsub.actors.Publisher$Publish@34d4a60f>
2021-03-15 10:40:42,006 ERROR [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - Publisher unavailable. Dropping <org.eclipse.ditto.services.utils.pubsub.actors.Publisher$Publish@34d4a60f>
2021-03-15 10:40:42,006 DEBUG [9fc51700-055d-4c70-9924-1a365975f031] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/9/za.co.agriio.pivot%3Aprod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f/pa - Applying command <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=9fc51700-055d-4c70-9924-1a365975f031, mqtt.retain=false, mqtt.topic=application/4/device/72fa56e5c95c4719/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:21d9cce8-8b2c-41a5-92c0-1a4d31d1d966"], ditto-entity-id=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f}], thingId=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f, featureId=direction, propertyPointer=/configuration/endPosition, propertyValue=0]>
2021-03-15 10:40:42,006 DEBUG [9fc51700-055d-4c70-9924-1a365975f031] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/9/za.co.agriio.pivot%3Aprod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f/pa - Applying command <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=9fc51700-055d-4c70-9924-1a365975f031, mqtt.retain=false, mqtt.topic=application/4/device/72fa56e5c95c4719/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:21d9cce8-8b2c-41a5-92c0-1a4d31d1d966"], ditto-entity-id=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f}], thingId=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f, featureId=direction, propertyPointer=/configuration/endPosition, propertyValue=0]>
2021-03-15 10:40:42,006 DEBUG [9fc51700-055d-4c70-9924-1a365975f031] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/9/za.co.agriio.pivot%3Aprod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f/pa - Validating conditional headers with currentETagValue <"hash:0"> on command <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=9fc51700-055d-4c70-9924-1a365975f031, mqtt.retain=false, mqtt.topic=application/4/device/72fa56e5c95c4719/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:21d9cce8-8b2c-41a5-92c0-1a4d31d1d966"], ditto-entity-id=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f}], thingId=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f, featureId=direction, propertyPointer=/configuration/endPosition, propertyValue=0]>.
2021-03-15 10:40:42,007 DEBUG [9fc51700-055d-4c70-9924-1a365975f031] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/9/za.co.agriio.pivot%3Aprod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f/pa - Validating conditional headers succeeded.
2021-03-15 10:40:42,007 DEBUG [9fc51700-055d-4c70-9924-1a365975f031] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/9/za.co.agriio.pivot%3Aprod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f/pa - Applying command <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=9fc51700-055d-4c70-9924-1a365975f031, mqtt.retain=false, mqtt.topic=application/4/device/72fa56e5c95c4719/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:21d9cce8-8b2c-41a5-92c0-1a4d31d1d966"], ditto-entity-id=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f}], thingId=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f, featureId=direction, propertyPointer=/configuration/endPosition, propertyValue=0]>
2021-03-15 10:40:42,009 DEBUG [9fc51700-055d-4c70-9924-1a365975f031] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/9/za.co.agriio.pivot%3Aprod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f/pa - Persisting Event <things.events:featurePropertyModified>.
2021-03-15 10:40:42,014 TRACE [] o.e.d.s.u.m.i.t.StoppedKamonTimer  - Timer with name <akka-persistence-mongo.journal.scala-official.write.append> and segment <overall> was stopped after <4667283> nanoseconds
2021-03-15 10:40:42,015 INFO  [] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/9/za.co.agriio.pivot%3Aprod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f/pa - Successfully persisted Event <things.events:featurePropertyModified>.
2021-03-15 10:40:42,017 ERROR [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - Publisher unavailable. Dropping <org.eclipse.ditto.services.utils.pubsub.actors.Publisher$Publish@779bdbf1>
2021-03-15 10:40:42,017 ERROR [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - Publisher unavailable. Dropping <org.eclipse.ditto.services.utils.pubsub.actors.Publisher$Publish@779bdbf1>
2021-03-15 10:40:42,018 DEBUG [] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/9/za.co.agriio.pivot%3Aprod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f/pa - Handling by strategy: <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=b36c3813-34b4-4812-9340-b5bac2242075, mqtt.retain=false, mqtt.topic=application/4/device/72fa56e5c95c4719/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:21d9cce8-8b2c-41a5-92c0-1a4d31d1d966"], ditto-entity-id=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f}], thingId=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f, featureId=direction, propertyPointer=/configuration/offset, propertyValue=125]>
2021-03-15 10:40:42,018 DEBUG [b36c3813-34b4-4812-9340-b5bac2242075] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/9/za.co.agriio.pivot%3Aprod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f/pa - Applying command <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=b36c3813-34b4-4812-9340-b5bac2242075, mqtt.retain=false, mqtt.topic=application/4/device/72fa56e5c95c4719/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:21d9cce8-8b2c-41a5-92c0-1a4d31d1d966"], ditto-entity-id=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f}], thingId=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f, featureId=direction, propertyPointer=/configuration/offset, propertyValue=125]>
2021-03-15 10:40:42,018 DEBUG [b36c3813-34b4-4812-9340-b5bac2242075] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/9/za.co.agriio.pivot%3Aprod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f/pa - Applying command <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=b36c3813-34b4-4812-9340-b5bac2242075, mqtt.retain=false, mqtt.topic=application/4/device/72fa56e5c95c4719/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:21d9cce8-8b2c-41a5-92c0-1a4d31d1d966"], ditto-entity-id=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f}], thingId=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f, featureId=direction, propertyPointer=/configuration/offset, propertyValue=125]>
2021-03-15 10:40:42,019 DEBUG [b36c3813-34b4-4812-9340-b5bac2242075] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/9/za.co.agriio.pivot%3Aprod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f/pa - Validating conditional headers with currentETagValue <"hash:7d"> on command <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=b36c3813-34b4-4812-9340-b5bac2242075, mqtt.retain=false, mqtt.topic=application/4/device/72fa56e5c95c4719/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:21d9cce8-8b2c-41a5-92c0-1a4d31d1d966"], ditto-entity-id=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f}], thingId=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f, featureId=direction, propertyPointer=/configuration/offset, propertyValue=125]>.
2021-03-15 10:40:42,019 DEBUG [b36c3813-34b4-4812-9340-b5bac2242075] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/9/za.co.agriio.pivot%3Aprod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f/pa - Validating conditional headers succeeded.
2021-03-15 10:40:42,019 DEBUG [b36c3813-34b4-4812-9340-b5bac2242075] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/9/za.co.agriio.pivot%3Aprod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f/pa - Applying command <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=b36c3813-34b4-4812-9340-b5bac2242075, mqtt.retain=false, mqtt.topic=application/4/device/72fa56e5c95c4719/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:21d9cce8-8b2c-41a5-92c0-1a4d31d1d966"], ditto-entity-id=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f}], thingId=za.co.agriio.pivot:prod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f, featureId=direction, propertyPointer=/configuration/offset, propertyValue=125]>
2021-03-15 10:40:42,024 DEBUG [b36c3813-34b4-4812-9340-b5bac2242075] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/9/za.co.agriio.pivot%3Aprod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f/pa - Persisting Event <things.events:featurePropertyModified>.
2021-03-15 10:40:42,032 TRACE [] o.e.d.s.u.m.i.t.StoppedKamonTimer  - Timer with name <akka-persistence-mongo.journal.scala-official.write.append> and segment <overall> was stopped after <5021194> nanoseconds
2021-03-15 10:40:42,034 ERROR [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - Publisher unavailable. Dropping <org.eclipse.ditto.services.utils.pubsub.actors.Publisher$Publish@1fde3673>
2021-03-15 10:40:42,033 INFO  [] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/9/za.co.agriio.pivot%3Aprod1-2a00a82b-014f-4ecd-b8be-c25fbec5902f/pa - Successfully persisted Event <things.events:featurePropertyModified>.
2021-03-15 10:40:42,034 ERROR [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - Publisher unavailable. Dropping <org.eclipse.ditto.services.utils.pubsub.actors.Publisher$Publish@1fde3673>
2021-03-15 10:40:43,723 TRACE [] o.e.d.s.u.c.AbstractJsonifiableWithDittoHeadersSerializer  - fromBinary CBOR which got 'in': A26C646974746F48656164657273AE686D7174742E716F736130781B646974746F2D726561642D7265766F6B65642D7375626A65637473806E636F7272656C6174696F6E2D6964782433306534626439352D623061662D343161332D383965342D6239623335343030376531646B6D7174742E72657461696E6566616C73656A6D7174742E746F706963782E6170706C69636174696F6E2F312F6465766963652F356530636661643537346163323737322F6576656E742F75706E7265717565737465642D61636B73806C646974746F2D6F726967696E781E6368697270737461636B2D636F6E6E656374696F6E2D7669612D6D717474781C646974746F2D696E626F756E642D7061796C6F61642D6D6170706572726368697270737461636B2D6D617070696E676849662D4D61746368612A71726573706F6E73652D7265717569726564F470646974746F2D6F726967696E61746F72782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D64663537343431323038326172646974746F2D617574682D636F6E74657874A26474797065781C7072652D61757468656E746963617465642D636F6E6E656374696F6E687375626A6563747381782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D64663537343431323038326173646974746F2D726561642D7375626A6563747382782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D646635373434313230383261782F617574687A3170726F643A39316632386433372D353765322D343963322D383136352D3437353361663564333639626F646974746F2D656E746974792D6964783D7A612E636F2E61677269696F2E7069766F743A70726F64312D66666135313538652D343562612D343134352D383338612D303064626561383466353738677061796C6F6164A46474797065781D7468696E67732E636F6D6D616E64733A6D6F6469667946656174757265677468696E674964783D7A612E636F2E61677269696F2E7069766F743A70726F64312D66666135313538652D343562612D343134352D383338612D303064626561383466353738696665617475726549646573706565646766656174757265A26F5F5F736368656D6156657273696F6E026A70726F70657274696573A16D636F6E66696775726174696F6EA3626F6EF4687468726F74746C65183263776574F4
2021-03-15 10:40:43,726 DEBUG [] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Handling by strategy: <ModifyFeature [type=things.commands:modifyFeature, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=30e4bd95-b0af-41a3-89e4-b9b354007e1d, mqtt.retain=false, mqtt.topic=application/1/device/5e0cfad574ac2772/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, feature=ImmutableFeature [featureId=speed, definition=null, properties={"configuration":{"on":false,"throttle":50,"wet":false}}, desiredProperties=null]]>
2021-03-15 10:40:43,726 DEBUG [30e4bd95-b0af-41a3-89e4-b9b354007e1d] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Applying command <ModifyFeature [type=things.commands:modifyFeature, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=30e4bd95-b0af-41a3-89e4-b9b354007e1d, mqtt.retain=false, mqtt.topic=application/1/device/5e0cfad574ac2772/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, feature=ImmutableFeature [featureId=speed, definition=null, properties={"configuration":{"on":false,"throttle":50,"wet":false}}, desiredProperties=null]]>
2021-03-15 10:40:43,726 DEBUG [30e4bd95-b0af-41a3-89e4-b9b354007e1d] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Applying command <ModifyFeature [type=things.commands:modifyFeature, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=30e4bd95-b0af-41a3-89e4-b9b354007e1d, mqtt.retain=false, mqtt.topic=application/1/device/5e0cfad574ac2772/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, feature=ImmutableFeature [featureId=speed, definition=null, properties={"configuration":{"on":false,"throttle":50,"wet":false}}, desiredProperties=null]]>
2021-03-15 10:40:43,726 TRACE [] o.e.d.s.u.c.AbstractJsonifiableWithDittoHeadersSerializer  - fromBinary CBOR which got 'in': A26C646974746F48656164657273AE686D7174742E716F736130781B646974746F2D726561642D7265766F6B65642D7375626A65637473806E636F7272656C6174696F6E2D6964782437646164636664642D343236352D346164662D626535652D6134353962646438353463366B6D7174742E72657461696E6566616C73656A6D7174742E746F706963782E6170706C69636174696F6E2F312F6465766963652F356530636661643537346163323737322F6576656E742F75706E7265717565737465642D61636B73806C646974746F2D6F726967696E781E6368697270737461636B2D636F6E6E656374696F6E2D7669612D6D717474781C646974746F2D696E626F756E642D7061796C6F61642D6D6170706572726368697270737461636B2D6D617070696E676849662D4D61746368612A71726573706F6E73652D7265717569726564F470646974746F2D6F726967696E61746F72782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D64663537343431323038326172646974746F2D617574682D636F6E74657874A26474797065781C7072652D61757468656E746963617465642D636F6E6E656374696F6E687375626A6563747381782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D64663537343431323038326173646974746F2D726561642D7375626A6563747382782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D646635373434313230383261782F617574687A3170726F643A39316632386433372D353765322D343963322D383136352D3437353361663564333639626F646974746F2D656E746974792D6964783D7A612E636F2E61677269696F2E7069766F743A70726F64312D66666135313538652D343562612D343134352D383338612D303064626561383466353738677061796C6F6164A46474797065781D7468696E67732E636F6D6D616E64733A6D6F6469667946656174757265677468696E674964783D7A612E636F2E61677269696F2E7069766F743A70726F64312D66666135313538652D343562612D343134352D383338612D303064626561383466353738696665617475726549646870726573737572656766656174757265A26F5F5F736368656D6156657273696F6E026A70726F70657274696573A36576616C7565FB3FE14D240AA143B2687761726E5F6C6F77F4697761726E5F68696768F4
2021-03-15 10:40:43,727 DEBUG [30e4bd95-b0af-41a3-89e4-b9b354007e1d] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Validating conditional headers with currentETagValue <"hash:678c629f"> on command <ModifyFeature [type=things.commands:modifyFeature, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=30e4bd95-b0af-41a3-89e4-b9b354007e1d, mqtt.retain=false, mqtt.topic=application/1/device/5e0cfad574ac2772/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, feature=ImmutableFeature [featureId=speed, definition=null, properties={"configuration":{"on":false,"throttle":50,"wet":false}}, desiredProperties=null]]>.
2021-03-15 10:40:43,727 DEBUG [30e4bd95-b0af-41a3-89e4-b9b354007e1d] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Validating conditional headers succeeded.
2021-03-15 10:40:43,727 DEBUG [30e4bd95-b0af-41a3-89e4-b9b354007e1d] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Applying command <ModifyFeature [type=things.commands:modifyFeature, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=30e4bd95-b0af-41a3-89e4-b9b354007e1d, mqtt.retain=false, mqtt.topic=application/1/device/5e0cfad574ac2772/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, feature=ImmutableFeature [featureId=speed, definition=null, properties={"configuration":{"on":false,"throttle":50,"wet":false}}, desiredProperties=null]]>
2021-03-15 10:40:43,731 TRACE [] o.e.d.s.u.c.AbstractJsonifiableWithDittoHeadersSerializer  - fromBinary CBOR which got 'in': A26C646974746F48656164657273AE686D7174742E716F736130781B646974746F2D726561642D7265766F6B65642D7375626A65637473806E636F7272656C6174696F6E2D6964782465306330623636632D633638662D343138652D616265612D6635353234326663613330626B6D7174742E72657461696E6566616C73656A6D7174742E746F706963782E6170706C69636174696F6E2F312F6465766963652F356530636661643537346163323737322F6576656E742F75706E7265717565737465642D61636B73806C646974746F2D6F726967696E781E6368697270737461636B2D636F6E6E656374696F6E2D7669612D6D717474781C646974746F2D696E626F756E642D7061796C6F61642D6D6170706572726368697270737461636B2D6D617070696E676849662D4D61746368612A71726573706F6E73652D7265717569726564F470646974746F2D6F726967696E61746F72782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D64663537343431323038326172646974746F2D617574682D636F6E74657874A26474797065781C7072652D61757468656E746963617465642D636F6E6E656374696F6E687375626A6563747381782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D64663537343431323038326173646974746F2D726561642D7375626A6563747382782F617574687A3170726F643A39303834666139392D396263382D346365662D383530362D646635373434313230383261782F617574687A3170726F643A39316632386433372D353765322D343963322D383136352D3437353361663564333639626F646974746F2D656E746974792D6964783D7A612E636F2E61677269696F2E7069766F743A70726F64312D66666135313538652D343562612D343134352D383338612D303064626561383466353738677061796C6F6164A5647479706578257468696E67732E636F6D6D616E64733A6D6F646966794665617475726550726F7065727479677468696E674964783D7A612E636F2E61677269696F2E7069766F743A70726F64312D66666135313538652D343562612D343134352D383338612D3030646265613834663537386966656174757265496469646972656374696F6E6870726F706572747978182F636F6E66696775726174696F6E2F636C6F636B776973656576616C7565F5
2021-03-15 10:40:43,733 DEBUG [30e4bd95-b0af-41a3-89e4-b9b354007e1d] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Persisting Event <things.events:featureModified>.
2021-03-15 10:40:43,742 TRACE [] o.e.d.s.u.m.i.t.StoppedKamonTimer  - Timer with name <akka-persistence-mongo.journal.scala-official.write.append> and segment <overall> was stopped after <5934025> nanoseconds
2021-03-15 10:40:43,743 INFO  [] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Successfully persisted Event <things.events:featureModified>.
2021-03-15 10:40:43,744 ERROR [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - Publisher unavailable. Dropping <org.eclipse.ditto.services.utils.pubsub.actors.Publisher$Publish@d7bc04fe>
2021-03-15 10:40:43,744 ERROR [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - Publisher unavailable. Dropping <org.eclipse.ditto.services.utils.pubsub.actors.Publisher$Publish@d7bc04fe>
2021-03-15 10:40:43,745 DEBUG [] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Handling by strategy: <ModifyFeature [type=things.commands:modifyFeature, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=7dadcfdd-4265-4adf-be5e-a459bdd854c6, mqtt.retain=false, mqtt.topic=application/1/device/5e0cfad574ac2772/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, feature=ImmutableFeature [featureId=pressure, definition=null, properties={"value":0.5406666,"warn_low":false,"warn_high":false}, desiredProperties=null]]>
2021-03-15 10:40:43,747 DEBUG [7dadcfdd-4265-4adf-be5e-a459bdd854c6] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Applying command <ModifyFeature [type=things.commands:modifyFeature, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=7dadcfdd-4265-4adf-be5e-a459bdd854c6, mqtt.retain=false, mqtt.topic=application/1/device/5e0cfad574ac2772/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, feature=ImmutableFeature [featureId=pressure, definition=null, properties={"value":0.5406666,"warn_low":false,"warn_high":false}, desiredProperties=null]]>
2021-03-15 10:40:43,747 DEBUG [7dadcfdd-4265-4adf-be5e-a459bdd854c6] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Applying command <ModifyFeature [type=things.commands:modifyFeature, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=7dadcfdd-4265-4adf-be5e-a459bdd854c6, mqtt.retain=false, mqtt.topic=application/1/device/5e0cfad574ac2772/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, feature=ImmutableFeature [featureId=pressure, definition=null, properties={"value":0.5406666,"warn_low":false,"warn_high":false}, desiredProperties=null]]>
2021-03-15 10:40:43,747 DEBUG [7dadcfdd-4265-4adf-be5e-a459bdd854c6] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Validating conditional headers with currentETagValue <"hash:3eacf45d"> on command <ModifyFeature [type=things.commands:modifyFeature, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=7dadcfdd-4265-4adf-be5e-a459bdd854c6, mqtt.retain=false, mqtt.topic=application/1/device/5e0cfad574ac2772/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, feature=ImmutableFeature [featureId=pressure, definition=null, properties={"value":0.5406666,"warn_low":false,"warn_high":false}, desiredProperties=null]]>.
2021-03-15 10:40:43,747 DEBUG [7dadcfdd-4265-4adf-be5e-a459bdd854c6] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Validating conditional headers succeeded.
2021-03-15 10:40:43,747 DEBUG [7dadcfdd-4265-4adf-be5e-a459bdd854c6] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Applying command <ModifyFeature [type=things.commands:modifyFeature, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=7dadcfdd-4265-4adf-be5e-a459bdd854c6, mqtt.retain=false, mqtt.topic=application/1/device/5e0cfad574ac2772/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, feature=ImmutableFeature [featureId=pressure, definition=null, properties={"value":0.5406666,"warn_low":false,"warn_high":false}, desiredProperties=null]]>
2021-03-15 10:40:43,752 DEBUG [7dadcfdd-4265-4adf-be5e-a459bdd854c6] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Persisting Event <things.events:featureModified>.
2021-03-15 10:40:43,758 TRACE [] o.e.d.s.u.m.i.t.StoppedKamonTimer  - Timer with name <akka-persistence-mongo.journal.scala-official.write.append> and segment <overall> was stopped after <4383579> nanoseconds
2021-03-15 10:40:43,759 INFO  [] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Successfully persisted Event <things.events:featureModified>.
2021-03-15 10:40:43,761 ERROR [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - Publisher unavailable. Dropping <org.eclipse.ditto.services.utils.pubsub.actors.Publisher$Publish@54102dda>
2021-03-15 10:40:43,761 DEBUG [] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Handling by strategy: <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=e0c0b66c-c68f-418e-abea-f55242fca30b, mqtt.retain=false, mqtt.topic=application/1/device/5e0cfad574ac2772/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, featureId=direction, propertyPointer=/configuration/clockwise, propertyValue=true]>
2021-03-15 10:40:43,761 ERROR [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - Publisher unavailable. Dropping <org.eclipse.ditto.services.utils.pubsub.actors.Publisher$Publish@54102dda>
2021-03-15 10:40:43,761 DEBUG [e0c0b66c-c68f-418e-abea-f55242fca30b] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Applying command <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=e0c0b66c-c68f-418e-abea-f55242fca30b, mqtt.retain=false, mqtt.topic=application/1/device/5e0cfad574ac2772/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, featureId=direction, propertyPointer=/configuration/clockwise, propertyValue=true]>
2021-03-15 10:40:43,762 DEBUG [e0c0b66c-c68f-418e-abea-f55242fca30b] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Applying command <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=e0c0b66c-c68f-418e-abea-f55242fca30b, mqtt.retain=false, mqtt.topic=application/1/device/5e0cfad574ac2772/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, featureId=direction, propertyPointer=/configuration/clockwise, propertyValue=true]>
2021-03-15 10:40:43,762 DEBUG [e0c0b66c-c68f-418e-abea-f55242fca30b] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Validating conditional headers with currentETagValue <"hash:4ee"> on command <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=e0c0b66c-c68f-418e-abea-f55242fca30b, mqtt.retain=false, mqtt.topic=application/1/device/5e0cfad574ac2772/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, featureId=direction, propertyPointer=/configuration/clockwise, propertyValue=true]>.
2021-03-15 10:40:43,762 DEBUG [e0c0b66c-c68f-418e-abea-f55242fca30b] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Validating conditional headers succeeded.
2021-03-15 10:40:43,763 DEBUG [e0c0b66c-c68f-418e-abea-f55242fca30b] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Applying command <ModifyFeatureProperty [type=things.commands:modifyFeatureProperty, dittoHeaders=ImmutableDittoHeaders [{mqtt.qos=0, ditto-read-revoked-subjects=[], correlation-id=e0c0b66c-c68f-418e-abea-f55242fca30b, mqtt.retain=false, mqtt.topic=application/1/device/5e0cfad574ac2772/event/up, requested-acks=[], ditto-origin=chirpstack-connection-via-mqtt, ditto-inbound-payload-mapper=chirpstack-mapping, If-Match=*, response-required=false, ditto-originator=authz1prod:9084fa99-9bc8-4cef-8506-df574412082a, ditto-auth-context={"type":"pre-authenticated-connection","subjects":["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a"]}, ditto-read-subjects=["authz1prod:9084fa99-9bc8-4cef-8506-df574412082a","authz1prod:91f28d37-57e2-49c2-8165-4753af5d369b"], ditto-entity-id=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578}], thingId=za.co.agriio.pivot:prod1-ffa5158e-45ba-4145-838a-00dbea84f578, featureId=direction, propertyPointer=/configuration/clockwise, propertyValue=true]>
2021-03-15 10:40:43,767 DEBUG [e0c0b66c-c68f-418e-abea-f55242fca30b] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Persisting Event <things.events:featurePropertyModified>.
2021-03-15 10:40:43,772 TRACE [] o.e.d.s.u.m.i.t.StoppedKamonTimer  - Timer with name <akka-persistence-mongo.journal.scala-official.write.append> and segment <overall> was stopped after <3270370> nanoseconds
2021-03-15 10:40:43,773 INFO  [] o.e.d.s.t.p.a.ThingPersistenceActor akka://ditto-cluster/system/sharding/thing/12/za.co.agriio.pivot%3Aprod1-ffa5158e-45ba-4145-838a-00dbea84f578/pa - Successfully persisted Event <things.events:featurePropertyModified>.
2021-03-15 10:40:43,776 ERROR [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - Publisher unavailable. Dropping <org.eclipse.ditto.services.utils.pubsub.actors.Publisher$Publish@55305b56>
2021-03-15 10:40:43,776 ERROR [] o.e.d.s.u.p.a.PubSupervisor akka://ditto-cluster/user/thingsRoot/thing-event-aware-pub-supervisor - Publisher unavailable. Dropping <org.eclipse.ditto.services.utils.pubsub.actors.Publisher$Publish@55305b56>
thjaeckle commented 3 years ago

@mvniekerk which version of Ditto are you running? The latest released 1.5.1? And did you ensure that all nodes are running the same Ditto version?

mvniekerk commented 3 years ago

1.5.1 All nodes running same version - it is Helm deployed

mvniekerk commented 3 years ago

The code in question that is crashing is https://github.com/eclipse/ditto/commit/12800d66d5f8b9cf4c6000a934a98261d7024038#diff-fd2a92b7b7d5db1d7a1385141ead10c3aa5a818144c6c497e527211565b8c92f

deserializeGroupedHashes

mvniekerk commented 3 years ago

Could this be a DB upgrade issue, as I've went to the latest version (using Helm)?

thjaeckle commented 3 years ago

@mvniekerk no, this cannot be related to updating the DB

thjaeckle commented 3 years ago

@mvniekerk do you have some specific configuration differing from the chart's defaults?

mvniekerk commented 3 years ago

I've got an MQTT connector added post-install (that in turns serves as a queue for Chirpstack). Although I don't expect that to be the problem seeing that the events to get persisted.

Apart from that, no.

thjaeckle commented 3 years ago

The problem seems not to be persisting the events - if you check, they should be persisted to the MongoDB (also retrieving the "thing" via the API later e.g. with a HTTP GET should work).

What isn't working for you is the Ditto internal pub/sub of the event to e.g. the Websocket .. I can however not imagine why this would fail with a ClassCastException - I also cannot reproduce. That's why I asked what could be different in your setup.

You did update an existing cluster of Ditto, didn't you? Just to rule out a problem with the "migration": could you please try setting up a complete new/fresh cluster with that version?

mvniekerk commented 3 years ago

It was an upgrade, yes. It is my prod cluster though, a complete new database will be a papercut to the eye.

mvniekerk commented 3 years ago

I've rewritten the deserializeGroupedHashes and currently building a docker image, will let you know on progress

mvniekerk commented 3 years ago

I've rewritten the deserializeGroupedHashes and currently building a docker image, will let you know on progress

Image failing to start up due a missing manifest. Will check how I can rig this and come back

mvniekerk commented 3 years ago

Changing the function:

private static List<Grouped<Long>> deserializeGroupedHashes(final scala.collection.immutable.Set<?> strings) {
        List<Grouped<Long>> ret = new ArrayList<>(strings.size());
        scala.collection.Iterator<?> stringsIter = strings.iterator();
        while (stringsIter.hasNext()) {
            Object c = stringsIter.next();
            String next;
            if (c instanceof ByteString.ByteString1C) {
                ByteString.ByteString1C nextVal = (ByteString.ByteString1C) c;
                next = nextVal.utf8String();
            } else {
                next = (String) c;
            }
            ret.add(Grouped.fromJson(JsonObject.of(next), JsonValue::asLong));
        }
        return ret;
    }

This causes exceptions: org.eclipse.ditto.json.JsonParseException: Failed to parse JSON string '��'!

Looking at the Bytestring set passed, they look like: <Set(ByteString(-125, -126), ByteString(-117, 95), ByteString(81, -78), ByteString(-40, 102), ByteString(-32, 85), ByteString(9, 9), ByteString(17, 38), ByteString(40, 19), ByteString(-10, 126), ByteString(119, 109), ByteString(107, 112), ByteString(-2, -74), ByteString(-12, 79), ByteString(-115, -93), ByteString(-112, -73), ByteString(38, 38), ByteString(-17, 17), ByteString(-18, 103), ByteString(13, -14), ByteString(-109, 57))>

Where are these bytestrings built from?

mvniekerk commented 3 years ago

I've put the *fromJson in a try/catch, and now I'm geting Websocket events.

private static List<Grouped<Long>> deserializeGroupedHashes(final scala.collection.immutable.Set<?> strings) {
    List<Grouped<Long>> ret = new ArrayList<>(strings.size());
    scala.collection.Iterator<?> stringsIter = strings.iterator();
    while (stringsIter.hasNext()) {
        Object c = stringsIter.next();
        String next;
        if (c instanceof ByteString.ByteString1C) {
            ByteString.ByteString1C nextVal = (ByteString.ByteString1C) c;
            next = nextVal.utf8String();
        } else {
            next = (String) c;
        }
        try {
            ret.add(Grouped.fromJson(JsonObject.of(next), JsonValue::asLong));
        } catch (Exception e) {
            e.printStackTrace();
        }
    }
    return ret;
}
thjaeckle commented 3 years ago

Seems that the deserializeGroupedHashes is triggered by a Replicator.Changed message which contains a different content of the event than expected with Ditto 1.5.1.

As a workaround you can set the environment variable DITTO_PUBSUB_RESTART_DELAY to 0s (defaults to 10s), this should cause that after such an error, the Publisher gets immediately restarted. However, events might still be "lost".

The only explanation I have is that some local directory to the container is still present which contains an old format of the events in Akka's "ddata". Probably the format changed between releases and we didn't notice ourself as we always create new containers instead of re-using old ones. Do you have a persistent mount or something which would cause that some old data written to the filesystem with an older Ditto version might after the update still be available?

Again, my recommdendation:

Just to rule out a problem with the "migration": could you please try setting up a complete new/fresh cluster with that version?

And I do not mean throwing away the database - that one and the data in it can remain. Just a new k8s deployment connecting to the same database.

mvniekerk commented 3 years ago

Thanks @thjaeckle Looking at the logs of the thing service, after the first few bytestrings that rolled through the try/catch of my custom container, the service is now chugging along.

As to any PVs, it is only mongodb that has one.