rchillyard / Majabigwaduce

A framework to allow MapReduce applications to use Akka actors
12 stars 4 forks source link

Cluster operations not working #26

Open rchillyard opened 2 years ago

rchillyard commented 2 years ago

We are getting a lot of WARN messages due to issues with clustering.

For background, see: https://doc.akka.io/docs/akka/current/cluster-usage.html

These log entries appear to be working:

2021-10-08 17:31:55,194 INFO akka.cluster.Cluster [MySpec-akka.actor.default-dispatcher-4] Cluster Node [akka://MySpec@127.0.0.1:58907] - Starting up, Akka version [2.6.16] ... 2021-10-08 17:31:55,461 INFO akka.cluster.Cluster [MySpec-akka.actor.default-dispatcher-4] Cluster Node [akka://MySpec@127.0.0.1:58907] - Registered cluster JMX MBean [akka:type=Cluster,port=58907] 2021-10-08 17:31:55,462 INFO akka.cluster.Cluster [MySpec-akka.actor.default-dispatcher-4] Cluster Node [akka://MySpec@127.0.0.1:58907] - Started up successfully 2021-10-08 17:31:55,603 INFO akka.cluster.Cluster [MySpec-akka.actor.default-dispatcher-4] Cluster Node [akka://MySpec@127.0.0.1:58907] - No downing-provider-class configured, manual cluster downing required, see https://doc.akka.io/docs/akka/current/typed/cluster.html#downing 2021-10-08 17:31:55,793 INFO akka.cluster.Cluster [MySpec-akka.actor.default-dispatcher-10] Cluster Node [akka://MySpec@127.0.0.1:58907] - Metrics collection has started successfully

But these do not:

2021-10-08 17:31:56,107 WARN akka.stream.Materializer [MapReduceFuncSpec-akka.actor.default-dispatcher-6] [outbound connection to [akka://ClusterSystem@127.0.0.1:2551], control stream] Upstream failed, cause: StreamTcpException: Tcp command [Connect(127.0.0.1/:2551,None,List(),Some(5000 milliseconds),true)] failed because of java.net.ConnectException: Connection refused 2021-10-08 17:31:56,107 WARN akka.stream.Materializer [MySpec-akka.actor.default-dispatcher-10] [outbound connection to [akka://ClusterSystem@127.0.0.1:2551], message stream] Upstream failed, cause: StreamTcpException: Tcp command [Connect(127.0.0.1/:2551,None,List(),Some(5000 milliseconds),true)] failed because of java.net.ConnectException: Connection refused 2021-10-08 17:31:56,108 WARN akka.stream.Materializer [MapReduceFuncSpec-akka.actor.default-dispatcher-6] [outbound connection to [akka://ClusterSystem@127.0.0.1:2552], message stream] Upstream failed, cause: StreamTcpException: Tcp command [Connect(127.0.0.1/:2552,None,List(),Some(5000 milliseconds),true)] failed because of java.net.ConnectException: Connection refused 2021-10-08 17:31:56,109 WARN akka.stream.Materializer [MySpec-akka.actor.default-dispatcher-10] [outbound connection to [akka://ClusterSystem@127.0.0.1:2551], control stream] Upstream failed, cause: StreamTcpException: Tcp command [Connect(127.0.0.1/:2551,None,List(),Some(5000 milliseconds),true)] failed because of java.net.ConnectException: Connection refused 2021-10-08 17:31:56,157 WARN akka.stream.Materializer [MySpec-akka.actor.default-dispatcher-10] [outbound connection to [akka://ClusterSystem@127.0.0.1:2552], control stream] Upstream failed, cause: StreamTcpException: Tcp command [Connect(127.0.0.1/:2552,None,List(),Some(5000 milliseconds),true)] failed because of java.net.ConnectException: Connection refused 2021-10-08 17:31:56,158 WARN akka.stream.Materializer [MapReduceFuncSpec-akka.actor.default-dispatcher-6] [outbound connection to [akka://ClusterSystem@127.0.0.1:2551], message stream] Upstream failed, cause: StreamTcpException: Tcp command [Connect(127.0.0.1/:2551,None,List(),Some(5000 milliseconds),true)] failed because of java.net.ConnectException: Connection refused 2021-10-08 17:31:56,158 WARN akka.stream.Materializer [MapReduceFuncSpec-akka.actor.default-dispatcher-6] [outbound connection to [akka://ClusterSystem@127.0.0.1:2552], control stream] Upstream failed, cause: StreamTcpException: Tcp command [Connect(127.0.0.1/:2552,None,List(),Some(5000 milliseconds),true)] failed because of java.net.ConnectException: Connection refused 2021-10-08 17:31:56,170 WARN akka.stream.Materializer [MySpec-akka.actor.default-dispatcher-10] [outbound connection to [akka://ClusterSystem@127.0.0.1:2552], message stream] Upstream failed, cause: StreamTcpException: Tcp command [Connect(127.0.0.1/:2552,None,List(),Some(5000 milliseconds),true)] failed because of java.net.ConnectException: Connection refused

rchillyard commented 2 years ago

This has been solved by using a completely different actor configuration in reference.conf