search

golemcloud / golem

Golem: Transparent durable execution for any programming language
https://learn.golem.cloud/
Apache License 2.0
161 stars 20 forks source link

shard-manager - worker executors without shard assignments #284

Open justcoon opened 3 months ago

justcoon commented 3 months ago

after rescaling worker-executor from 1 to 3 nodes (OSS golem, AWS kubernetes)

2 nodes ended without shard assignment 

2024-03-20T09:20:16.462509Z  INFO golem_shard_manager::shard_management: Executing shard assignments: [deployment-worker-executor-test-54d596d859-2cs85: [<0>..<100>, <460>..<664>], deployment-worker-executor-test-54d596d859-bfnsp: [], deployment-worker-executor-test-54d596d859-f295r: []]
2024-03-20T09:20:16.462536Z  INFO golem_shard_manager::worker_executor: Assigning shards {ShardId { value: 0 }, ShardId { value: 1 }, ShardId { value: 2 }, ShardId { value: 3 },  ... }
2024-03-20T09:20:16.462687Z  INFO golem_shard_manager::worker_executor: Assigning shards {} to pod Pod { host: "deployment-worker-executor-test-54d596d859-bfnsp", ip: 10.0.103.14, port: 9000, pod_name: Some("deployment-worker-executor-test-54d596d859-bfnsp") }
2024-03-20T09:20:16.462741Z  INFO golem_shard_manager::worker_executor: Assigning shards {} to pod Pod { host: "deployment-worker-executor-test-54d596d859-f295r", ip: 10.0.103.209, port: 9000, pod_name: Some("deployment-worker-executor-test-54d596d859-f295r") }
justcoon commented 3 months ago

shard_manager_logs.txt