Then the workload is stuck at 7/10 progress. Adding additional seems to do the trick, the task succeeded with 4 provider nodes.
Those provider nodes were running for about 24h, then I tried to run the task again and the job was stuck at 7/10 again. Adding a fresh provider node did the trick again.
b09..a07693ff'
INFO [golem.task.taskrequestorstats ] Received work offers. offer_count=500, task_id='7aca90ac-824d-11ea-b476-6110940bba10'
INFO [apps.wasm ] Node 1acb9b09d2d097819b1031ad7e918a8708bd0b24943900e1d704d1c968f22d7a3e5bff1e9a8a769468b11db46d6783358dfd0468fd14d0df6ee6adcea07693ff has been blacklisted for this task
INFO [golem.task.taskserver ] provider 1acb9b09d2d097819b1031ad7e918a8708bd0b24943900e1d704d1c968f22d7a3e5bff1e9a8a769468b11db46d6783358dfd0468fd14d0df6ee6adcea07693ff is not allowed for this task at this moment (either waiting for results or previously failed)
INFO [golem.task.tasksession ] Received offer to compute. task_id='7aca90ac-824d-11ea-b476-6110940bba10', node='37c64f7a..d543ea5a'
INFO [golem.task.taskrequestorstats ] Received work offers. offer_count=501, task_id='7aca90ac-824d-11ea-b476-6110940bba10'
INFO [apps.wasm ] Node 37c64f7acb93ce0cd899cd2dd5d8ab9619e794df8c0063b683ccce1c57ea8e7d906161f3fb32d1086d3da620a2eebaa8b2a677e0f6f82f93944b512dd543ea5a has been blacklisted for this task
INFO [golem.task.taskserver ] provider 37c64f7acb93ce0cd899cd2dd5d8ab9619e794df8c0063b683ccce1c57ea8e7d906161f3fb32d1086d3da620a2eebaa8b2a677e0f6f82f93944b512dd543ea5a is not allowed for this task at this moment (either waiting for results or previously failed)
INFO [golem.task.tasksession ] Received offer to compute. task_id='7aca90ac-824d-11ea-b476-6110940bba10', node='1acb9b09..a07693ff'
INFO [golem.task.taskrequestorstats ] Received work offers. offer_count=502, task_id='7aca90ac-824d-11ea-b476-6110940bba10'
INFO [apps.wasm ] Node 1acb9b09d2d097819b1031ad7e918a8708bd0b24943900e1d704d1c968f22d7a3e5bff1e9a8a769468b11db46d6783358dfd0468fd14d0df6ee6adcea07693ff has been blacklisted for this task
INFO [golem.task.taskserver ] provider 1acb9b09d2d097819b1031ad7e918a8708bd0b24943900e1d704d1c968f22d7a3e5bff1e9a8a769468b11db46d6783358dfd0468fd14d0df6ee6adcea07693ff is not allowed for this task at this moment (either waiting for results or previously failed)
Description
Golem Version: 0.22.2
Golem-Messages version (leave empty if unsure):
Electron version (if used): N/A
OS: Ubuntu 18.04
Branch (if launched from source): develop
Mainnet/Testnet: testnet
Description of the issue:
I setup a subnet of nodes on one machine, which doesn't have a public IP address, as described in this wiki page
I created 1 requestor and 2 provider nodes. Then I used
gwasm-runner
to launch thehello-gwasm-runner
task as:Then the workload is stuck at 7/10 progress. Adding additional seems to do the trick, the task succeeded with 4 provider nodes.
Those provider nodes were running for about 24h, then I tried to run the task again and the job was stuck at 7/10 again. Adding a fresh provider node did the trick again.
Logs and any additional context
Excerpt from the requestor logs: