At first notifications will arrive roughly at the same speed as before
but the delay starts increasing gradually over time. Keep-alive is still
tested with the same frequency but failures in between notifications are
only logged with the next notification threshold included.
Fixes #317
Also includes merging Docker changes from main -> dev
A Docker image has been built for testing: ghcr.io/artanicus/chiadog:keepalive_antispam-f73494
Example log output with extra debug and a shorter 60s threshold for the benefit of better seeing what's going on:
[2022-01-14 23:14:09] [ INFO] --- Connected HDD? The total plot count increased from 0 to 153. (non_decreasing_plots.py:33)
[2022-01-14 23:15:50] [ WARNING] --- Your harvester appears to be offline! No events for the past 101 seconds. (Iteration 0) (keep_alive_monitor.py:111)
[2022-01-14 23:16:51] [ WARNING] --- Your harvester appears to be offline! No events for the past 161 seconds. (Iteration 1) To avoid flooding you, the next notification won't be sent before 2022-01-14 23:17:20.696072 (keep_alive_monitor.py:111)
[2022-01-14 23:17:51] [ WARNING] --- Your harvester appears to be offline! No events for the past 221 seconds. (Iteration 1) (keep_alive_monitor.py:111)
[2022-01-14 23:18:52] [ WARNING] --- Your harvester appears to be offline! No events for the past 282 seconds. (Iteration 2) (keep_alive_monitor.py:111)
[2022-01-14 23:19:52] [ WARNING] --- Your harvester appears to be offline! No events for the past 342 seconds. (Iteration 3) (keep_alive_monitor.py:111)
[2022-01-14 23:20:52] [ WARNING] --- Your harvester appears to be offline! No events for the past 403 seconds. (Iteration 4) To avoid flooding you, the next notification won't be sent before 2022-01-14 23:20:54.446072 (keep_alive_monitor.py:111)
[2022-01-14 23:21:52] [ WARNING] --- Your harvester appears to be offline! No events for the past 463 seconds. (Iteration 4) (keep_alive_monitor.py:111)
[2022-01-14 23:22:53] [ WARNING] --- Your harvester appears to be offline! No events for the past 524 seconds. (Iteration 5) To avoid flooding you, the next notification won't be sent before 2022-01-14 23:23:26.321072 (keep_alive_monitor.py:111)
[2022-01-14 23:23:53] [ WARNING] --- Your harvester appears to be offline! No events for the past 584 seconds. (Iteration 5) (keep_alive_monitor.py:111)
[2022-01-14 23:24:53] [ WARNING] --- Your harvester appears to be offline! No events for the past 644 seconds. (Iteration 6) To avoid flooding you, the next notification won't be sent before 2022-01-14 23:27:14.133572 (keep_alive_monitor.py:111)
[2022-01-14 23:25:53] [ WARNING] --- Your harvester appears to be offline! No events for the past 704 seconds. (Iteration 6) To avoid flooding you, the next notification won't be sent before 2022-01-14 23:27:14.133572 (keep_alive_monitor.py:111)
[2022-01-14 23:26:54] [ WARNING] --- Your harvester appears to be offline! No events for the past 764 seconds. (Iteration 6) To avoid flooding you, the next notification won't be sent before 2022-01-14 23:27:14.133572 (keep_alive_monitor.py:111)
[2022-01-14 23:27:54] [ WARNING] --- Your harvester appears to be offline! No events for the past 824 seconds. (Iteration 6) (keep_alive_monitor.py:111)
[2022-01-14 23:28:54] [ WARNING] --- Your harvester appears to be offline! No events for the past 884 seconds. (Iteration 7) To avoid flooding you, the next notification won't be sent before 2022-01-14 23:32:55.852322 (keep_alive_monitor.py:111)
[2022-01-14 23:29:54] [ WARNING] --- Your harvester appears to be offline! No events for the past 945 seconds. (Iteration 7) To avoid flooding you, the next notification won't be sent before 2022-01-14 23:32:55.852322 (keep_alive_monitor.py:111)
[2022-01-14 23:30:54] [ WARNING] --- Your harvester appears to be offline! No events for the past 1005 seconds. (Iteration 7) To avoid flooding you, the next notification won't be sent before 2022-01-14 23:32:55.852322 (keep_alive_monitor.py:111)
[2022-01-14 23:31:54] [ WARNING] --- Your harvester appears to be offline! No events for the past 1065 seconds. (Iteration 7) To avoid flooding you, the next notification won't be sent before 2022-01-14 23:32:55.852322 (keep_alive_monitor.py:111)
[2022-01-14 23:32:54] [ WARNING] --- Your harvester appears to be offline! No events for the past 1125 seconds. (Iteration 7) To avoid flooding you, the next notification won't be sent before 2022-01-14 23:32:55.852322 (keep_alive_monitor.py:111)
[2022-01-14 23:32:58] [ WARNING] --- Experiencing networking issues? Harvester did not participate in any challenge for 1128 seconds. It's now working again. (time_since_last_farm_event.py:40)
[2022-01-14 23:33:55] [ INFO] --- incident for EventService.HARVESTER is over (keep_alive_monitor.py:115)
[2022-01-14 23:35:55] [ WARNING] --- Your harvester appears to be offline! No events for the past 95 seconds. (Iteration 0) (keep_alive_monitor.py:111)
[2022-01-14 23:36:56] [ WARNING] --- Your harvester appears to be offline! No events for the past 156 seconds. (Iteration 1) To avoid flooding you, the next notification won't be sent before 2022-01-14 23:37:25.442751 (keep_alive_monitor.py:111)
[2022-01-14 23:37:56] [ WARNING] --- Your harvester appears to be offline! No events for the past 216 seconds. (Iteration 1) (keep_alive_monitor.py:111)
[2022-01-14 23:38:56] [ WARNING] --- Your harvester appears to be offline! No events for the past 276 seconds. (Iteration 2) (keep_alive_monitor.py:111)
[2022-01-14 23:39:02] [ WARNING] --- Experiencing networking issues? Harvester did not participate in any challenge for 282 seconds. It's now working again. (time_since_last_farm_event.py:40)
[2022-01-14 23:39:56] [ INFO] --- incident for EventService.HARVESTER is over (keep_alive_monitor.py:115)
Fixes #317
main->devghcr.io/artanicus/chiadog:keepalive_antispam-f73494