Create ability to restart crucial forest core methods upon crash

mobilecoinofficial / forest

Enables a Forest of MobileCoin enabled SignalBots. Beta software, APIs may change!

MIT License

19 stars 12 forks source link

Closed iamalwaysuncomfortable closed 2 years ago

iamalwaysuncomfortable commented 2 years ago

Create a separate file (which should be a future place for self repair/health-check service.) that intakes coroutines representing crucial services and adding an error handling callback onto them
Error handler ensures a log message is sent
Error handler also allows an error handler function to be passed
For handle_messages this restarts the service if it crashes

itdaniher commented 2 years ago

need to increment the key at '${{ runner.os }}-pipenv-v8-${{ hashFiles(''**/Pipfile.lock'') }}' in .github/workflows/checks.yml and rerun ci

itdaniher commented 2 years ago

this is a little more complex than I want, but also not bad

itdaniher commented 2 years ago

Got this passing. Should probably check that it recovers auxin-cli from network failures.

itdaniher commented 2 years ago

So this doesn't actually recover from the set of failures we've encountered, which I think is an Auxin bug?

itdaniher commented 2 years ago

iamalwaysuncomfortable commented 2 years ago

Ready for final review/approval