eosnetworkfoundation / eos-evm-contract

EOS EVM
MIT License
22 stars 14 forks source link

SMS Alerting for EVM Infrastructure Health Checks #603

Closed kj4ezj closed 11 months ago

kj4ezj commented 1 year ago

As part of an epic for a unified metrics and alerting system around EVM infrastructure, this ticket is to send alerts relating to the EVM AWS infrastructure health checks to arbitrary SMS phone numbers.

https://docs.aws.amazon.com/sns/latest/dg/sns-mobile-phone-number-as-subscriber.html

See Also

engineering issue 68 - EVM Monitoring and Alerting - Phase 1

  1. eos-evm issue 602 - Funnel EVM Health Checks into CloudWatch
  2. engineering issue 48 - Collaborate with Operations on Unified Dashboarding Solution
  3. engineering issue 49 - Create Bot to Alert via IM on Specific Metrics
  4. eos-evm issue 603 - SMS Alerting for EVM Infrastructure Health Checks
  5. engineering issue 65 - Email Alerting for EVM Infrastructure Health Checks
  6. telegram-bot issue 1 - Open-Source This Repo
  7. engineering issue 57 - Create Telegram Service Account
  8. engineering issue 58 - Create EVM Testnet Alert Channel Using Telegram Service Account
  9. engineering issue 64 - Create EVM Mainnet Alert Channel Using Telegram Service Account
  10. engineering issue 66 - Fix EVM CloudWatch Alerts
  11. telegram-bot issue 2 - Human-Friendly Alerts
  12. engineering issue 71 - EVM Alerts for APAC Infrastructure
  13. telegram-bot issue 3 - Alert Bot Maintainer via Telegram on Errors
kj4ezj commented 1 year ago

The United States of America has implemented new regulations for telephone carriers beginning 2023-08-01 to combat spam SMS and phone calls. These regulations require telephony carriers to verify the owner's identify before they can acquire various types of phone numbers used to send messages to distribution lists, including but not limited to "toll-free numbers."

As such, Amazon no longer sends SMS messages from a unified SNS "origination" SNS phone number, each customer must obtain a unique number. These numbers can also no longer be obtained instantly. Amazon's telephony partners must manually verify our identity before issuing us a phone number to be used to send SMS notifications.

I have applied for an "origination" phone number for every ENF AWS account, but the verification process is expected to take as long as 2023-08-14 to complete. That means we may not be able to send SMS messages until that date.

Moreover, the new regulations require that SMS recipients explicitly verify their phone number by clicking a link. We will also be limited to ten (10) destination numbers. If we wish to send SMS notifications to more than ten phone numbers, we will need to apply to Amazon to have this restriction lifted.

This system is built out, and I was able to test it using email notifications instead. I will keep this ticket open until we are granted "origination" phone numbers.

kj4ezj commented 11 months ago

Our SMS origination numbers were approved around a month ago. We have one for the testnet, and one for the mainnet. Please reach out to ENF Automation to have your phone number added to receive SMS alerts. Under US law, you will have to confirm your "subscription" by clicking an AWS link.