littermap / littermap-aws-backend

Cloud-native backend for the Litter Map application -- (Join us on: https://discord.gg/JvEQMSQaYr)
https://littermap.com
GNU Affero General Public License v3.0
3 stars 2 forks source link

Add searches for Cloudwatch Log Insights #8

Open specious opened 2 years ago

specious commented 2 years ago

CloudWatch Logs Insights is an AWS feature introduced in 2018 that makes it possible to search and analyze CloudWatch log data over chosen time periods using a specialized query language.

Add relevant search queries to the serverless stack template (as in aws-samples/cloudwatch-logs-insights-queries) so they are then available as default queries in the console.

specious commented 2 years ago

As an aside, a more comprehensive and flexible but also expensive and technically heavy solution for indexing and searching logs is to hand the logs over to OpenSearch (Amazon's fork of the legendary Elasticsearch distributed full-text search and analytics engine), but as the article explains, it is not a pure serverless solution and will incur expenses for persistent computing resources and require more operational expertise on the backend team.

This may be something to keep in mind and to consider in the future.