Setup Athena for better data and log search - Githubissues

cds-snc / platform-forms-client

NextJS application that serves the public-facing website for Forms

https://forms-staging.cdssandbox.xyz/

MIT License

31 stars 13 forks source link

Setup Athena for better data and log search #3586

Open srtalbot opened 1 month ago

srtalbot commented 1 month ago

Description:

Athena can join our varied log applications into a single search for easier querying.

Key user stories for searching logs

As a security analyst I need to know:

Which form a response is connected to
Who owns the form
The history of the form (when it was published, how long it was live for, if it is still live)

So that I can investigate an incident

Acceptance criteria:

[ ] Decide on an initial approach for parse and search system logs.
[ ] Implement the log streams to Athena
[ ] Write the queries for the stories above.
[ ] Update tips and tricks for on-call with specific queries to get the information in the story above.
[ ] ...

wmoussa-gc commented 1 week ago

Draft design document started: Design Doc 00XX - Athena Federated Query