Prepare observability specs

[kjduensing]

Description

Until we have endpoints and services to measure, we can't set up monitors and alerts for our endpoints. However, we can prepare for this by documenting the attributes we'd like to measure (latency, error rate, etc) and setting up a blank datadog dashboard for our team. This will help us hit the ground running and ensure all engineers have the appropriate access to datadog.

Acceptance Criteria

• [x] List of observability attributes created & documented
• [x] Blank datadog dashboard set up for our team
• [ ] All onboarded engineers can access the blank datadog dashboard

Demo

• Demoable? Sorta
• How? Show the blank dashboard (not that impactful), show the list of observability traits
• Impact? This will help us hit the ground running and ensure all engineers have the appropriate access to datadog.

Definition of Done

• [ ] All acceptance criteria are met
• [ ] Documentation is updated

[kjduensing]

Initial list of observability metrics

[kjduensing]

Blocked by missing datadog access. Status: Ticket Created

[kjduensing]

Blank Travel Pay performance dashboard created. Not there are 2 Travel-Pay related dashboards in addition to ours, scoped to the Check in team.

[kjduensing]

@hinzed1127 Could you please submit a ticket for Datadog "standard" access using these instructions?