Evaluate AWS Aurora for the Scorer as a Cost-Effective Alternative to Our Current RDS Instance

nutrina commented 7 months ago

Objective: Given the significant idle time in our current database (over 90% idle), we aim to explore AWS Aurora as a potential replacement for our RDS instance to optimize costs and evaluate performance impacts.

Tasks to Complete:

1. Provisioning: Provision an AWS Aurora instance in the staging environment, while retaining the existing RDS instance for comparison purposes. 2. Configuration: Configure autoscaling on the AWS Aurora instance to ensure it meets our operational requirements during varying load conditions. 3. Performance Testing: Conduct load testing on both the Aurora and current RDS setups. Tests should measure:

Throughput: Number of Passports created within a specific time frame.
Success Rates: Number of successful requests processed. *4. Observation: Monitor and record the autoscaling behavior of Aurora during traffic spikes to assess response times and scaling efficiency.

Expected Outcomes:

1. Performance Comparison: Detailed comparison of performance under high load scenarios focusing on: a. Throughput capabilities (e.g., Passport creation rate). b. Request success rate. 2. Scalability Analysis: Insights into the responsiveness and efficiency of Aurora's autoscaling feature during unexpected traffic surges. 3. Cost Analysis: A comprehensive cost analysis predicting monthly expenditures when using Aurora, considering both operational and idle times.

Acceptance Criteria:

Successfully deploy AWS Aurora in the staging environment without impacting existing services.
Autoscaling is set up and demonstrably responsive to simulated load changes.
Load testing results are documented, showing clear comparisons in performance and cost between Aurora and the current RDS setup.
Final report includes actionable recommendations based on performance metrics, scalability observations, and cost analysis.

Timebox for this is 2 days.

nutrina commented 6 months ago

The results for the aurora test has been posted here. Looks very promising. But we should make a comparison, where we look at the same test setup run at the DB instance and then run against Aurora

larisa17 commented 6 months ago

More details about the Aws Aurora setup & test results can be found at https://www.notion.so/gitcoin/Passport-Scorer-Aurora-DB-16ff9e2fdcd84dd885beb4cbe56419d7

passportxyz / passport

Evaluate AWS Aurora for the Scorer as a Cost-Effective Alternative to Our Current RDS Instance #2444