fecgov / fecfile-web-api

Back-end API for FECfile application
7 stars 2 forks source link

Celery report summary calculation does not finish with over 400 transactions #920

Open Elaine-Krauss-TCG opened 2 weeks ago

Elaine-Krauss-TCG commented 2 weeks ago

Business Reason

When a report has hundreds of transactions, its summary page should finish calculating as expected.

QA Notes

Report calculation should finish and return expected values when a report has hundreds of transactions.

Work with devs to load 500 transactions in DEV to test performance is responsive.

DEV Notes

The summary calculation is done by a Celery worker so this ticket will include figuring out how to get Silk metrics from the code run in the worker: https://github.com/fecgov/fecfile-web-api/blob/develop/django-backend/fecfiler/web_services/summary/views.py

After loading the bulk-testing-data fixture, report summary pages with 400+ transactions do not finish calculating, but they don't fail or error out either. In this ticket, the developer should investigate the summary calculation process to determine why it is non-terminating and to find opportunities for performance improvements.

For QA, create a report in an available committee that has a report with 500 transactions for testing. Provide the report loaded to QA for testing.

Design

null

FECFILE-1428