This commit configures Redis priority queues and task routes for Celery. It sets up the queue order strategy as "priority" and defines 10 priority levels (0-9). The task routes are also defined, with "process_file_and_notify" having the highest priority (9), "process_crawl_and_notify" having priority 8, and all other tasks having a default priority of 5.

Note: This commit message does not include any issue references, tags, or author names.

Description

Please include a summary of the changes and the related issue. Please also include relevant motivation and context.

Checklist before requesting a review

Please delete options that are not relevant.

[ ] My code follows the style guidelines of this project
[ ] I have performed a self-review of my code
[ ] I have commented hard-to-understand areas
[ ] I have ideally added tests that prove my fix is effective or that my feature works
[ ] New and existing unit tests pass locally with my changes
[ ] Any dependent changes have been merged

QuivrHQ / quivr

chore: Configure Redis priority queues and task routes for Celery #2720

Description

Checklist before requesting a review

Screenshots (if appropriate):