Refactored Clear Expired Jobs Script to Make HTTP Requests Asynchrono…

[cormacjmollitor]

…usly

🔨 Changes

HTTP requests to job URL's are now asynchronous

:squirrel: Testing instructions

📄 Relevant screenshots or documentation links

:clipboard: Checklist

• [ ] My code follows the style guidelines of this project
• [ ] I have performed a self-review of my own code
• [ ] I have commented my code, particularly in hard-to-understand areas
• [ ] I have made corresponding changes to the documentation
• [ ] My changes generate no new warnings
• [ ] I have added tests that prove my fix is effective or that my feature works
• [ ] New and existing unit tests pass locally with my changes

[cowmanjoe]

I'm getting occasional hanging and I'm not sure why. Maybe we should have a timeout on each individual HTTP request so that one HTTP request can't hang the whole thing.

Also, I think there may be a rate limit for hitting ZipRecruiter website jobs (jobs with link at ziprecruiter.com domain) because I got this notice when trying to access a job manually: .

This was when I tried to do this multiple times on over 1000 jobs. One other thing that happened when it didn't hang though is that it deleted jobs on the second run that weren't deleted on the first run. Any ideas on why this would be happening? Sorry for the long comment that really only raised a bunch of hard questions :/