Description: Design and implement a system to schedule and manage background scraping jobs based on user-defined schedules.
Testing:
• Unit tests for job scheduling logic
• Integration tests simulating job execution over time
Questions/Considerations:
• How do we handle missed or failed jobs?
• What's our strategy for distributing jobs to maintain the 5-job concurrency limit?
Dependencies: SeshuJobs Table Design, Scraping Schedule Selection UI
Description: Design and implement a system to schedule and manage background scraping jobs based on user-defined schedules. Testing: • Unit tests for job scheduling logic • Integration tests simulating job execution over time Questions/Considerations: • How do we handle missed or failed jobs? • What's our strategy for distributing jobs to maintain the 5-job concurrency limit? Dependencies: SeshuJobs Table Design, Scraping Schedule Selection UI