Scaling submission scripts across multiple machines

stopstalk / stopstalk-deployment

Stop stalking and start StopStalking :wink:

https://www.stopstalk.com

MIT License

314 stars 96 forks source link

Scaling submission scripts across multiple machines #336

Open raj454raj opened 5 years ago

raj454raj commented 5 years ago

How do we scale across machines and divide the submission fetching scripts and perform submission table insertions atomically ?

raj454raj commented 5 years ago

Not immediately required right now, the current one is now optimized enough to be handled by one machine. This could be a great restructuring project though.