issues
search
indrajithi
/
tiny-web-crawler
A simple and easy to use web crawler for Python
MIT License
55
stars
11
forks
source link
Implement a retry mechanism for transient errors
#39
Open
indrajithi
opened
1 week ago
indrajithi
commented
1 week ago
Use exponential delay in retry controlled by a
max_retry_attempts=5
(this can be hardcoded and need not be accepted as a param from user)
max_retry_attempts=5
(this can be hardcoded and need not be accepted as a param from user)