Open jefcolbi opened 3 weeks ago
Sometimes the crawler freezes because there is no timeout defined for the http request.
We can prevent that by passing a timetout argument.
Sometimes the crawler freezes because there is no timeout defined for the http request.
We can prevent that by passing a timetout argument.