Docs: BaseCrawlingStrategy._refresh_states() also takes a non iterab…

scrapinghub / frontera

A scalable frontier for web crawlers

BSD 3-Clause "New" or "Revised" License

1.29k stars 216 forks source link

Docs: BaseCrawlingStrategy._refresh_states() also takes a non iterab… #355

Closed IAlwaysBeCoding closed 5 years ago

IAlwaysBeCoding commented 5 years ago

…le for the requests parameter.

It is important to disclose that _refresh_states() also takes a non iterable for the requests parameter. Eventually, refresh_and_keep() converts the non iterable object into a non-iterable object contained within a list.

sibiryakov commented 5 years ago

thanks man!

IAlwaysBeCoding commented 5 years ago

No problem @sibiryakov . You are doing a really good job at keeping frontera updated, saved me hundred of hours by using your framework than a poorly build in-house made solution.

Keep up the great work!