Update/remove documentation on the 'revisiting backend'

scrapinghub / frontera

A scalable frontier for web crawlers

BSD 3-Clause "New" or "Revised" License

1.29k stars 215 forks source link

Update/remove documentation on the 'revisiting backend' #392

Open anjackson opened 4 years ago

anjackson commented 4 years ago

The documentation refers to a 'revisiting backend' (e.g. https://frontera.readthedocs.io/en/latest/topics/frontera-settings.html#revisiting-backend) but this appears to have been removed. I guess those parts of the documentation should be removed?

sibiryakov commented 4 years ago

Yes, these are outdated @anjackson.

Prometheus3375 commented 4 years ago

Have the documentation updated? Quick search through sources shows that setting SQLALCHEMYBACKEND_REVISIT_INTERVAL is unused. I think this setting should be removed from default in sources and from documentation.