search

q-m / scrapy-webarchive

A plugin for Scrapy that allows users to capture and export web archives in the WARC and WACZ formats during crawling.
http://developers.thequestionmark.org/scrapy-webarchive/
2 stars 0 forks source link

Compatibility with Scrapy #4

Closed leewesleyv closed 1 month ago

leewesleyv commented 1 month ago

Currently the version of Scrapy is pinned to 2.11.2 (in pyproject.toml). We want to see if we can support a larger range of Scrapy versions.

leewesleyv commented 1 month ago

With this we also need to think about the Python versions that we want to/can support.

wvengen commented 1 month ago

Ideally, I guess, all officially supported Python versions + any older versions we need to support. https://www.python.org/downloads/ lists six currently supported minor versions.

leewesleyv commented 1 month ago

With Python 3.8 EOL I think we should drop that. But it seems that Scrapy does not officially support Python 3.13 yet, so I would say that we follow whatever Scrapy is doing.

leewesleyv commented 1 month ago

Resolved in #13

Will open a new ticket for Python 3.13 support (where we are dependent on Scrapy's official Python 3.13 support).