-
* 洋葱网络 tor
* 随机选择一个代理 [scrapy-proxies](https://github.com/aivarsk/scrapy-proxies)
* 一些免费代理 [xiaoer](http://www.xiaoerdaili.com/) [西刺](https://www.xicidaili.com/)
* 收费集成代理 [scrapy-crawlera](https://…
-
![image](https://user-images.githubusercontent.com/43572770/100686233-d7a75980-33b8-11eb-8c62-8484a15881eb.png)
Clone issue: https://github.com/scrapy-plugins/scrapy-splash/issues/272
-
In the docs you mention
```
# You need also to change the default download handlers, like so:
DOWNLOAD_HANDLERS = {
"http": "scrapy_selenium.SeleniumDownloadHandler",
"https": "scrapy_sel…
-
as these are fixed, remove the entry from KNOWN_ISSUES in cli/_tests/test_scrapy_crawl
INFO moin.cli._tests.test_scrapy_crawl:test_scrapy_crawl.py:84 expected {200} got 404 for url="https://www.…
-
Testing with latest version of Scrapy, I found out that yielding `Dataclass objects` do not work with `scrapy-deltafetch`. If the object type is changed to `scrapy.item.Item` the plugin works as inten…
-
I propose to add some special character to the [`utils.misc.load_object`](https://github.com/scrapy/scrapy/blob/master/scrapy/utils/misc.py#L31) function's `path` argument, for example `:` to mark att…
-
Scrapy provides built-in support for exporting data through FTP. [FTP is considered insecure](https://bandit.readthedocs.io/en/latest/blacklists/blacklist_imports.html#b402-import-ftplib).
We shoul…
-
An example of documentation https://github.com/scrapy-plugins/scrapy-splash (section "Examples") has the code:
```
script = """
function main(splash)
splash:init_cookies(splash.args.cookies)
…
-
Not sure how to help diagnose this, but we started getting Timeout Errors after we started using `2.3.0`. `2.3.1` doesn't solve the issue either, but downgrading to `v2.2.0` works.
Please let me kn…
-
I made a yaml file through your browser plugin.
In the preview of the browser plugin it shows the correct data, however when used with Scrapy it returns something else.
https://i.imgur.com/gNfnoAH…