-
### Description
The `OffsiteMiddleware` logs a single message for each domain filtered. Great!
But then the `core.engine` logs a message for every single url filtered by the OffsiteMiddleware.
(L…
-
If I have said anything impolite, please forgive me, as I have used a translator. My basic situation is the same as this issue [Spiders hangs](https://github.com/scrapy-plugins/scrapy-playwright/issue…
-
I have a [crawler written in scrapy](https://github.com/Princeton-CDH/caliper-scrapy/blob/main/caliper/spiders/caliper_spider.py) that I would love to port to spider-py, but I can't figure out how to …
-
Pytest sometimes hangs arbitrarily:
```
2024-07-21T10:08:37.7202349Z PASSED [ 27%]
2024-07-21T10:08:37.7260128Z bbot/test/test_st…
-
I have a threading Web spider using httpx that is triggering a race condition in anyio/_core/_eventloop.py's get_asynclib() function. This race can be triggered if you have a lot of threads trying to …
-
## Description
browserless have default browser session timeout as 30s by default https://docs.browserless.io/Docker/docker#connection-timeout, this can be turned off by setting `-1` in the browserle…
-
I have tested it on win11, please check it, hope it helpful.
scrapy_playwright/handler.py :
```python
import asyncio
import logging
from contextlib import suppress
from dataclasses import da…
-
## Problem Description
Spyder completely freezes when clicking open file.
### What steps reproduce the problem?
1. Install the latest miniconda (python 3.9).
2. Install spyder 5.1.1 from con…
-
After tests have passed, pytest sometimes fails to exit:
```
2024-07-16T00:58:54.0119865Z VERBOSE bbot.core.httpengine:engine.py:399 Got shutdown signal, shutting down...
2024-07-16T00:58:54.124…
-
Hi,
I have a strange issue where I am receiving a 400 response from Google after clicking on the "I agree" button on their consent form.
![after_span](https://user-images.githubusercontent.com/1…