-
**Describe the bug**
Ive set the option DATABASE_URL to support MySQL in a correct format and restart scrapydweb,but no DBS in [DB_APSCHEDULER, DB_TIMERTASKS, DB_METADATA, DB_JOBS] had been created a…
-
The Jobs table in the web interface is really bare. The Scrapy stats collector contains a lot of valuable data, which should be included in this table.
I see a few ways of accessing this data:
1. Par…
-
### Apache Airflow version
2.3.4
### What happened
I am trying to `pip install` a few packages to my custom docker image. Here is my custom dockerfile.
```
FROM apache/airflow:2.3.4
RUN pip…
nodox updated
2 years ago
-
I have the following spider:
```python
# Python
from typing import Any, Dict, Iterator, List
from urllib.parse import urlparse
# 3rd Party
from scrapy.spiders import CrawlSpider, Rule
from …
dsism updated
2 years ago
-
Vulnerable Library - Scrapy-1.5.1-py2.py3-none-any.whl
A high-level Web Crawling and Web Scraping framework
Library home page: https://files.pythonhosted.org/packages/5d/12/a6197eaf97385e96fd8ec5662…
-
I have a few concerns with the number of instances available to page when using playwright integration with scrapy.
Perhaps I have not yet fully understood the integration (lack of documentation do…
-
Hi
While reading scrapy documetation ("Selector" segment) it is recommended to first select the class by css then apply either Xpath or regex. we have regex in GUI but not xpath.
to further explai…
-
Hi there,
is it possible to bump a 1.3 version? It would be good to have a version with support for Basic Authentication #326
Thanks
-
### Bug description
When parsing the following file:
```python
#!/usr/bin/env python3
"""
General Utilities
(part of web.py)
"""
import datetime
import os
import re
import shutil
i…
-
Seeing thousands of these logs on our cloud:
> ERROR Piwik\ExceptionHandler[2021-07-05 23:57:59 UTC] [52b29 demo-proxy.innocraft.cloud] /core/SupportedBrowser.php(68): Your browser is not supported…