-
Hi,
I do not understand how to set `meta` parameters in a frontier Request generated from a seeder.
It seems that there are two kinds of meta parameters: frontier ones and scrapy ones. I would like to…
-
With this snippet:
```python
# dateparser==0.7.0 ( also reproduces on master branch )
import dateparser
import datetime
import pytz
settings = { "RELATIVE_BASE": datetime.datetime.now().re…
-
Are there any plans to add support for date format like this one: `'over a week ago'`? Facebook is using it so might be relevant in the near future.
I can take on this feature if you want and submi…
-
There's a way to specify where to create the tests https://scrapy-poet.readthedocs.io/en/stable/testing.html#configuring-the-test-location, but actual paths may look like this: `some_project/tests/fix…
-
Some web pages contain badly formatted JSON-LD data, e.g., [an example](https://www.debenhams.com/webapp/wcs/stores/servlet/prod_10701_10001_60742+1515029001_-1)
The JSON-LD in this page is:
```
…
-
One of the major use after building the ` number-parser ` might be to integrate it with ` price-parser ` and ` dateparser ` as suggested by @noviluni .
There are many features that are similar in th…
-
**Running ubuntu on VM VirtualBox**
**Running ifconfig command:**
>docker0: flags=4099 mtu 1500
inet 172.17.0.1 netmask 255.255.0.0 broadcast 172.17.255.255
inet6 fe80::42:9…
-
Dear contributers, dear community,
I'd like to build a web-application in python that can be extended using lua scripts. These extensions are contributed by affiliated developers, and in general, the…
-
Crawlera only provides proxies and that will only serve us its purpose if scraping fails because bitcointalk blocked our IP. If bitcointalk uses cloudflare to detect and block scraper bots (which I ha…
-
What do you think about moving the project to @scrapy organization, as it is used in Scrapy tutorial? We may also rename the project to quotes.toscrape.com, to make it more discoverable.
kmike updated
7 years ago