-
Currently, `conf.projects` can contain a mixture of integers and dictionaries. E.g., the configuration file
```
projects:
default: 12345
prod:
id: 33333
stack: scrapy:1.1
```
W…
-
https://jupyter.scrapinghub.com/user/user-redirect/lab/tree/shared/QA/New%20projects/NOTHS/google.co.uk/DoD-1100_google_completion_Oleksandr.ipynb
If to download the csv format of data then the issue…
-
I run a splash server in the docker.
commond: `docker run -p 8050:8050 scrapinghub/splash --max-timeout 3600`
But I got a 504 error.
`"error": {"info": {"timeout": 30}, "description": "Timeout exc…
-
Hello all, a user has submitted an IDEA on https://ideas.digitalocean.com/ideas/DO-I-1045 as follows:
> 1
> VOTE
> Create a Portia 1-Click application
>
> This is a little visual scrapper.
>…
-
Currently (as of 3393bb8) this package has got [a list of dependencies](https://github.com/scrapinghub/shub-workflow/blob/3393bb8/setup.py#L14) which is in conflict to some other commonly required one…
-
Not a bug, just a question. I want to run a python script (as a job), it seems it should be possible to do. You can do this in scrapinghub.
Thanks for the great package!
-
DQR responds with this error: `validate() got an unexpected keyword argument 'df'`
https://github.com/scrapinghub/arche/commit/9fd17df193917773e0f72cc0ca001a5506febf9e#r33664865 - possible place to s…
-
For the moment cross-python-versions fixtures work only if the fixtures/tests are generated in Python 3.
This means that if you generate your fixtures in Python3, you would be able to test them in ei…
-
```
from kafka import KafkaConsumer
from frontera.contrib.backends.remote.codecs.msgpack import Encoder as MsgPackEncoder, Decoder as MsgPackDecoder
from frontera.core.models import Request, Respon…
ghost updated
5 years ago
-
I'm running extruct using docker, however have a problem
```
FROM python:3.5
#see https://github.com/scrapinghub/extruct
RUN pip install bottle
RUN pip install gevent
RUN pip install requests…