-
I accidentally posted my apikey to GH with debug output, like this
```
(Pdb) conf.get_target_conf(108106)
Target(project_id=108106, endpoint='https://app.scrapinghub.com/api/', apikey='', stack=N…
-
yield scrapy_splash.SplashRequest("https://example.com", self.parse,
endpoint='execute',
args={'lua_source': script, 'wait':60})
Lu…
-
This is my plan for ~the next day to get a py38 compatible version of datrie up on pypi
- [x] decide on version number (inclined to go with 0.8.2 because there is a 0.8.1 tag from @sarnold that in…
-
I'm trying to install Splash the manual way using [this guide](https://splash.readthedocs.io/en/stable/install.html#ubuntu-16-04-manual-way) but `provision.sh` doesn't exist.
```shell
vagrant@ubun…
ghost updated
5 years ago
-
So previously my server got hacked because I left Splash port open to public. I now use Firewall to my server address, and Scrapy Splash stop working with this error:
```
2017-11-22 22:12:45 [sc…
-
https://github.com/milcent/benford_py/blob/master/Demo.ipynb
I'd like to check on real data, but so far I think:
1. This is only useful when the significant amount of numerical data is affected, s…
-
I try to execute JavaScript code and return value, so I added 'script': 1 to splash args, therefore, returned value must store in _response.data['script']_. But when I try to access 'script' field in …
ghost updated
4 years ago
-
At the moment you can use a proxy to connect to splash by setting the `proxy` property of `request.meta`, but there is no way to set the proxy splash will use for accessing the page.
Splash doesn't h…
-
Hello,
I would like to use scrapy-splash to scrape multiple sites from one domain in parallel fashion. The site uses javascript to render some things I am interested in.
I do get mixed responses…
-
Thanks for working on this great project. I have followed your instructions to setup scrapyd and scrapydweb on heroku, but ran into issue that there are other package dependencies in my scrapy project…