-
Discussion today have basically resolved how to set the pub date and volume of a PoA article, if it is not present in the XML.
The issue is setting the article status of "POA" or "VOR". This is curre…
gnott updated
9 years ago
-
It would help with debugging to see the browser window while shot-scraper is working, and perhaps keep it open when an error occurs (or a screenshot is taken).
This would make debugging easier as I…
b-a0 updated
3 months ago
-
Some data sources don't require daily updates, and some server admins might be irked by daily scraping. It would be great to be able to set longer intervals for the automated scraper run.
-
# Summary
As mentioned by @ghickman on Slack, we could use something like [shot-scraper](https://github.com/simonw/shot-scraper) to generate screenshots.
This ideally would be automated or, fail…
-
(Slightly separate to #923, but triggered by it)
AIUI
- there are a limited number of slots for scrapers that can be running simultaneously
- Some scrapers can take a very long time to run, thus red…
-
Right now the unstructured data folder contains limited data, we need scrappers to scrape the data from different Lucknow websites so that if we want to add more data in the future or update the data…
-
Looks like when access flow.task_id , the response sometimes get [] in subtasks
[client.py#L330](https://github.com/d60/twikit/blob/5cdeb5369572ac6109bde9904a326b5f42e1faf0/twikit/client/client.py#…
-
* Operating System: MacOSX 10.14.6
* Node version: v10.15.3
* google-play-scraper version: 7.1.1
### Description:
Hi,
I am trying to find out when the app state changes in google play console:…
-
These are general ideas to improve Juriscraper. Some of them are to improve the quality / quantity of the data returned per scraper. Some of them are for improving developer experience
## Scrapers…
-
I can't get this scraper to work. Even if the cookies are written already, I get stuck on the login page:
Here's a video of what I see: https://drive.google.com/file/d/1zEEN16_0TB3kOMebiolmvdSaAKbu…