-
### Feature Description
Take out top-level utility functions out of `scraper_utils.py` and `legistar_utils.py` into files under `cdp_scrapers/utils`. The files have become too large. i.e. Those fil…
-
-
It seems that the "Movie Scene Number" is not presented to scene scrapers as a field they can set.
It would be great if scrapers were able to set this when adding their other metadata (Director, D…
-
### Is this urgent?
No
### What parts are affected
Backend
### What is the server version
93
### What is the client version
0.4.21
### What platform are you using
Linux
### What's the proble…
-
On the [owner show page](https://morph.io/morph-scrappers) lists of running, erroring and 'other' scrapers are divided by some space (I'm now unclear if this is the case as [errored scrapers aren't sp…
-
I noticed that some scrapers are missing some countries' proxies, so it would be nice to have the ability to choose a different scraper per domain/country or so.
MyWay updated
6 months ago
-
This is a pretty long list so I'm moving this to a different URL. All the actions on this file have to be matched to some more general keywords provided by OpenCivicData:
https://gist.github.com/Ernie…
-
All lots need to have the same ID as it was generated in the original ParkAPI by the geojson wrapper. (As discussed in issue #1)
In essence that means:
- start with legacy city name (e.g. frankfu…
-
I created a new folder for my latest webscraper, and created an (as yet unfinished) spider file and spider test file, and also updated to the most recent version of city-scrapers-pitt/master branch an…
-
A long time ago, I started working on turning the Texas Secretary of State's results into something easier to deal with: https://github.com/texastribune/tx_election_scrapers
I haven't touched it in a…