-
cc @mitar
-
**Pre-filing checks**
- [X] I have searched for open issues that report the same problem
- [X] I have checked that the bug affects the latest version of the library
v15.0.0
**The URL of the…
-
Once we have the scrapers outputting to a repo, we can have a job/tool that calls csvdiff, xmldiff etc to monitor when the scraped and the IATI version differ - and alert us.
Bonus points if this w…
-
@appleorange1's scraper [symlinks `scraper.rb`](https://github.com/appleorange1/victorianparliamentmemberdata/blob/master/scraper.rb) and morph's not handling that properly.
[Morph/production] …
-
Refactoring SPOJ related code.
- [ ] Refactor all scrapers and paste them into the `scraper.py` file.
- [ ] Refactor all scheduled functions and paste them into the `cron.py` file.
- [ ] Refa…
-
```
What steps will reproduce the problem?
1. Import games to rom collection
2. Realize that some games have been incorrectly detected and scraped
3. Manually re-scrape the selected game, using the "i…
-
```
What steps will reproduce the problem?
1.check scraper before hand that photo exists
(http://thegamesdb.net/search/?string=sonic+advance&function=Search)
2.Import Sonic Advance or any GBA game
…
-
If I do this
```
items.each do |item|
if ScraperWiki.select("* from swdata where ....).empty?
ScraperWiki.save_sqlite(["key123"], item)
else
puts "Skipping " + item["key123…
-
The setting Movies > 'Scrapers - Images' > 'Preferred Language' is not applied with either automatic scraping or manual selection.
Forced language can be set to english and still images tagged in di…
phtnk updated
2 years ago
-
This is to make it easier for one scraper to access the data from another scraper with the api. You don't actually have to embed the secret key yourself. It's just "magically" available.
Some other e…