montera34 / pageonex

PageOneX. Analyzing front pages
http://pageonex.com
GNU Affero General Public License v3.0
54 stars 13 forks source link

Missing images in an "open" thread #129

Closed numeroteca closed 11 years ago

numeroteca commented 11 years ago

The images of one day are missing. It was selected as "open" thread and that day I open the thread to soon, before the images were at kiosko.net. As it didn't find the images they were displayed as not found. I erased that day from the thread and scraped again. Then include that day again, but it seems that in the database those newspapers are stored as not found.

The scraper should look for missing images and try to download them again if those days ara called again. We should talk about normal behavior for open threads.

numeroteca commented 11 years ago

related to 924571a91

I've made a test thread http://production.pageonex.com/numeroteca/movilizaciones-mayo-2013 Both first (5/1) and last (5/12) days are not working. I don't know if first day is related to this issue, but the papers (May 1st) exists http://kiosko.net/es/2013-05-01/np/elpais.html

numeroteca commented 11 years ago

36f610c4 offers a solution to this.