Uploading newspapers images manually

numeroteca commented 10 years ago

We've commented different times the need of researchers for adding newspapers that are not available at kiosko.net. I am not planning to do this a feature available for all users yet, I just want to test 'manually' how it would work.

I am now making a collaborative research of the Turkish protests. I have all the front pages that are missing in this thread http://pageonex.com/numeroteca/occupygezi-turkish-newspapers/ I could eventually upload through ssh all the missing images folder by folder with the appropriate names:

Is there a better method to do this?
There are newspapers that are not in our list (not available in kiosko.net), but I have the newspaper images. Should I create entries in our database for those newspapers, or that would cause more harm than good?

numeroteca commented 10 years ago

I've uploaded an image via SSH but it hasn't worked (with the same name). Image still not available. thoughts?

rahulbot commented 10 years ago

You'd have to create entries manually in the media table for the newspapers, then create images in the image table for each front page image, and then put the files in the right place... kind of a pain. Supporting this "import uploaded images" feature would take more work than we have time for.

That said, I added scaffolded UIs to edit images and media items via the web. You can find these under the new "admin" menu for any users marked as admins (in addition to the existing users admin editing feature). see 0a9d8718bf85fa9a077b05c6b6a55388df0d5d1b and fd3b6e8a691e939837cc907e2677647fbd121767

numeroteca commented 10 years ago

I see, I was missing editing the database part. Thanks.

Re: UI to edit images and media. How can that help to fix things previously described? How is it supposed to be used? When adding an image, it asks for the id number of the media, which is difficult or impossible to get.

A related issue:

This thread http://pageonex.com/DeboraLeal/spring-in-brazil/ There were some missing images initially. Later on, kiosko.net uploaded those images. The "try download button" didn't work or worked wrongly, and images like http://pageonex.com/DeboraLeal/spring-in-brazil/coding/?i=39370 are not being displayed (though the image exists http://img.kiosko.net/2013/06/17/br/br_estado_spaulo.750.jpg). I tried to go to the image menu and fix/edit those images, but there is no pagination or search to find it. Is there other way to use the image edit new implemented feature?

I checked via ssh: the image exists in the server, but with 0kb.

Thanks.

rahulbot commented 10 years ago

If the file is zero that means it didn't work. I should probably try to catch that case and mark the image as not there.

I don't have paging, but the last commit adds in some more links, so you can:

visit the media view page for one media source
click that link at the top to see a list of all the images we have associated with it
click the id image that isn't working
click the "download" button and you'll get a message indicating if the download worked or not

rahulbot commented 10 years ago

verified this path on production. don't have time to do more to support this request.

numeroteca commented 10 years ago

I followed the steps: For an image like http://pageonex.com/images/38668 (br_oglobo-2013-06-16), where the image in kiosko exists (http://img.kiosko.net/2013/06/16/br/br_oglobo.750.jpg), it was not able to download it.

rahulbot commented 10 years ago

Annoying unix permissions - some images had me as the owner so the website couldn't overwrite those. I fixed it:

cd /var/www/pageonex/production/app/assets/images/kiosko
sudo chown -R www-data *

numeroteca commented 10 years ago

ups, I tried for http://pageonex.com/images/43773 and http://pageonex.com/images/44469 but it didn't work, and they have www-data as owner.

rahulbot commented 10 years ago

weird - I see that those two had file sizes of zero. I deleted the underlying files and then they both worked. very odd.

numeroteca commented 7 years ago

Rescuing this thread after a few user requests.

How to use in PageOneX images that are not in kiosko.net? I envision two possible solutions:

Making PageOneX point to other online data sources to download the images (databases provided by newspapers such as El País, El Mundo; fron page databases by third parties like lasportadas.es).
Allow uploading of image in bulk. Users would be able to upload a group of images of a certain newspaper. Once uploaded we'd need to see how to connect them with particular days (name of images should be, for example: elmundo-2002-05-03.jpg)

montera34 / pageonex

Uploading newspapers images manually #172