wpoa / open-access-media-importer

A tool for harvesting media files from Open Access articles for upload into Wikimedia Commons
http://commons.wikimedia.org/wiki/User:Open_Access_Media_Importer_Bot
23 stars 8 forks source link

File not uploaded because it allegedly "already exists at Wikimedia Commons" #141

Open Daniel-Mietchen opened 9 years ago

Daniel-Mietchen commented 9 years ago

The problem here is

Skipping <http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s025.m4v>, already exists at Wikimedia Commons.

while https://commons.wikimedia.org/wiki/File:Real-Time-Imaging-of-DNA-Damage-in-Yeast-Cells-Using-Ultra-Short-Near-Infrared-Pulsed-Laser-pone.0113325.s025.ogv does not exist ( https://commons.wikimedia.org/wiki/File:Real-Time-Imaging-of-DNA-Damage-in-Yeast-Cells-Using-Ultra-Short-Near-Infrared-Pulsed-Laser-pone.0113325.s024.ogv and https://commons.wikimedia.org/wiki/File:Real-Time-Imaging-of-DNA-Damage-in-Yeast-Cells-Using-Ultra-Short-Near-Infrared-Pulsed-Laser-pone.0113325.s026.ogv do; the latter was created in a separate run from the one that uploaded the files until s024.) Full transcript of test:

danielmietchen@pc57722:~/open-access-media-importer$ sh oami_pmc_doi_import.sh 
Removing “/home/danielmietchen/.local/share/open-access-media-importer/pmc_doi.sqlite” … done.
Mo 24. Nov 00:48:26 CET 2014
10.1371/journal.pone.0113325
Input DOIs, delimited by whitespace: Getting PubMed Central IDs for given DOIs … found: 4237433
Downloading “http://eutils.ncbi.nlm.nih.gov/entrez/eutils/efetch.fcgi?db=pmc&id=4237433”, saving into directory “/home/danielmietchen/.cache/open-access-media-importer/metadata/raw/pmc_doi” …
100% |#########################################################################################################################################################################################################|
/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py:463: SAWarning: Unicode type received non-unicode bind param value.
  param.append(processors[key](compiled_params[key]))
“Real-Time Imaging of DNA Damage in Yeast Cells Using Ultra-Short Near-Infrared Pulsed Laser Irradiation”:
    26 × /

Checking MIME types …
DOI 10.1371/journal.pone.0113325, http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s001.tif, source claimed / but is image/tiff.                                            | ETA:  00:00:00
/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py:463: SAWarning: Unicode type received non-unicode bind param value.
  param.append(processors[key](compiled_params[key]))
DOI 10.1371/journal.pone.0113325, http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s002.tif, source claimed / but is image/tiff.                                            | ETA:  00:00:41
DOI 10.1371/journal.pone.0113325, http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s003.tif, source claimed / but is image/tiff.                                            | ETA:  00:00:47
DOI 10.1371/journal.pone.0113325, http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s004.pdf, source claimed / but is application/pdf.                                       | ETA:  00:01:04
DOI 10.1371/journal.pone.0113325, http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s005.pdf, source claimed / but is application/pdf.                                       | ETA:  00:00:51
DOI 10.1371/journal.pone.0113325, http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s006.m4v, source claimed / but is video/mp4.                                             | ETA:  00:00:42
DOI 10.1371/journal.pone.0113325, http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s007.m4v, source claimed / but is video/mp4.                                             | ETA:  00:00:38
DOI 10.1371/journal.pone.0113325, http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s008.m4v, source claimed / but is video/mp4.                                             | ETA:  00:00:35
DOI 10.1371/journal.pone.0113325, http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s009.m4v, source claimed / but is video/mp4.                                             | ETA:  00:00:32
DOI 10.1371/journal.pone.0113325, http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s010.m4v, source claimed / but is video/mp4.                                             | ETA:  00:00:29
DOI 10.1371/journal.pone.0113325, http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s011.m4v, source claimed / but is video/mp4.                                             | ETA:  00:00:27
DOI 10.1371/journal.pone.0113325, http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s012.m4v, source claimed / but is video/mp4.                                             | ETA:  00:00:24
DOI 10.1371/journal.pone.0113325, http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s013.m4v, source claimed / but is video/mp4.                                             | ETA:  00:00:22
DOI 10.1371/journal.pone.0113325, http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s014.m4v, source claimed / but is video/mp4.                                             | ETA:  00:00:20
DOI 10.1371/journal.pone.0113325, http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s015.m4v, source claimed / but is video/mp4.                                             | ETA:  00:00:18
DOI 10.1371/journal.pone.0113325, http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s016.m4v, source claimed / but is video/mp4.                                             | ETA:  00:00:16
DOI 10.1371/journal.pone.0113325, http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s017.m4v, source claimed / but is video/mp4.                                             | ETA:  00:00:14
DOI 10.1371/journal.pone.0113325, http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s018.m4v, source claimed / but is video/mp4.                                             | ETA:  00:00:13
DOI 10.1371/journal.pone.0113325, http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s019.m4v, source claimed / but is video/mp4.                                             | ETA:  00:00:11
DOI 10.1371/journal.pone.0113325, http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s020.m4v, source claimed / but is video/mp4.####                                         | ETA:  00:00:09
DOI 10.1371/journal.pone.0113325, http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s021.m4v, source claimed / but is video/mp4.##########                                   | ETA:  00:00:08
DOI 10.1371/journal.pone.0113325, http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s022.m4v, source claimed / but is video/mp4.#################                            | ETA:  00:00:06
DOI 10.1371/journal.pone.0113325, http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s023.m4v, source claimed / but is video/mp4.########################                     | ETA:  00:00:04
DOI 10.1371/journal.pone.0113325, http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s024.m4v, source claimed / but is video/mp4.###############################              | ETA:  00:00:03
DOI 10.1371/journal.pone.0113325, http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s025.m4v, source claimed / but is video/mp4.######################################       | ETA:  00:00:01
26 of 26 100% |#################################################################################################################################################################################| Time: 00:00:41
DOI 10.1371/journal.pone.0113325, http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s026.m4v, source claimed / but is video/mp4.
Skipping <http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s006.m4v>, already exists at Wikimedia Commons.
Skipping <http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s007.m4v>, already exists at Wikimedia Commons.
Skipping <http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s008.m4v>, already exists at Wikimedia Commons.
Skipping <http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s009.m4v>, already exists at Wikimedia Commons.
Skipping <http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s010.m4v>, already exists at Wikimedia Commons.
Skipping <http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s011.m4v>, already exists at Wikimedia Commons.
Skipping <http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s012.m4v>, already exists at Wikimedia Commons.
Skipping <http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s013.m4v>, already exists at Wikimedia Commons.
Skipping <http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s014.m4v>, already exists at Wikimedia Commons.
Skipping <http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s015.m4v>, already exists at Wikimedia Commons.
Skipping <http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s016.m4v>, already exists at Wikimedia Commons.
Skipping <http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s017.m4v>, already exists at Wikimedia Commons.
Skipping <http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s018.m4v>, already exists at Wikimedia Commons.
Skipping <http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s019.m4v>, already exists at Wikimedia Commons.
Skipping <http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s020.m4v>, already exists at Wikimedia Commons.
Skipping <http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s021.m4v>, already exists at Wikimedia Commons.
Skipping <http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s022.m4v>, already exists at Wikimedia Commons.
Skipping <http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s023.m4v>, already exists at Wikimedia Commons.
Skipping <http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s024.m4v>, already exists at Wikimedia Commons.
Skipping <http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s025.m4v>, already exists at Wikimedia Commons.
Skipping <http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4237433/bin/pone.0113325.s026.m4v>, already exists at Wikimedia Commons.
Removing “/home/danielmietchen/.local/share/open-access-media-importer/pmc_doi.sqlite” … done.
danielmietchen@pc57722:~/open-access-media-importer$