search

denshoproject / ddr-cmdln

Command-line tools for automating the Densho Digital Repository's various processes.
Other
0 stars 2 forks source link

File ingest fails even tho binary is successfully uploaded #59

Closed gjost closed 6 years ago

gjost commented 6 years ago

Philip (2018-03-09 16:15): Adding binaries results in a failure message even though the binary is successfully uploaded. failure message is "AttributeError: 'list' object has no attribute 'identifier'

status  FAILURE
entity_id   ddr-testing-40048-13
task_id b6b19712-293d-40e2-ae3b-61c23602d158
traceback   
Traceback (most recent call last):
  File "/opt/ddr-local/venv/ddrlocal/local/lib/python2.7/site-packages/celery/app/trace.py", line 240, in trace_task
    R = retval = fun(*args, **kwargs)
  File "/opt/ddr-local/venv/ddrlocal/local/lib/python2.7/site-packages/celery/app/trace.py", line 438, in __protected_call__
    return self.run(*args, **kwargs)
  File "/opt/ddr-local/ddrlocal/webui/tasks.py", line 296, in entity_add_file
    result = file_.post_json()
  File "/opt/ddr-local/venv/ddrlocal/local/lib/python2.7/site-packages/ddr_cmdln-0.9.4b0-py2.7.egg/DDR/models/__init__.py", line 2466, in post_json
    'entity_id': self.parent_id,
  File "/opt/ddr-local/venv/ddrlocal/local/lib/python2.7/site-packages/ddr_cmdln-0.9.4b0-py2.7.egg/DDR/docstore.py", line 551, in post
    parents = _parents_status([document.identifier.path_abs()])
AttributeError: 'list' object has no attribute 'identifier'
entity_url  /ui/entity/ddr-testing-40048-13/
filename    ddr-densho-349-11_mezz.tif
start   2018-03-06T15:30:02PST-0800
result  AttributeError("'list' object has no attribute 'identifier'",)
action  webui-file-new-mezzanine
message Could not upload <b>ddr-densho-349-11_mezz.tif</b> to <a href="/ui/entity/ddr-testing-40048-13/">ddr-testing-40048-13</a>.<br/>AttributeError("'list' object has no attribute 'identifier'",)
dismissable True
startd  March 6, 2018, 3:30 p.m.

Traceback (most recent call last):
  File "/opt/ddr-local/venv/ddrlocal/local/lib/python2.7/site-packages/celery/app/trace.py", line 240, in trace_task
    R = retval = fun(*args, **kwargs)
  File "/opt/ddr-local/venv/ddrlocal/local/lib/python2.7/site-packages/celery/app/trace.py", line 438, in __protected_call__
    return self.run(*args, **kwargs)
  File "/opt/ddr-local/ddrlocal/webui/tasks.py", line 296, in entity_add_file
    result = file_.post_json()
  File "/opt/ddr-local/venv/ddrlocal/local/lib/python2.7/site-packages/ddr_cmdln-0.9.4b0-py2.7.egg/DDR/models/__init__.py", line 2466, in post_json
    'entity_id': self.parent_id,
  File "/opt/ddr-local/venv/ddrlocal/local/lib/python2.7/site-packages/ddr_cmdln-0.9.4b0-py2.7.egg/DDR/docstore.py", line 551, in post
    parents = _parents_status([document.identifier.path_abs()])
AttributeError: 'list' object has no attribute 'identifier'

from addfile.log (LONG):
[2018-02-09T08:58:37.065002-08:00] ok - START task_id a7771926-af4c-471d-97c4-3f9a58a6d0e3
[2018-02-09T08:58:37.065082-08:00] ok - ddrlocal.webui.file.new
[2018-02-09T08:58:37.065122-08:00] ok - Locking ddr-testing-40048-12
[2018-02-09T08:58:37.068361-08:00] ok - locked
[2018-02-09T08:58:39.719235-08:00] ok - ------------------------------------------------------------------------
[2018-02-09T08:58:39.719307-08:00] ok - DDR.models.Entity.add_file: START
[2018-02-09T08:58:39.719341-08:00] ok - entity: ddr-testing-40048-12
[2018-02-09T08:58:39.719380-08:00] ok - data: {'sort': 1, 'path': u'/media/sf_ddrshared/ddr-densho-296-23_master.tif', 'label': u'd', 'public': u'1', 'rights': u'cc'}
[2018-02-09T08:58:39.719417-08:00] ok - Examining source file
[2018-02-09T08:58:39.719456-08:00] ok - check dir /media/sf_ddrshared/ddr-densho-296-23_master.tif (| src_path)
[2018-02-09T08:58:39.720135-08:00] ok - | file size 297931252
[2018-02-09T08:58:46.681108-08:00] ok - | md5: c5c7b51dc27353c1e570d83dfc9f8e75
[2018-02-09T08:58:52.587701-08:00] ok - | sha1: 72d8a77469fc38a4064d7efaad48c3d02ca8d6a2
[2018-02-09T08:58:59.203201-08:00] ok - | sha256: 0a7cdc06b36f311d1a817beffa542be0cd3af2c5d880cf8da777eea07df14c63
[2018-02-09T08:58:59.203303-08:00] ok - | extracting XMP data
[2018-02-09T08:58:59.209691-08:00] ok - Identifier
[2018-02-09T08:58:59.209766-08:00] ok - | idparts {'sha1': '72d8a77469', 'role': 'mezzanine'}
[2018-02-09T08:58:59.209958-08:00] ok - | identifier <webui.identifier.Identifier file:ddr-testing-40048-12-mezzanine-72d8a77469>
[2018-02-09T08:58:59.210307-08:00] ok - Checking files/dirs
[2018-02-09T08:58:59.211624-08:00] ok - check dir /var/www/media/ddr/tmp/file-add/ddr-testing-40048/ddr-testing-40048-12 (| tmp_dir)
[2018-02-09T08:58:59.222208-08:00] ok - check dir /var/www/media/ddr/ddr-testing-40048/files/ddr-testing-40048-12/files (| dest_dir)
[2018-02-09T08:58:59.224543-08:00] ok - Copying to work dir
[2018-02-09T08:58:59.224600-08:00] ok - | cp /media/sf_ddrshared/ddr-densho-296-23_master.tif /var/www/media/ddr/tmp/file-add/ddr-testing-40048/ddr-testing-40048-12/ddr-densho-296-23_master.tif
[2018-02-09T08:59:04.730540-08:00] ok - | done
[2018-02-09T08:59:04.730636-08:00] ok - | Renaming ddr-densho-296-23_master.tif -> ddr-testing-40048-12-mezzanine-72d8a77469.tif
[2018-02-09T08:59:04.733411-08:00] ok - Making access file
[2018-02-09T08:59:04.733969-08:00] ok - | /var/www/media/ddr/tmp/file-add/ddr-testing-40048/ddr-testing-40048-12/ddr-testing-40048-12-mezzanine-72d8a77469-a.jpg
[2018-02-09T08:59:18.887565-08:00] ok - | identify: /media/sf_ddrshared/ddr-densho-296-23_master.tif TIFF 6565x7562 6565x7562+0+0 16-bit sRGB 297.9MB 0.000u 0:00.000
[2018-02-09T08:59:18.887694-08:00] ok - | convert "/media/sf_ddrshared/ddr-densho-296-23_master.tif"[0] -resize '1024x1024>' /var/www/media/ddr/tmp/file-add/ddr-testing-40048/ddr-testing-40048-12/ddr-testing-40048-12-mezzanine-72d8a77469-a.jpg
[2018-02-09T08:59:18.887746-08:00] ok - | convert: status:0 exists:True islink:False size:145060
[2018-02-09T08:59:18.887780-08:00] ok - | done
[2018-02-09T08:59:18.887814-08:00] ok - File object
[2018-02-09T08:59:18.888618-08:00] ok - | file_ <DDR.models.File file:ddr-testing-40048-12-mezzanine-72d8a77469>
[2018-02-09T08:59:18.888669-08:00] ok - | file_.basename_orig: ddr-densho-296-23_master.tif
[2018-02-09T08:59:18.888708-08:00] ok - | file_.path_abs: /var/www/media/ddr/ddr-testing-40048/files/ddr-testing-40048-12/files/ddr-testing-40048-12-mezzanine-72d8a77469.tif
[2018-02-09T08:59:18.888740-08:00] ok - | file_.size: 297931252
[2018-02-09T08:59:18.888778-08:00] ok - Attaching access file
[2018-02-09T08:59:18.889324-08:00] ok - | file_.access_rel: ddr-testing-40048-12-mezzanine-72d8a77469-a.jpg
[2018-02-09T08:59:18.889397-08:00] ok - | file_.access_abs: /var/www/media/ddr/ddr-testing-40048/files/ddr-testing-40048-12/files/ddr-testing-40048-12-mezzanine-72d8a77469-a.jpg
[2018-02-09T08:59:18.889439-08:00] ok - Attaching file to entity
[2018-02-09T08:59:18.889472-08:00] ok - | done
[2018-02-09T08:59:18.889500-08:00] ok - Writing object metadata
[2018-02-09T08:59:18.889549-08:00] ok - | /var/www/media/ddr/tmp/file-add/ddr-testing-40048/ddr-testing-40048-12/ddr-testing-40048-12-mezzanine-72d8a77469.json
[2018-02-09T08:59:18.938635-08:00] ok - Moving files to dest_dir
[2018-02-09T08:59:18.938753-08:00] ok - | mv /var/www/media/ddr/tmp/file-add/ddr-testing-40048/ddr-testing-40048-12/ddr-testing-40048-12-mezzanine-72d8a77469.json /var/www/media/ddr/ddr-testing-40048/files/ddr-testing-40048-12/files/ddr-testing-40048-12-mezzanine-72d8a77469.json
[2018-02-09T08:59:18.941455-08:00] ok - | mv /var/www/media/ddr/tmp/file-add/ddr-testing-40048/ddr-testing-40048-12/ddr-testing-40048-12-mezzanine-72d8a77469.tif /var/www/media/ddr/ddr-testing-40048/files/ddr-testing-40048-12/files/ddr-testing-40048-12-mezzanine-72d8a77469.tif
[2018-02-09T08:59:18.944123-08:00] ok - | mv /var/www/media/ddr/tmp/file-add/ddr-testing-40048/ddr-testing-40048-12/ddr-testing-40048-12-mezzanine-72d8a77469-a.jpg /var/www/media/ddr/ddr-testing-40048/files/ddr-testing-40048-12/files/ddr-testing-40048-12-mezzanine-72d8a77469-a.jpg
[2018-02-09T08:59:18.946122-08:00] ok - | all files moved
[2018-02-09T08:59:18.946169-08:00] ok - Writing entity.json
[2018-02-09T08:59:18.982168-08:00] ok - Staging files
[2018-02-09T08:59:18.983233-08:00] ok - | repo <git.Repo "/var/www/media/ddr/ddr-testing-40048/.git">
[2018-02-09T08:59:18.999497-08:00] ok - | 4 files to stage:
[2018-02-09T08:59:18.999576-08:00] ok - |   files/ddr-testing-40048-12/entity.json
[2018-02-09T08:59:18.999608-08:00] ok - |   files/ddr-testing-40048-12/files/ddr-testing-40048-12-mezzanine-72d8a77469.json
[2018-02-09T08:59:18.999687-08:00] ok - |   files/ddr-testing-40048-12/files/ddr-testing-40048-12-mezzanine-72d8a77469.tif
[2018-02-09T08:59:18.999728-08:00] ok - |   files/ddr-testing-40048-12/files/ddr-testing-40048-12-mezzanine-72d8a77469-a.jpg
[2018-02-09T08:59:18.999765-08:00] ok - git stage
[2018-02-09T08:59:19.038657-08:00] ok - annex stage
[2018-02-09T08:59:23.025080-08:00] ok - ok
[2018-02-09T08:59:23.039819-08:00] ok - | 4 files staged:
[2018-02-09T08:59:23.039910-08:00] ok - show_staged True
[2018-02-09T08:59:23.039944-08:00] ok - |   files/ddr-testing-40048-12/entity.json
[2018-02-09T08:59:23.039973-08:00] ok - |   files/ddr-testing-40048-12/files/ddr-testing-40048-12-mezzanine-72d8a77469-a.jpg
[2018-02-09T08:59:23.040003-08:00] ok - |   files/ddr-testing-40048-12/files/ddr-testing-40048-12-mezzanine-72d8a77469.json
[2018-02-09T08:59:23.040029-08:00] ok - |   files/ddr-testing-40048-12/files/ddr-testing-40048-12-mezzanine-72d8a77469.tif
[2018-02-09T08:59:23.040063-08:00] ok - | 4 files staged (4 new, 0 modified)
[2018-02-09T08:59:23.040179-08:00] ok - add_file_commit(<DDR.models.File file:ddr-testing-40048-12-mezzanine-72d8a77469>, <git.Repo "/var/www/media/ddr/ddr-testing-40048/.git">, <DDR.ingest.AddFileLogger '/var/log/ddr/addfile/ddr-testing-40048/ddr-testing-40048-12.log'>, Philip Kikawa, philip.kikawa@densho.org, ddr-local)
[2018-02-09T08:59:23.088825-08:00] ok - All files staged.
[2018-02-09T08:59:23.088951-08:00] ok - Updating changelog
[2018-02-09T08:59:23.091037-08:00] ok - git add files/ddr-testing-40048-12/changelog
[2018-02-09T08:59:23.118700-08:00] ok - Committing
[2018-02-09T08:59:23.282581-08:00] ok - commit: 954d05db5c6e1c54f93cce4db825fe1fab938188
[2018-02-09T08:59:23.306960-08:00] ok - files committed:
[2018-02-09T08:59:23.307054-08:00] ok - | .../ddr-testing-40048-12-mezzanine-72d8a77469.json
[2018-02-09T08:59:23.307086-08:00] ok - | .../ddr-testing-40048-12-mezzanine-72d8a77469.tif
[2018-02-09T08:59:23.307113-08:00] ok - | ...ddr-testing-40048-12-mezzanine-72d8a77469-a.jpg
[2018-02-09T08:59:23.307140-08:00] ok - | files/ddr-testing-40048-12/changelog
[2018-02-09T08:59:23.307166-08:00] ok - | files/ddr-testing-40048-12/entity.json
[2018-02-09T08:59:23.307218-08:00] ok - Updating Elasticsearch
[2018-02-09T08:59:23.314195-08:00] not ok - DDRTask.ON_FAILURE
[2018-02-09T08:59:23.317745-08:00] ok - FileAddDebugTask.AFTER_RETURN
[2018-02-09T08:59:23.317803-08:00] ok - task_id: a7771926-af4c-471d-97c4-3f9a58a6d0e3
[2018-02-09T08:59:23.317834-08:00] ok - status: FAILURE
[2018-02-09T08:59:23.317871-08:00] ok - retval: 'list' object has no attribute 'identifier'
[2018-02-09T08:59:23.317927-08:00] ok - Unlocking ddr-testing-40048-12
[2018-02-09T08:59:23.320509-08:00] ok - unlocked
[2018-02-09T08:59:23.320571-08:00] ok - END task_id a7771926-af4c-471d-97c4-3f9a58a6d0e3

[2018-02-09T09:01:17.753725-08:00] ok - START task_id 829342e7-8765-4a6d-881a-0594762e7006
[2018-02-09T09:01:17.753780-08:00] ok - ddrlocal.webui.file.new
[2018-02-09T09:01:17.753816-08:00] ok - Locking ddr-testing-40048-12
[2018-02-09T09:01:17.757508-08:00] ok - locked
[2018-02-09T09:01:19.993850-08:00] ok - ------------------------------------------------------------------------
[2018-02-09T09:01:19.993904-08:00] ok - DDR.models.Entity.add_file: START
[2018-02-09T09:01:19.993939-08:00] ok - entity: ddr-testing-40048-12
[2018-02-09T09:01:19.993980-08:00] ok - data: {'sort': 1, 'path': u'/media/sf_ddrshared/ddr-densho-296-3-1_mezz.tif', 'label': u'asdf', 'public': u'0', 'rights': u'cc'}
[2018-02-09T09:01:19.994011-08:00] ok - Examining source file
[2018-02-09T09:01:19.994049-08:00] ok - check dir /media/sf_ddrshared/ddr-densho-296-3-1_mezz.tif (| src_path)
[2018-02-09T09:01:19.994794-08:00] ok - | file size 22247260
[2018-02-09T09:01:20.539295-08:00] ok - | md5: 17607b2b4fc32abb9694c1fb0b6907cb
[2018-02-09T09:01:21.102588-08:00] ok - | sha1: d77ceed9d38acd01098db4fa5a9b2e8ca326f7e8
[2018-02-09T09:01:21.658535-08:00] ok - | sha256: 0895b4c928ebcbd91d53c442976345f3e01eef9e50580b236c182349931079c1
[2018-02-09T09:01:21.658631-08:00] ok - | extracting XMP data
[2018-02-09T09:01:21.664908-08:00] ok - Identifier
[2018-02-09T09:01:21.665041-08:00] ok - | idparts {'sha1': 'd77ceed9d3', 'role': 'master'}
[2018-02-09T09:01:21.665289-08:00] ok - | identifier <webui.identifier.Identifier file:ddr-testing-40048-12-master-d77ceed9d3>
[2018-02-09T09:01:21.665636-08:00] ok - Checking files/dirs
[2018-02-09T09:01:21.666342-08:00] ok - check dir /var/www/media/ddr/tmp/file-add/ddr-testing-40048/ddr-testing-40048-12 (| tmp_dir)
[2018-02-09T09:01:21.667543-08:00] ok - check dir /var/www/media/ddr/ddr-testing-40048/files/ddr-testing-40048-12/files (| dest_dir)
[2018-02-09T09:01:21.667605-08:00] ok - Copying to work dir
[2018-02-09T09:01:21.667643-08:00] ok - | cp /media/sf_ddrshared/ddr-densho-296-3-1_mezz.tif /var/www/media/ddr/tmp/file-add/ddr-testing-40048/ddr-testing-40048-12/ddr-densho-296-3-1_mezz.tif
[2018-02-09T09:01:22.061118-08:00] ok - | done
[2018-02-09T09:01:22.061212-08:00] ok - | Renaming ddr-densho-296-3-1_mezz.tif -> ddr-testing-40048-12-master-d77ceed9d3.tif
[2018-02-09T09:01:22.063499-08:00] ok - Making access file
[2018-02-09T09:01:22.064027-08:00] ok - | /var/www/media/ddr/tmp/file-add/ddr-testing-40048/ddr-testing-40048-12/ddr-testing-40048-12-master-d77ceed9d3-a.jpg
[2018-02-09T09:01:23.237916-08:00] ok - | identify: /media/sf_ddrshared/ddr-densho-296-3-1_mezz.tif TIFF 3294x4561 3294x4561+0+0 8-bit sRGB 22.25MB 0.000u 0:00.000
[2018-02-09T09:01:23.238075-08:00] ok - | convert "/media/sf_ddrshared/ddr-densho-296-3-1_mezz.tif"[0] -resize '1024x1024>' /var/www/media/ddr/tmp/file-add/ddr-testing-40048/ddr-testing-40048-12/ddr-testing-40048-12-master-d77ceed9d3-a.jpg
[2018-02-09T09:01:23.238121-08:00] ok - | convert: status:0 exists:True islink:False size:209209
[2018-02-09T09:01:23.238155-08:00] ok - | done
[2018-02-09T09:01:23.238190-08:00] ok - File object
[2018-02-09T09:01:23.238960-08:00] ok - | file_ <DDR.models.File file:ddr-testing-40048-12-master-d77ceed9d3>
[2018-02-09T09:01:23.239009-08:00] ok - | file_.basename_orig: ddr-densho-296-3-1_mezz.tif
[2018-02-09T09:01:23.239047-08:00] ok - | file_.path_abs: /var/www/media/ddr/ddr-testing-40048/files/ddr-testing-40048-12/files/ddr-testing-40048-12-master-d77ceed9d3.tif
[2018-02-09T09:01:23.239079-08:00] ok - | file_.size: 22247260
[2018-02-09T09:01:23.239117-08:00] ok - Attaching access file
[2018-02-09T09:01:23.239842-08:00] ok - | file_.access_rel: ddr-testing-40048-12-master-d77ceed9d3-a.jpg
[2018-02-09T09:01:23.239896-08:00] ok - | file_.access_abs: /var/www/media/ddr/ddr-testing-40048/files/ddr-testing-40048-12/files/ddr-testing-40048-12-master-d77ceed9d3-a.jpg
[2018-02-09T09:01:23.239947-08:00] ok - Attaching file to entity
[2018-02-09T09:01:23.239984-08:00] ok - | done
[2018-02-09T09:01:23.240014-08:00] ok - Writing object metadata
[2018-02-09T09:01:23.240051-08:00] ok - | /var/www/media/ddr/tmp/file-add/ddr-testing-40048/ddr-testing-40048-12/ddr-testing-40048-12-master-d77ceed9d3.json
[2018-02-09T09:01:23.244891-08:00] ok - Moving files to dest_dir
[2018-02-09T09:01:23.245015-08:00] ok - | mv /var/www/media/ddr/tmp/file-add/ddr-testing-40048/ddr-testing-40048-12/ddr-testing-40048-12-master-d77ceed9d3.json /var/www/media/ddr/ddr-testing-40048/files/ddr-testing-40048-12/files/ddr-testing-40048-12-master-d77ceed9d3.json
[2018-02-09T09:01:23.248073-08:00] ok - | mv /var/www/media/ddr/tmp/file-add/ddr-testing-40048/ddr-testing-40048-12/ddr-testing-40048-12-master-d77ceed9d3.tif /var/www/media/ddr/ddr-testing-40048/files/ddr-testing-40048-12/files/ddr-testing-40048-12-master-d77ceed9d3.tif
[2018-02-09T09:01:23.250416-08:00] ok - | mv /var/www/media/ddr/tmp/file-add/ddr-testing-40048/ddr-testing-40048-12/ddr-testing-40048-12-master-d77ceed9d3-a.jpg /var/www/media/ddr/ddr-testing-40048/files/ddr-testing-40048-12/files/ddr-testing-40048-12-master-d77ceed9d3-a.jpg
[2018-02-09T09:01:23.252375-08:00] ok - | all files moved
[2018-02-09T09:01:23.252441-08:00] ok - Writing entity.json
[2018-02-09T09:01:23.293929-08:00] ok - Staging files
[2018-02-09T09:01:23.294912-08:00] ok - | repo <git.Repo "/var/www/media/ddr/ddr-testing-40048/.git">
[2018-02-09T09:01:23.309151-08:00] ok - | 4 files to stage:
[2018-02-09T09:01:23.309247-08:00] ok - |   files/ddr-testing-40048-12/entity.json
[2018-02-09T09:01:23.309279-08:00] ok - |   files/ddr-testing-40048-12/files/ddr-testing-40048-12-master-d77ceed9d3.json
[2018-02-09T09:01:23.309310-08:00] ok - |   files/ddr-testing-40048-12/files/ddr-testing-40048-12-master-d77ceed9d3.tif
[2018-02-09T09:01:23.309347-08:00] ok - |   files/ddr-testing-40048-12/files/ddr-testing-40048-12-master-d77ceed9d3-a.jpg
[2018-02-09T09:01:23.309383-08:00] ok - git stage
[2018-02-09T09:01:23.385033-08:00] ok - annex stage
[2018-02-09T09:01:24.169179-08:00] ok - ok
[2018-02-09T09:01:24.184160-08:00] ok - | 4 files staged:
[2018-02-09T09:01:24.184247-08:00] ok - show_staged True
[2018-02-09T09:01:24.184282-08:00] ok - |   files/ddr-testing-40048-12/entity.json
[2018-02-09T09:01:24.184312-08:00] ok - |   files/ddr-testing-40048-12/files/ddr-testing-40048-12-master-d77ceed9d3-a.jpg
[2018-02-09T09:01:24.184342-08:00] ok - |   files/ddr-testing-40048-12/files/ddr-testing-40048-12-master-d77ceed9d3.json
[2018-02-09T09:01:24.184370-08:00] ok - |   files/ddr-testing-40048-12/files/ddr-testing-40048-12-master-d77ceed9d3.tif
[2018-02-09T09:01:24.184403-08:00] ok - | 4 files staged (4 new, 0 modified)
[2018-02-09T09:01:24.184499-08:00] ok - add_file_commit(<DDR.models.File file:ddr-testing-40048-12-master-d77ceed9d3>, <git.Repo "/var/www/media/ddr/ddr-testing-40048/.git">, <DDR.ingest.AddFileLogger '/var/log/ddr/addfile/ddr-testing-40048/ddr-testing-40048-12.log'>, Philip Kikawa, philip.kikawa@densho.org, ddr-local)
[2018-02-09T09:01:24.207949-08:00] ok - All files staged.
[2018-02-09T09:01:24.208029-08:00] ok - Updating changelog
[2018-02-09T09:01:24.209972-08:00] ok - git add files/ddr-testing-40048-12/changelog
[2018-02-09T09:01:24.231562-08:00] ok - Committing
[2018-02-09T09:01:24.379811-08:00] ok - commit: 34c7b701afdab455d82ab980bd6e144b12825459
[2018-02-09T09:01:24.401545-08:00] ok - files committed:
[2018-02-09T09:01:24.401635-08:00] ok - | .../ddr-testing-40048-12-master-d77ceed9d3-a.jpg
[2018-02-09T09:01:24.401667-08:00] ok - | .../ddr-testing-40048-12-master-d77ceed9d3.json
[2018-02-09T09:01:24.401695-08:00] ok - | .../ddr-testing-40048-12-master-d77ceed9d3.tif
[2018-02-09T09:01:24.401750-08:00] ok - | files/ddr-testing-40048-12/changelog
[2018-02-09T09:01:24.401780-08:00] ok - | files/ddr-testing-40048-12/entity.json
[2018-02-09T09:01:24.401833-08:00] ok - Updating Elasticsearch
[2018-02-09T09:01:24.404863-08:00] not ok - DDRTask.ON_FAILURE
[2018-02-09T09:01:24.407575-08:00] ok - FileAddDebugTask.AFTER_RETURN
[2018-02-09T09:01:24.407620-08:00] ok - task_id: 829342e7-8765-4a6d-881a-0594762e7006
[2018-02-09T09:01:24.407652-08:00] ok - status: FAILURE
[2018-02-09T09:01:24.407679-08:00] ok - retval: 'list' object has no attribute 'identifier'
[2018-02-09T09:01:24.407708-08:00] ok - Unlocking ddr-testing-40048-12
[2018-02-09T09:01:24.410258-08:00] ok - unlocked
[2018-02-09T09:01:24.410300-08:00] ok - END task_id 829342e7-8765-4a6d-881a-0594762e7006

[2018-02-09T09:04:22.267468-08:00] ok - START task_id 4e88a635-5d5f-4c43-9def-df4d528654e4
[2018-02-09T09:04:22.267558-08:00] ok - ddrlocal.webui.file.new
[2018-02-09T09:04:22.267600-08:00] ok - Locking ddr-testing-40048-12
[2018-02-09T09:04:22.270956-08:00] ok - locked
[2018-02-09T09:04:24.801273-08:00] ok - ------------------------------------------------------------------------
[2018-02-09T09:04:24.801328-08:00] ok - DDR.models.Entity.add_file: START
[2018-02-09T09:04:24.801364-08:00] ok - entity: ddr-testing-40048-12
[2018-02-09T09:04:24.801407-08:00] ok - data: {'sort': 1, 'path': u'/media/sf_ddrshared/ddr-densho-296-3-2_master.tif', 'label': u'z', 'public': u'1', 'rights': u'cc'}
[2018-02-09T09:04:24.801442-08:00] ok - Examining source file
[2018-02-09T09:04:24.801478-08:00] ok - check dir /media/sf_ddrshared/ddr-densho-296-3-2_master.tif (| src_path)
[2018-02-09T09:04:24.802192-08:00] ok - | file size 66564304
[2018-02-09T09:04:26.497675-08:00] ok - | md5: 9f987848e01386d846c8f3c41f8b2290
[2018-02-09T09:04:28.170171-08:00] ok - | sha1: 25c279246830a68a9d83719cfbfb6f7dbb3edcc6
[2018-02-09T09:04:29.995140-08:00] ok - | sha256: 7fd46737e962ec4786908f6793e4f24b35cad9994ed6f4c3e895632dd010bf29
[2018-02-09T09:04:29.995239-08:00] ok - | extracting XMP data
[2018-02-09T09:04:29.999527-08:00] ok - Identifier
[2018-02-09T09:04:29.999585-08:00] ok - | idparts {'sha1': '25c2792468', 'role': 'master'}
[2018-02-09T09:04:29.999763-08:00] ok - | identifier <webui.identifier.Identifier file:ddr-testing-40048-12-master-25c2792468>
[2018-02-09T09:04:30.000105-08:00] ok - Checking files/dirs
[2018-02-09T09:04:30.000850-08:00] ok - check dir /var/www/media/ddr/tmp/file-add/ddr-testing-40048/ddr-testing-40048-12 (| tmp_dir)
[2018-02-09T09:04:30.002187-08:00] ok - check dir /var/www/media/ddr/ddr-testing-40048/files/ddr-testing-40048-12/files (| dest_dir)
[2018-02-09T09:04:30.002243-08:00] ok - Copying to work dir
[2018-02-09T09:04:30.002282-08:00] ok - | cp /media/sf_ddrshared/ddr-densho-296-3-2_master.tif /var/www/media/ddr/tmp/file-add/ddr-testing-40048/ddr-testing-40048-12/ddr-densho-296-3-2_master.tif
[2018-02-09T09:04:31.161725-08:00] ok - | done
[2018-02-09T09:04:31.161833-08:00] ok - | Renaming ddr-densho-296-3-2_master.tif -> ddr-testing-40048-12-master-25c2792468.tif
[2018-02-09T09:04:31.164361-08:00] ok - Making access file
[2018-02-09T09:04:31.164805-08:00] ok - | /var/www/media/ddr/tmp/file-add/ddr-testing-40048/ddr-testing-40048-12/ddr-testing-40048-12-master-25c2792468-a.jpg
[2018-02-09T09:04:33.283084-08:00] ok - | identify: /media/sf_ddrshared/ddr-densho-296-3-2_master.tif TIFF 4128x5373 4128x5373+0+0 8-bit sRGB 66.56MB 0.000u 0:00.000
[2018-02-09T09:04:33.283211-08:00] ok - | convert "/media/sf_ddrshared/ddr-densho-296-3-2_master.tif"[0] -resize '1024x1024>' /var/www/media/ddr/tmp/file-add/ddr-testing-40048/ddr-testing-40048-12/ddr-testing-40048-12-master-25c2792468-a.jpg
[2018-02-09T09:04:33.283256-08:00] ok - | convert: status:0 exists:True islink:False size:102503
[2018-02-09T09:04:33.283290-08:00] ok - | done
[2018-02-09T09:04:33.283324-08:00] ok - File object
[2018-02-09T09:04:33.284085-08:00] ok - | file_ <DDR.models.File file:ddr-testing-40048-12-master-25c2792468>
[2018-02-09T09:04:33.284134-08:00] ok - | file_.basename_orig: ddr-densho-296-3-2_master.tif
[2018-02-09T09:04:33.284198-08:00] ok - | file_.path_abs: /var/www/media/ddr/ddr-testing-40048/files/ddr-testing-40048-12/files/ddr-testing-40048-12-master-25c2792468.tif
[2018-02-09T09:04:33.284248-08:00] ok - | file_.size: 66564304
[2018-02-09T09:04:33.284288-08:00] ok - Attaching access file
[2018-02-09T09:04:33.284786-08:00] ok - | file_.access_rel: ddr-testing-40048-12-master-25c2792468-a.jpg
[2018-02-09T09:04:33.284834-08:00] ok - | file_.access_abs: /var/www/media/ddr/ddr-testing-40048/files/ddr-testing-40048-12/files/ddr-testing-40048-12-master-25c2792468-a.jpg
[2018-02-09T09:04:33.284871-08:00] ok - Attaching file to entity
[2018-02-09T09:04:33.284905-08:00] ok - | done
[2018-02-09T09:04:33.284933-08:00] ok - Writing object metadata
[2018-02-09T09:04:33.284971-08:00] ok - | /var/www/media/ddr/tmp/file-add/ddr-testing-40048/ddr-testing-40048-12/ddr-testing-40048-12-master-25c2792468.json
[2018-02-09T09:04:33.331885-08:00] ok - Moving files to dest_dir
[2018-02-09T09:04:33.331996-08:00] ok - | mv /var/www/media/ddr/tmp/file-add/ddr-testing-40048/ddr-testing-40048-12/ddr-testing-40048-12-master-25c2792468.json /var/www/media/ddr/ddr-testing-40048/files/ddr-testing-40048-12/files/ddr-testing-40048-12-master-25c2792468.json
[2018-02-09T09:04:33.334456-08:00] ok - | mv /var/www/media/ddr/tmp/file-add/ddr-testing-40048/ddr-testing-40048-12/ddr-testing-40048-12-master-25c2792468.tif /var/www/media/ddr/ddr-testing-40048/files/ddr-testing-40048-12/files/ddr-testing-40048-12-master-25c2792468.tif
[2018-02-09T09:04:33.336434-08:00] ok - | mv /var/www/media/ddr/tmp/file-add/ddr-testing-40048/ddr-testing-40048-12/ddr-testing-40048-12-master-25c2792468-a.jpg /var/www/media/ddr/ddr-testing-40048/files/ddr-testing-40048-12/files/ddr-testing-40048-12-master-25c2792468-a.jpg
[2018-02-09T09:04:33.338373-08:00] ok - | all files moved
[2018-02-09T09:04:33.338418-08:00] ok - Writing entity.json
[2018-02-09T09:04:33.373697-08:00] ok - Staging files
[2018-02-09T09:04:33.374669-08:00] ok - | repo <git.Repo "/var/www/media/ddr/ddr-testing-40048/.git">
[2018-02-09T09:04:33.388954-08:00] ok - | 4 files to stage:
[2018-02-09T09:04:33.389040-08:00] ok - |   files/ddr-testing-40048-12/entity.json
[2018-02-09T09:04:33.389072-08:00] ok - |   files/ddr-testing-40048-12/files/ddr-testing-40048-12-master-25c2792468.json
[2018-02-09T09:04:33.389105-08:00] ok - |   files/ddr-testing-40048-12/files/ddr-testing-40048-12-master-25c2792468.tif
[2018-02-09T09:04:33.389145-08:00] ok - |   files/ddr-testing-40048-12/files/ddr-testing-40048-12-master-25c2792468-a.jpg
[2018-02-09T09:04:33.389181-08:00] ok - git stage
[2018-02-09T09:04:33.428620-08:00] ok - annex stage
[2018-02-09T09:04:35.858062-08:00] ok - ok
[2018-02-09T09:04:35.871678-08:00] ok - | 4 files staged:
[2018-02-09T09:04:35.871760-08:00] ok - show_staged True
[2018-02-09T09:04:35.871796-08:00] ok - |   files/ddr-testing-40048-12/entity.json
[2018-02-09T09:04:35.871867-08:00] ok - |   files/ddr-testing-40048-12/files/ddr-testing-40048-12-master-25c2792468-a.jpg
[2018-02-09T09:04:35.871905-08:00] ok - |   files/ddr-testing-40048-12/files/ddr-testing-40048-12-master-25c2792468.json
[2018-02-09T09:04:35.871933-08:00] ok - |   files/ddr-testing-40048-12/files/ddr-testing-40048-12-master-25c2792468.tif
[2018-02-09T09:04:35.871966-08:00] ok - | 4 files staged (4 new, 0 modified)
[2018-02-09T09:04:35.872062-08:00] ok - add_file_commit(<DDR.models.File file:ddr-testing-40048-12-master-25c2792468>, <git.Repo "/var/www/media/ddr/ddr-testing-40048/.git">, <DDR.ingest.AddFileLogger '/var/log/ddr/addfile/ddr-testing-40048/ddr-testing-40048-12.log'>, Philip Kikawa, philip.kikawa@densho.org, ddr-local)
[2018-02-09T09:04:35.890306-08:00] ok - All files staged.
[2018-02-09T09:04:35.890408-08:00] ok - Updating changelog
[2018-02-09T09:04:35.892097-08:00] ok - git add files/ddr-testing-40048-12/changelog
[2018-02-09T09:04:35.914746-08:00] ok - Committing
[2018-02-09T09:04:36.062028-08:00] ok - commit: 41b9eddae3240abc97772def5a2b98fe9e79fed1
[2018-02-09T09:04:36.082658-08:00] ok - files committed:
[2018-02-09T09:04:36.082739-08:00] ok - | .../ddr-testing-40048-12-master-25c2792468-a.jpg
[2018-02-09T09:04:36.082771-08:00] ok - | .../ddr-testing-40048-12-master-25c2792468.json
[2018-02-09T09:04:36.082809-08:00] ok - | .../ddr-testing-40048-12-master-25c2792468.tif
[2018-02-09T09:04:36.082867-08:00] ok - | files/ddr-testing-40048-12/changelog
[2018-02-09T09:04:36.082895-08:00] ok - | files/ddr-testing-40048-12/entity.json
[2018-02-09T09:04:36.082948-08:00] ok - Updating Elasticsearch
[2018-02-09T09:04:36.084937-08:00] not ok - DDRTask.ON_FAILURE
[2018-02-09T09:04:36.087544-08:00] ok - FileAddDebugTask.AFTER_RETURN
[2018-02-09T09:04:36.087587-08:00] ok - task_id: 4e88a635-5d5f-4c43-9def-df4d528654e4
[2018-02-09T09:04:36.087618-08:00] ok - status: FAILURE
[2018-02-09T09:04:36.087645-08:00] ok - retval: 'list' object has no attribute 'identifier'
[2018-02-09T09:04:36.087673-08:00] ok - Unlocking ddr-testing-40048-12
[2018-02-09T09:04:36.089740-08:00] ok - unlocked
[2018-02-09T09:04:36.089783-08:00] ok - END task_id 4e88a635-5d5f-4c43-9def-df4d528654e4

[2018-02-09T09:45:10.860131-08:00] ok - START task_id 5afea249-6530-49f0-9a04-d3812fffcc7b
[2018-02-09T09:45:10.860920-08:00] ok - ddrlocal.webui.file.new
[2018-02-09T09:45:10.860970-08:00] ok - Locking ddr-testing-40048-12
[2018-02-09T09:45:10.864727-08:00] ok - locked
[2018-02-09T09:45:12.996175-08:00] ok - ------------------------------------------------------------------------
[2018-02-09T09:45:12.996230-08:00] ok - DDR.models.Entity.add_file: START
[2018-02-09T09:45:12.996265-08:00] ok - entity: ddr-testing-40048-12
[2018-02-09T09:45:12.996305-08:00] ok - data: {'sort': 1, 'path': u'/media/sf_ddrshared/ddr-densho-296-3-2_master.tif', 'label': u'dfsjkl;', 'public': u'1', 'rights': u'cc'}
[2018-02-09T09:45:12.996379-08:00] ok - Examining source file
[2018-02-09T09:45:12.996422-08:00] ok - check dir /media/sf_ddrshared/ddr-densho-296-3-2_master.tif (| src_path)
[2018-02-09T09:45:12.997046-08:00] ok - | file size 66564304
[2018-02-09T09:45:14.373568-08:00] ok - | md5: 9f987848e01386d846c8f3c41f8b2290
[2018-02-09T09:45:15.739446-08:00] ok - | sha1: 25c279246830a68a9d83719cfbfb6f7dbb3edcc6
[2018-02-09T09:45:17.243156-08:00] ok - | sha256: 7fd46737e962ec4786908f6793e4f24b35cad9994ed6f4c3e895632dd010bf29
[2018-02-09T09:45:17.243250-08:00] ok - | extracting XMP data
[2018-02-09T09:45:17.249784-08:00] ok - Identifier
[2018-02-09T09:45:17.249840-08:00] ok - | idparts {'sha1': '25c2792468', 'role': 'master'}
[2018-02-09T09:45:17.250075-08:00] ok - | identifier <webui.identifier.Identifier file:ddr-testing-40048-12-master-25c2792468>
[2018-02-09T09:45:17.250403-08:00] ok - Checking files/dirs
[2018-02-09T09:45:17.254882-08:00] not ok - Can't add 'ddr-densho-296-3-2_master.tif'. Already exists: 'ddr-testing-40048-12-master-25c2792468'!
[2018-02-09T09:45:17.260170-08:00] not ok - DDRTask.ON_FAILURE
[2018-02-09T09:45:17.262942-08:00] ok - FileAddDebugTask.AFTER_RETURN
[2018-02-09T09:45:17.263009-08:00] ok - task_id: 5afea249-6530-49f0-9a04-d3812fffcc7b
[2018-02-09T09:45:17.263043-08:00] ok - status: FAILURE
[2018-02-09T09:45:17.263071-08:00] ok - retval: Can't add 'ddr-densho-296-3-2_master.tif'. Already exists: 'ddr-testing-40048-12-master-25c2792468'!
[2018-02-09T09:45:17.263101-08:00] ok - Unlocking ddr-testing-40048-12
[2018-02-09T09:45:17.266328-08:00] ok - unlocked
[2018-02-09T09:45:17.266370-08:00] ok - END task_id 5afea249-6530-49f0-9a04-d3812fffcc7b

[2018-02-09T09:45:42.951003-08:00] ok - START task_id a10f0200-74c4-44fc-a3eb-598ab959b1f8
[2018-02-09T09:45:42.951088-08:00] ok - ddrlocal.webui.file.new
[2018-02-09T09:45:42.951129-08:00] ok - Locking ddr-testing-40048-12
[2018-02-09T09:45:42.955033-08:00] ok - locked
[2018-02-09T09:45:45.546985-08:00] ok - ------------------------------------------------------------------------
[2018-02-09T09:45:45.547036-08:00] ok - DDR.models.Entity.add_file: START
[2018-02-09T09:45:45.547070-08:00] ok - entity: ddr-testing-40048-12
[2018-02-09T09:45:45.547110-08:00] ok - data: {'sort': 1, 'path': u'/media/sf_ddrshared/ddr-densho-321-1060_mezz.tif', 'label': u'dgfh', 'public': u'1', 'rights': u'cc'}
[2018-02-09T09:45:45.547145-08:00] ok - Examining source file
[2018-02-09T09:45:45.547184-08:00] ok - check dir /media/sf_ddrshared/ddr-densho-321-1060_mezz.tif (| src_path)
[2018-02-09T09:45:45.547981-08:00] ok - | file size 48744924
[2018-02-09T09:45:46.820802-08:00] ok - | md5: a7cd9876c070b06b82c20fef21dd23ff
[2018-02-09T09:45:48.113651-08:00] ok - | sha1: 5c809ac33b2362ee4bb5f35c791e8712c5106d00
[2018-02-09T09:45:49.365510-08:00] ok - | sha256: 7cf6ee8ac5003c2c8d3ceb8a26d79b04e1e2a0fcd434ea4c00f28da0554f5fde
[2018-02-09T09:45:49.365601-08:00] ok - | extracting XMP data
[2018-02-09T09:45:49.371756-08:00] ok - Identifier
[2018-02-09T09:45:49.371846-08:00] ok - | idparts {'sha1': '5c809ac33b', 'role': 'master'}
[2018-02-09T09:45:49.372059-08:00] ok - | identifier <webui.identifier.Identifier file:ddr-testing-40048-12-master-5c809ac33b>
[2018-02-09T09:45:49.372415-08:00] ok - Checking files/dirs
[2018-02-09T09:45:49.373651-08:00] ok - check dir /var/www/media/ddr/tmp/file-add/ddr-testing-40048/ddr-testing-40048-12 (| tmp_dir)
[2018-02-09T09:45:49.376254-08:00] ok - check dir /var/www/media/ddr/ddr-testing-40048/files/ddr-testing-40048-12/files (| dest_dir)
[2018-02-09T09:45:49.376368-08:00] ok - Copying to work dir
[2018-02-09T09:45:49.376411-08:00] ok - | cp /media/sf_ddrshared/ddr-densho-321-1060_mezz.tif /var/www/media/ddr/tmp/file-add/ddr-testing-40048/ddr-testing-40048-12/ddr-densho-321-1060_mezz.tif
[2018-02-09T09:45:50.205987-08:00] ok - | done
[2018-02-09T09:45:50.206081-08:00] ok - | Renaming ddr-densho-321-1060_mezz.tif -> ddr-testing-40048-12-master-5c809ac33b.tif
[2018-02-09T09:45:50.208369-08:00] ok - Making access file
[2018-02-09T09:45:50.208852-08:00] ok - | /var/www/media/ddr/tmp/file-add/ddr-testing-40048/ddr-testing-40048-12/ddr-testing-40048-12-master-5c809ac33b-a.jpg
[2018-02-09T09:45:52.698469-08:00] ok - | identify: /media/sf_ddrshared/ddr-densho-321-1060_mezz.tif TIFF 5999x4915 5999x4915+0+0 8-bit sRGB 48.74MB 0.000u 0:00.000
[2018-02-09T09:45:52.698574-08:00] ok - | convert "/media/sf_ddrshared/ddr-densho-321-1060_mezz.tif"[0] -resize '1024x1024>' /var/www/media/ddr/tmp/file-add/ddr-testing-40048/ddr-testing-40048-12/ddr-testing-40048-12-master-5c809ac33b-a.jpg
[2018-02-09T09:45:52.698617-08:00] ok - | convert: status:0 exists:True islink:False size:265205
[2018-02-09T09:45:52.698649-08:00] ok - | done
[2018-02-09T09:45:52.698682-08:00] ok - File object
[2018-02-09T09:45:52.699447-08:00] ok - | file_ <DDR.models.File file:ddr-testing-40048-12-master-5c809ac33b>
[2018-02-09T09:45:52.699497-08:00] ok - | file_.basename_orig: ddr-densho-321-1060_mezz.tif
[2018-02-09T09:45:52.699536-08:00] ok - | file_.path_abs: /var/www/media/ddr/ddr-testing-40048/files/ddr-testing-40048-12/files/ddr-testing-40048-12-master-5c809ac33b.tif
[2018-02-09T09:45:52.699571-08:00] ok - | file_.size: 48744924
[2018-02-09T09:45:52.699609-08:00] ok - Attaching access file
[2018-02-09T09:45:52.700232-08:00] ok - | file_.access_rel: ddr-testing-40048-12-master-5c809ac33b-a.jpg
[2018-02-09T09:45:52.700367-08:00] ok - | file_.access_abs: /var/www/media/ddr/ddr-testing-40048/files/ddr-testing-40048-12/files/ddr-testing-40048-12-master-5c809ac33b-a.jpg
[2018-02-09T09:45:52.700410-08:00] ok - Attaching file to entity
[2018-02-09T09:45:52.700445-08:00] ok - | done
[2018-02-09T09:45:52.700473-08:00] ok - Writing object metadata
[2018-02-09T09:45:52.700510-08:00] ok - | /var/www/media/ddr/tmp/file-add/ddr-testing-40048/ddr-testing-40048-12/ddr-testing-40048-12-master-5c809ac33b.json
[2018-02-09T09:45:52.704950-08:00] ok - Moving files to dest_dir
[2018-02-09T09:45:52.705023-08:00] ok - | mv /var/www/media/ddr/tmp/file-add/ddr-testing-40048/ddr-testing-40048-12/ddr-testing-40048-12-master-5c809ac33b.json /var/www/media/ddr/ddr-testing-40048/files/ddr-testing-40048-12/files/ddr-testing-40048-12-master-5c809ac33b.json
[2018-02-09T09:45:52.709327-08:00] ok - | mv /var/www/media/ddr/tmp/file-add/ddr-testing-40048/ddr-testing-40048-12/ddr-testing-40048-12-master-5c809ac33b.tif /var/www/media/ddr/ddr-testing-40048/files/ddr-testing-40048-12/files/ddr-testing-40048-12-master-5c809ac33b.tif
[2018-02-09T09:45:52.711329-08:00] ok - | mv /var/www/media/ddr/tmp/file-add/ddr-testing-40048/ddr-testing-40048-12/ddr-testing-40048-12-master-5c809ac33b-a.jpg /var/www/media/ddr/ddr-testing-40048/files/ddr-testing-40048-12/files/ddr-testing-40048-12-master-5c809ac33b-a.jpg
[2018-02-09T09:45:52.713264-08:00] ok - | all files moved
[2018-02-09T09:45:52.713308-08:00] ok - Writing entity.json
[2018-02-09T09:45:52.747741-08:00] ok - Staging files
[2018-02-09T09:45:52.748725-08:00] ok - | repo <git.Repo "/var/www/media/ddr/ddr-testing-40048/.git">
[2018-02-09T09:45:52.763653-08:00] ok - | 4 files to stage:
[2018-02-09T09:45:52.763726-08:00] ok - |   files/ddr-testing-40048-12/entity.json
[2018-02-09T09:45:52.763758-08:00] ok - |   files/ddr-testing-40048-12/files/ddr-testing-40048-12-master-5c809ac33b.json
[2018-02-09T09:45:52.763789-08:00] ok - |   files/ddr-testing-40048-12/files/ddr-testing-40048-12-master-5c809ac33b.tif
[2018-02-09T09:45:52.763827-08:00] ok - |   files/ddr-testing-40048-12/files/ddr-testing-40048-12-master-5c809ac33b-a.jpg
[2018-02-09T09:45:52.763886-08:00] ok - git stage
[2018-02-09T09:45:52.888759-08:00] ok - annex stage
[2018-02-09T09:45:54.186539-08:00] ok - ok
[2018-02-09T09:45:54.200977-08:00] ok - | 4 files staged:
[2018-02-09T09:45:54.201064-08:00] ok - show_staged True
[2018-02-09T09:45:54.201099-08:00] ok - |   files/ddr-testing-40048-12/entity.json
[2018-02-09T09:45:54.201128-08:00] ok - |   files/ddr-testing-40048-12/files/ddr-testing-40048-12-master-5c809ac33b-a.jpg
[2018-02-09T09:45:54.201158-08:00] ok - |   files/ddr-testing-40048-12/files/ddr-testing-40048-12-master-5c809ac33b.json
[2018-02-09T09:45:54.201185-08:00] ok - |   files/ddr-testing-40048-12/files/ddr-testing-40048-12-master-5c809ac33b.tif
[2018-02-09T09:45:54.201217-08:00] ok - | 4 files staged (4 new, 0 modified)
[2018-02-09T09:45:54.201330-08:00] ok - add_file_commit(<DDR.models.File file:ddr-testing-40048-12-master-5c809ac33b>, <git.Repo "/var/www/media/ddr/ddr-testing-40048/.git">, <DDR.ingest.AddFileLogger '/var/log/ddr/addfile/ddr-testing-40048/ddr-testing-40048-12.log'>, Philip Kikawa, philip.kikawa@densho.org, ddr-local)
[2018-02-09T09:45:54.243312-08:00] ok - All files staged.
[2018-02-09T09:45:54.243427-08:00] ok - Updating changelog
[2018-02-09T09:45:54.247883-08:00] ok - git add files/ddr-testing-40048-12/changelog
[2018-02-09T09:45:54.275409-08:00] ok - Committing
[2018-02-09T09:45:54.442042-08:00] ok - commit: 23d9d779d000d23d3824fbe6e4abfba28458c37b
[2018-02-09T09:45:54.465147-08:00] ok - files committed:
[2018-02-09T09:45:54.465223-08:00] ok - | .../ddr-testing-40048-12-master-5c809ac33b-a.jpg
[2018-02-09T09:45:54.465254-08:00] ok - | .../ddr-testing-40048-12-master-5c809ac33b.json
[2018-02-09T09:45:54.465281-08:00] ok - | .../ddr-testing-40048-12-master-5c809ac33b.tif
[2018-02-09T09:45:54.465308-08:00] ok - | files/ddr-testing-40048-12/changelog
[2018-02-09T09:45:54.465333-08:00] ok - | files/ddr-testing-40048-12/entity.json
[2018-02-09T09:45:54.465385-08:00] ok - Updating Elasticsearch
[2018-02-09T09:45:54.469653-08:00] not ok - DDRTask.ON_FAILURE
[2018-02-09T09:45:54.472502-08:00] ok - FileAddDebugTask.AFTER_RETURN
[2018-02-09T09:45:54.472547-08:00] ok - task_id: a10f0200-74c4-44fc-a3eb-598ab959b1f8
[2018-02-09T09:45:54.472578-08:00] ok - status: FAILURE
[2018-02-09T09:45:54.472605-08:00] ok - retval: 'list' object has no attribute 'identifier'
[2018-02-09T09:45:54.472633-08:00] ok - Unlocking ddr-testing-40048-12
[2018-02-09T09:45:54.476101-08:00] ok - unlocked
[2018-02-09T09:45:54.476143-08:00] ok - END task_id a10f0200-74c4-44fc-a3eb-598ab959b1f8

[2018-02-09T10:15:44.761693-08:00] ok - START task_id 94d1f3ec-e358-469e-8b60-fdc27308788b
[2018-02-09T10:15:44.761778-08:00] ok - ddrlocal.webui.file.new
[2018-02-09T10:15:44.761817-08:00] ok - Locking ddr-testing-40048-12
[2018-02-09T10:15:44.767439-08:00] ok - locked
[2018-02-09T10:15:47.128572-08:00] ok - ------------------------------------------------------------------------
[2018-02-09T10:15:47.128622-08:00] ok - DDR.models.Entity.add_file: START
[2018-02-09T10:15:47.128655-08:00] ok - entity: ddr-testing-40048-12
[2018-02-09T10:15:47.128705-08:00] ok - data: {'sort': 2, 'path': u'/media/sf_ddrshared/ddr-densho-321-1060_mezz.tif', 'label': u'Check', 'public': u'1', 'rights': u'cc'}
[2018-02-09T10:15:47.128740-08:00] ok - Examining source file
[2018-02-09T10:15:47.128774-08:00] ok - check dir /media/sf_ddrshared/ddr-densho-321-1060_mezz.tif (| src_path)
[2018-02-09T10:15:47.129475-08:00] ok - | file size 48744924
[2018-02-09T10:15:48.368177-08:00] ok - | md5: a7cd9876c070b06b82c20fef21dd23ff
[2018-02-09T10:15:49.601804-08:00] ok - | sha1: 5c809ac33b2362ee4bb5f35c791e8712c5106d00
[2018-02-09T10:15:50.903747-08:00] ok - | sha256: 7cf6ee8ac5003c2c8d3ceb8a26d79b04e1e2a0fcd434ea4c00f28da0554f5fde
[2018-02-09T10:15:50.903841-08:00] ok - | extracting XMP data
[2018-02-09T10:15:50.909525-08:00] ok - Identifier
[2018-02-09T10:15:50.909590-08:00] ok - | idparts {'sha1': '5c809ac33b', 'role': 'mezzanine'}
[2018-02-09T10:15:50.909763-08:00] ok - | identifier <webui.identifier.Identifier file:ddr-testing-40048-12-mezzanine-5c809ac33b>
[2018-02-09T10:15:50.910053-08:00] ok - Checking files/dirs
[2018-02-09T10:15:50.910780-08:00] ok - check dir /var/www/media/ddr/tmp/file-add/ddr-testing-40048/ddr-testing-40048-12 (| tmp_dir)
[2018-02-09T10:15:50.912143-08:00] ok - check dir /var/www/media/ddr/ddr-testing-40048/files/ddr-testing-40048-12/files (| dest_dir)
[2018-02-09T10:15:50.912198-08:00] ok - Copying to work dir
[2018-02-09T10:15:50.912236-08:00] ok - | cp /media/sf_ddrshared/ddr-densho-321-1060_mezz.tif /var/www/media/ddr/tmp/file-add/ddr-testing-40048/ddr-testing-40048-12/ddr-densho-321-1060_mezz.tif
[2018-02-09T10:15:51.742263-08:00] ok - | done
[2018-02-09T10:15:51.742362-08:00] ok - | Renaming ddr-densho-321-1060_mezz.tif -> ddr-testing-40048-12-mezzanine-5c809ac33b.tif
[2018-02-09T10:15:51.744649-08:00] ok - Making access file
[2018-02-09T10:15:51.745084-08:00] ok - | /var/www/media/ddr/tmp/file-add/ddr-testing-40048/ddr-testing-40048-12/ddr-testing-40048-12-mezzanine-5c809ac33b-a.jpg
[2018-02-09T10:15:54.152472-08:00] ok - | identify: /media/sf_ddrshared/ddr-densho-321-1060_mezz.tif TIFF 5999x4915 5999x4915+0+0 8-bit sRGB 48.74MB 0.000u 0:00.000
[2018-02-09T10:15:54.152579-08:00] ok - | convert "/media/sf_ddrshared/ddr-densho-321-1060_mezz.tif"[0] -resize '1024x1024>' /var/www/media/ddr/tmp/file-add/ddr-testing-40048/ddr-testing-40048-12/ddr-testing-40048-12-mezzanine-5c809ac33b-a.jpg
[2018-02-09T10:15:54.152625-08:00] ok - | convert: status:0 exists:True islink:False size:265205
[2018-02-09T10:15:54.152660-08:00] ok - | done
[2018-02-09T10:15:54.152694-08:00] ok - File object
[2018-02-09T10:15:54.153449-08:00] ok - | file_ <DDR.models.File file:ddr-testing-40048-12-mezzanine-5c809ac33b>
[2018-02-09T10:15:54.153498-08:00] ok - | file_.basename_orig: ddr-densho-321-1060_mezz.tif
[2018-02-09T10:15:54.153537-08:00] ok - | file_.path_abs: /var/www/media/ddr/ddr-testing-40048/files/ddr-testing-40048-12/files/ddr-testing-40048-12-mezzanine-5c809ac33b.tif
[2018-02-09T10:15:54.153570-08:00] ok - | file_.size: 48744924
[2018-02-09T10:15:54.153607-08:00] ok - Attaching access file
[2018-02-09T10:15:54.154120-08:00] ok - | file_.access_rel: ddr-testing-40048-12-mezzanine-5c809ac33b-a.jpg
[2018-02-09T10:15:54.154166-08:00] ok - | file_.access_abs: /var/www/media/ddr/ddr-testing-40048/files/ddr-testing-40048-12/files/ddr-testing-40048-12-mezzanine-5c809ac33b-a.jpg
[2018-02-09T10:15:54.154203-08:00] ok - Attaching file to entity
[2018-02-09T10:15:54.154237-08:00] ok - | done
[2018-02-09T10:15:54.154265-08:00] ok - Writing object metadata
[2018-02-09T10:15:54.154301-08:00] ok - | /var/www/media/ddr/tmp/file-add/ddr-testing-40048/ddr-testing-40048-12/ddr-testing-40048-12-mezzanine-5c809ac33b.json
[2018-02-09T10:15:54.158582-08:00] ok - Moving files to dest_dir
[2018-02-09T10:15:54.158647-08:00] ok - | mv /var/www/media/ddr/tmp/file-add/ddr-testing-40048/ddr-testing-40048-12/ddr-testing-40048-12-mezzanine-5c809ac33b.json /var/www/media/ddr/ddr-testing-40048/files/ddr-testing-40048-12/files/ddr-testing-40048-12-mezzanine-5c809ac33b.json
[2018-02-09T10:15:54.167164-08:00] ok - | mv /var/www/media/ddr/tmp/file-add/ddr-testing-40048/ddr-testing-40048-12/ddr-testing-40048-12-mezzanine-5c809ac33b.tif /var/www/media/ddr/ddr-testing-40048/files/ddr-testing-40048-12/files/ddr-testing-40048-12-mezzanine-5c809ac33b.tif
[2018-02-09T10:15:54.169408-08:00] ok - | mv /var/www/media/ddr/tmp/file-add/ddr-testing-40048/ddr-testing-40048-12/ddr-testing-40048-12-mezzanine-5c809ac33b-a.jpg /var/www/media/ddr/ddr-testing-40048/files/ddr-testing-40048-12/files/ddr-testing-40048-12-mezzanine-5c809ac33b-a.jpg
[2018-02-09T10:15:54.171284-08:00] ok - | all files moved
[2018-02-09T10:15:54.171331-08:00] ok - Writing entity.json
[2018-02-09T10:15:54.202186-08:00] ok - Staging files
[2018-02-09T10:15:54.203119-08:00] ok - | repo <git.Repo "/var/www/media/ddr/ddr-testing-40048/.git">
[2018-02-09T10:15:54.215564-08:00] ok - | 4 files to stage:
[2018-02-09T10:15:54.215628-08:00] ok - |   files/ddr-testing-40048-12/entity.json
[2018-02-09T10:15:54.215661-08:00] ok - |   files/ddr-testing-40048-12/files/ddr-testing-40048-12-mezzanine-5c809ac33b.json
[2018-02-09T10:15:54.215692-08:00] ok - |   files/ddr-testing-40048-12/files/ddr-testing-40048-12-mezzanine-5c809ac33b.tif
[2018-02-09T10:15:54.215725-08:00] ok - |   files/ddr-testing-40048-12/files/ddr-testing-40048-12-mezzanine-5c809ac33b-a.jpg
[2018-02-09T10:15:54.215761-08:00] ok - git stage
[2018-02-09T10:15:54.336451-08:00] ok - annex stage
[2018-02-09T10:15:55.899882-08:00] ok - ok
[2018-02-09T10:15:55.915227-08:00] ok - | 4 files staged:
[2018-02-09T10:15:55.915294-08:00] ok - show_staged True
[2018-02-09T10:15:55.915329-08:00] ok - |   files/ddr-testing-40048-12/entity.json
[2018-02-09T10:15:55.915357-08:00] ok - |   files/ddr-testing-40048-12/files/ddr-testing-40048-12-mezzanine-5c809ac33b-a.jpg
[2018-02-09T10:15:55.915390-08:00] ok - |   files/ddr-testing-40048-12/files/ddr-testing-40048-12-mezzanine-5c809ac33b.json
[2018-02-09T10:15:55.915418-08:00] ok - |   files/ddr-testing-40048-12/files/ddr-testing-40048-12-mezzanine-5c809ac33b.tif
[2018-02-09T10:15:55.915448-08:00] ok - | 4 files staged (4 new, 0 modified)
[2018-02-09T10:15:55.915542-08:00] ok - add_file_commit(<DDR.models.File file:ddr-testing-40048-12-mezzanine-5c809ac33b>, <git.Repo "/var/www/media/ddr/ddr-testing-40048/.git">, <DDR.ingest.AddFileLogger '/var/log/ddr/addfile/ddr-testing-40048/ddr-testing-40048-12.log'>, Philip Kikawa, philip.kikawa@densho.org, ddr-local)
[2018-02-09T10:15:55.933995-08:00] ok - All files staged.
[2018-02-09T10:15:55.934059-08:00] ok - Updating changelog
[2018-02-09T10:15:55.978894-08:00] ok - git add files/ddr-testing-40048-12/changelog
[2018-02-09T10:15:56.002057-08:00] ok - Committing
[2018-02-09T10:15:56.161170-08:00] ok - commit: 819d4f41579bf7994ce312d8931b0b9fe46a6e65
[2018-02-09T10:15:56.182976-08:00] ok - files committed:
[2018-02-09T10:15:56.183042-08:00] ok - | .../ddr-testing-40048-12-mezzanine-5c809ac33b.json
[2018-02-09T10:15:56.183073-08:00] ok - | .../ddr-testing-40048-12-mezzanine-5c809ac33b.tif
[2018-02-09T10:15:56.183100-08:00] ok - | ...ddr-testing-40048-12-mezzanine-5c809ac33b-a.jpg
[2018-02-09T10:15:56.183126-08:00] ok - | files/ddr-testing-40048-12/changelog
[2018-02-09T10:15:56.183152-08:00] ok - | files/ddr-testing-40048-12/entity.json
[2018-02-09T10:15:56.183201-08:00] ok - Updating Elasticsearch
[2018-02-09T10:15:56.185440-08:00] not ok - DDRTask.ON_FAILURE
[2018-02-09T10:15:56.188001-08:00] ok - FileAddDebugTask.AFTER_RETURN
[2018-02-09T10:15:56.188042-08:00] ok - task_id: 94d1f3ec-e358-469e-8b60-fdc27308788b
[2018-02-09T10:15:56.188073-08:00] ok - status: FAILURE
[2018-02-09T10:15:56.188100-08:00] ok - retval: 'list' object has no attribute 'identifier'
[2018-02-09T10:15:56.188128-08:00] ok - Unlocking ddr-testing-40048-12
[2018-02-09T10:15:56.190611-08:00] ok - unlocked
[2018-02-09T10:15:56.190654-08:00] ok - END task_id 94d1f3ec-e358-469e-8b60-fdc27308788b
gjost commented 6 years ago

Looks like file ingest failed when DDR failed to connect to Elasticsearch.

gjost commented 6 years ago

The "Updating Elasticsearch" error actually occurs in ddr-local; look there for more updates: https://github.com/densho/ddr-local/issues/231

gjost commented 6 years ago

Actually it was fixed here.