search

richq / folders2flickr

Upload files to flickr
Other
102 stars 38 forks source link

KeyError and IndexError #19

Closed michieldewit closed 10 years ago

michieldewit commented 10 years ago

I just pulled the latest version (the f2fignore branch, actually) and ran folders2flickr. I did not run it for a few weeks. During indexing it came up with a whole bunch of KeyError and IndexError exceptions. An excerpt from the error.log:

(<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0004',), <traceback object at 0x2e81560>)
(<type 'exceptions.IndexError'>, IndexError('list index out of range',), <traceback object at 0x2f51320>)
(<type 'exceptions.IndexError'>, IndexError('list index out of range',), <traceback object at 0x2f51878>)
(<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0004',), <traceback object at 0x2e81710>)
(<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0004',), <traceback object at 0x2f4e488>)
(<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0004',), <traceback object at 0x2f4e6c8>)
(<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0004',), <traceback object at 0x2f4e5f0>)
(<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0004',), <traceback object at 0x2f4e440>)
(<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0004',), <traceback object at 0x2f4ea28>)
(<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0004',), <traceback object at 0x2f4e680>)
(<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0004',), <traceback object at 0x2f4e290>)
(<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0004',), <traceback object at 0x2f4e488>)
(<type 'exceptions.IndexError'>, IndexError('list index out of range',), <traceback object at 0x2e80ab8>)
(<type 'exceptions.IndexError'>, IndexError('string index out of range',), <traceback object at 0x2f511b8>)
(<type 'exceptions.IndexError'>, IndexError('string index out of range',), <traceback object at 0x2e80878>)
(<type 'exceptions.IndexError'>, IndexError('list index out of range',), <traceback object at 0x2e80f38>)
(<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0004',), <traceback object at 0x2f4ebd8>)
(<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0004',), <traceback object at 0x2f4eb00>)

And an excerpt from debug.log:

2014-03-18 18:07:36,336 ERROR (<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0001',), <traceback object at 0x2e7ab90>)
2014-03-18 18:07:36,337 DEBUG Getting EXIF for /storage/Photos/2009/Huis verkopen/Selectie/Woonkamer/IMG_2965.JPG
2014-03-18 18:07:36,376 ERROR (<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0001',), <traceback object at 0x2e817a0>)
2014-03-18 18:07:36,377 DEBUG Getting EXIF for /storage/Photos/2009/Huis verkopen/Selectie/Woonkamer/IMG_2969.JPG
2014-03-18 18:07:36,406 ERROR (<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0001',), <traceback object at 0x2e816c8>)
2014-03-18 18:07:36,428 DEBUG Getting EXIF for /storage/Photos/2010/2. Wereldreis/10. Thailand [Mei-Augustus]/3. Koh Tao/10. Dag 12 - foto's motorfiets/P6120111.JPG
2014-03-18 18:07:36,562 ERROR (<type 'exceptions.IndexError'>, IndexError('list index out of range',), <traceback object at 0x2e816c8>)
2014-03-18 18:07:36,564 DEBUG Getting EXIF for /storage/Photos/2010/2. Wereldreis/10. Thailand [Mei-Augustus]/3. Koh Tao/12. snorkel test Avery/P6190111.JPG
2014-03-18 18:07:36,793 ERROR (<type 'exceptions.IndexError'>, IndexError('string index out of range',), <traceback object at 0x2f516c8>)
2014-03-18 18:10:16,761 Uploading image /storage/Photos/2011/4. April/1. Vrijgezellenfeest S&A/Karin/P4030094_10.avi with tags #/2011/4.#April/1.#Vrijgezellenfeest#S&A/Karin/P4030094_10.avi "" "2011" "4. April" "1. Vrijgezellenfeest S&A" "Karin"
2014-03-18 18:10:21,966 (<type 'exceptions.IndexError'>, IndexError('list index out of range',), <traceback object at 0x2f256c8>)
2014-03-18 18:10:22,111 (<type 'exceptions.IndexError'>, IndexError('list index out of range',), <traceback object at 0x2f23908>)

The script is actually uploading photos, but it does generate a lot of these errors in the mean time. Any idea what may be going on?

richq commented 10 years ago

Ouch! Is this the same camera and everything? I really need to get up to date on the upstream exif.py, but I'm starting to thing it might be something else that's broken :-/

On 03/18/2014 06:16 PM, Michiel de Wit wrote:

I just pulled the latest version (the f2fignore branch, actually) and ran folders2flickr. I did not run it for a few weeks. During indexing it came up with a whole bunch of KeyError and IndexError exceptions. An excerpt from the error.log:

(<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0004',), <traceback object at 0x2e81560>) (<type 'exceptions.IndexError'>, IndexError('list index out of range',), <traceback object at 0x2f51320>) (<type 'exceptions.IndexError'>, IndexError('list index out of range',), <traceback object at 0x2f51878>) (<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0004',), <traceback object at 0x2e81710>) (<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0004',), <traceback object at 0x2f4e488>) (<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0004',), <traceback object at 0x2f4e6c8>) (<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0004',), <traceback object at 0x2f4e5f0>) (<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0004',), <traceback object at 0x2f4e440>) (<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0004',), <traceback object at 0x2f4ea28>) (<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0004',), <traceback object at 0x2f4e680>) (<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0004',), <traceback object at 0x2f4e290>) (<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0004',), <traceback object at 0x2f4e488>) (<type 'exceptions.IndexError'>, IndexError('list index out of range',), <traceback object at 0x2e80ab8>) (<type 'exceptions.IndexError'>, IndexError('string index out of range',), <traceback object at 0x2f511b8>) (<type 'exceptions.IndexError'>, IndexError('string index out of range',), <traceback object at 0x2e80878>) (<type 'exceptions.IndexError'>, IndexError('list index out of range',), <traceback object at 0x2e80f38>) (<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0004',), <traceback object at 0x2f4ebd8>) (<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0004',), <traceback object at 0x2f4eb00>)

And an excerpt from debug.log:

2014-03-18 18:07:36,336 ERROR (<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0001',), <traceback object at 0x2e7ab90>) 2014-03-18 18:07:36,337 DEBUG Getting EXIF for /storage/Photos/2009/Huis verkopen/Selectie/Woonkamer/IMG_2965.JPG 2014-03-18 18:07:36,376 ERROR (<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0001',), <traceback object at 0x2e817a0>) 2014-03-18 18:07:36,377 DEBUG Getting EXIF for /storage/Photos/2009/Huis verkopen/Selectie/Woonkamer/IMG_2969.JPG 2014-03-18 18:07:36,406 ERROR (<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0001',), <traceback object at 0x2e816c8>) 2014-03-18 18:07:36,428 DEBUG Getting EXIF for /storage/Photos/2010/2. Wereldreis/10. Thailand [Mei-Augustus]/3. Koh Tao/10. Dag 12 - foto's motorfiets/P6120111.JPG 2014-03-18 18:07:36,562 ERROR (<type 'exceptions.IndexError'>, IndexError('list index out of range',), <traceback object at 0x2e816c8>) 2014-03-18 18:07:36,564 DEBUG Getting EXIF for /storage/Photos/2010/2. Wereldreis/10. Thailand [Mei-Augustus]/3. Koh Tao/12. snorkel test Avery/P6190111.JPG 2014-03-18 18:07:36,793 ERROR (<type 'exceptions.IndexError'>, IndexError('string index out of range',), <traceback object at 0x2f516c8>)

Any idea what may be going on?

— Reply to this email directly or view it on GitHub https://github.com/richq/folders2flickr/issues/19.

michieldewit commented 10 years ago

Hi Richard,

The photos have not changed since the last run. In fact, my collection is quite large, so F2F is not yet finished with the first round of syncing. So it is possible F2F did not yet see the pictures. I have attached one of these pictures. Perhaps it prove to be of use to you?

Kind regards,

Michiel de Wit

On Tue, Mar 18, 2014 at 9:20 PM, Richard Quirk notifications@github.comwrote:

Ouch! Is this the same camera and everything? I really need to get up to date on the upstream exif.py, but I'm starting to thing it might be something else that's broken :-/

On 03/18/2014 06:16 PM, Michiel de Wit wrote:

I just pulled the latest version (the f2fignore branch, actually) and ran folders2flickr. I did not run it for a few weeks. During indexing it came up with a whole bunch of KeyError and IndexError exceptions. An excerpt from the error.log:

(<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0004',), <traceback object at 0x2e81560>) (<type 'exceptions.IndexError'>, IndexError('list index out of range',), <traceback object at 0x2f51320>) (<type 'exceptions.IndexError'>, IndexError('list index out of range',), <traceback object at 0x2f51878>) (<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0004',), <traceback object at 0x2e81710>) (<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0004',), <traceback object at 0x2f4e488>) (<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0004',), <traceback object at 0x2f4e6c8>) (<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0004',), <traceback object at 0x2f4e5f0>) (<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0004',), <traceback object at 0x2f4e440>) (<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0004',), <traceback object at 0x2f4ea28>) (<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0004',), <traceback object at 0x2f4e680>) (<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0004',), <traceback object at 0x2f4e290>) (<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0004',), <traceback object at 0x2f4e488>) (<type 'exceptions.IndexError'>, IndexError('list index out of range',), <traceback object at 0x2e80ab8>) (<type 'exceptions.IndexError'>, IndexError('string index out of range',), <traceback object at 0x2f511b8>) (<type 'exceptions.IndexError'>, IndexError('string index out of range',), <traceback object at 0x2e80878>) (<type 'exceptions.IndexError'>, IndexError('list index out of range',), <traceback object at 0x2e80f38>) (<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0004',), <traceback object at 0x2f4ebd8>) (<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0004',), <traceback object at 0x2f4eb00>)

And an excerpt from debug.log:

2014-03-18 18:07:36,336 ERROR (<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0001',), <traceback object at 0x2e7ab90>) 2014-03-18 18:07:36,337 DEBUG Getting EXIF for /storage/Photos/2009/Huis verkopen/Selectie/Woonkamer/IMG_2965.JPG 2014-03-18 18:07:36,376 ERROR (<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0001',), <traceback object at 0x2e817a0>) 2014-03-18 18:07:36,377 DEBUG Getting EXIF for /storage/Photos/2009/Huis verkopen/Selectie/Woonkamer/IMG_2969.JPG 2014-03-18 18:07:36,406 ERROR (<type 'exceptions.KeyError'>, KeyError('MakerNote Tag 0x0001',), <traceback object at 0x2e816c8>) 2014-03-18 18:07:36,428 DEBUG Getting EXIF for /storage/Photos/2010/2. Wereldreis/10. Thailand [Mei-Augustus]/3. Koh Tao/10. Dag 12 - foto's motorfiets/P6120111.JPG 2014-03-18 18:07:36,562 ERROR (<type 'exceptions.IndexError'>, IndexError('list index out of range',), <traceback object at 0x2e816c8>) 2014-03-18 18:07:36,564 DEBUG Getting EXIF for /storage/Photos/2010/2. Wereldreis/10. Thailand [Mei-Augustus]/3. Koh Tao/12. snorkel test Avery/P6190111.JPG 2014-03-18 18:07:36,793 ERROR (<type 'exceptions.IndexError'>, IndexError('string index out of range',), <traceback object at 0x2f516c8>)

Any idea what may be going on?

Reply to this email directly or view it on GitHub https://github.com/richq/folders2flickr/issues/19.

Reply to this email directly or view it on GitHubhttps://github.com/richq/folders2flickr/issues/19#issuecomment-37982608 .

richq commented 10 years ago

Hi Michiel,

It seems github stripped the image from your email message :( Can you attach it to a comment via their web interface? It'd be great to have an example, if I can repro the problem I can fix it.

Thanks

michieldewit commented 10 years ago

I see. I attached it again. img_2965

richq commented 10 years ago

Thanks! I'll try and debug it this weekend.

richq commented 10 years ago

This should be fixed now as v1.1 uses an external python-exif, exif-py, exifread rather than the built in one.