search

sul-dlss / assembly-image

Creates JP2 image derivatives of files.
Other
0 stars 1 forks source link

some jp2s created in jp2-create don't render in the viewer #203

Open andrewjbtw opened 4 months ago

andrewjbtw commented 4 months ago

We've seen cases where some JP2s created via jp2-create don't render in the viewer, while other JP2s in the same object render successfully.

Note: the example below has been fixed by submitting new images but I still have the original problem files

Example: https://argo.stanford.edu/view/druid:ps622dm7550 -

The first page of that item won't load in the viewer. There's an error message for 

An error occurred

TypeError: NetworkError when attempting to fetch resource.

But the inside pages load just fine.

The images were produced with different cameras but went through the same production processes and then were accessioned together.

exiftool differences

There are some differences in the exiftool output for the images.

The image that doesn't load - note the warning:

ExifTool Version Number         : 12.76
File Name                       : ps622dm7550_0001.jp2
Directory                       : .
File Size                       : 39 MB
File Modification Date/Time     : 2024:06:03 17:11:20-07:00
File Access Date/Time           : 2024:06:04 09:22:11-07:00
File Inode Change Date/Time     : 2024:06:04 09:22:09-07:00
File Permissions                : -rw-r--r--
File Type                       : JP2
File Type Extension             : jp2
MIME Type                       : image/jp2
Major Brand                     : JPEG 2000 Image (.JP2)
Minor Version                   : 0.0.0
Compatible Brands               : jp2
Image Height                    : 7835
Image Width                     : 6369
Number Of Components            : 3
Bits Per Component              : 8 Bits, Unsigned
Compression                     : JPEG 2000
Color Spec Method               : Enumerated
Color Spec Precedence           : 0
Color Spec Approximation        : Not Specified
Color Space                     : sRGB
Capture Y Resolution            : 23622
Capture X Resolution            : 23622
Capture Y Resolution Unit       : m
Capture X Resolution Unit       : m
XMP Toolkit                     : XMP Core 5.5.0
Make                            : Phase One
Camera Model Name               : iXH 150MP
Serial Number                   : NA000041
Lens Info                       : 72mm f/5.59999288939453-21.9999786374997
Lens                            : Phase One RS 72mm MkII/iXG
Lens Serial Number              : UL001181
Image Number                    : 89184
Firmware                        : iXH 150MP, v1.03.4 (FWR)
Date Created                    : 2024:05:30 15:01:13
Caption Writer                  : 
Headline                        : 
City                            : 
State                           : 
Country                         : 
Source                          : 
Instructions                    : 
Category                        : 
Authors Position                : 
Transmission Reference          : 
Credit                          : 
Legacy IPTC Digest              : 1FBF68003B2A1BE6C093034E41B6A914
Create Date                     : 2024:05:30 15:01:13
Creator Tool                    : Capture One 20 Windows
Location                        : 
Intellectual Genre              : 
Country Code                    : 
Parent MEID                     : 
Original File Name              : 
Creator Work Email              : 
Creator Work Telephone          : 
Creator Postal Code             : 
Creator Work URL                : 
Creator Address                 : 
Creator City                    : 
Creator Country                 : 
Creator Region                  : 
Description                     : 
Rights                          : 
Title                           : 
Subject                         : 20240530 covers
Usage Terms                     : 
Hierarchical Subject            : 20240530 covers
Coded Character Set             : UTF8
Application Record Version      : 4
Warning                         : Unrecognized UUID-IPTC box
Image Size                      : 6369x7835
Megapixels                      : 49.9
Lens ID                         : Phase One RS 72mm MkII/iXG

And this is for an image that does load:

ExifTool Version Number         : 12.76
File Name                       : ps622dm7550_0002.jp2
Directory                       : .
File Size                       : 19 MB
File Modification Date/Time     : 2024:06:03 17:11:21-07:00
File Access Date/Time           : 2024:06:04 09:22:25-07:00
File Inode Change Date/Time     : 2024:06:04 09:22:23-07:00
File Permissions                : -rw-r--r--
File Type                       : JP2
File Type Extension             : jp2
MIME Type                       : image/jp2
Major Brand                     : JPEG 2000 Image (.JP2)
Minor Version                   : 0.0.0
Compatible Brands               : jp2
Image Height                    : 7791
Image Width                     : 6023
Number Of Components            : 3
Bits Per Component              : 8 Bits, Unsigned
Compression                     : JPEG 2000
Color Spec Method               : Enumerated
Color Spec Precedence           : 0
Color Spec Approximation        : Not Specified
Color Space                     : sRGB
Capture Y Resolution            : 23622
Capture X Resolution            : 23622
Capture Y Resolution Unit       : m
Capture X Resolution Unit       : m
XMP Toolkit                     : XMP Core 5.5.0
Make                            : Phase One
Camera Model Name               : iXG 100MP
Create Date                     : 2024:05:14 21:56:49
Creator Tool                    : Capture One 20 Windows
Serial Number                   : YN020045
Lens Info                       : 72mm f/21.9999786374997-5.59999288939453
Lens                            : Schneider Kreuznach RS-72mm/iXG
Lens Serial Number              : 15507821
Image Number                    : 28646
Firmware                        : iXG 100MP, Factory Firmware: 3.11.4
Date Created                    : 2024:05:14 21:56:49
Caption Writer                  : 
Headline                        : 
City                            : 
State                           : 
Country                         : 
Source                          : 
Instructions                    : 
Category                        : 
Authors Position                : 
Transmission Reference          : 
Credit                          : 
Legacy IPTC Digest              : 37814F3DE02E76512B7DD44EA8D1D7E6
Location                        : 
Intellectual Genre              : 
Country Code                    : 
Parent MEID                     : 
Original File Name              : 
Creator Work Email              : 
Creator Work Telephone          : 
Creator Postal Code             : 
Creator Work URL                : 
Creator Address                 : 
Creator City                    : 
Creator Country                 : 
Creator Region                  : 
Description                     : 
Rights                          : 
Title                           : 
Subject                         : v1 left
Usage Terms                     : 
Hierarchical Subject            : v1 left
Coded Character Set             : UTF8
Application Record Version      : 4
Keywords                        : 
Image Size                      : 6023x7791
Megapixels                      : 46.9
Lens ID                         : Schneider Kreuznach RS-72mm/iXG

One possibility is that the source TIFFs have some difference that leads to different JP2s.

andrewjbtw commented 4 months ago

Note that there's a related ticket on the image server side https://github.com/cantaloupe-project/cantaloupe/issues/648

I've filed this issue in case there's something we can do at the JP2-production side of things.

andrewjbtw commented 3 months ago

Here's the exiftool output for the two tiffs:

The one that doesn't work:

ExifTool Version Number         : 12.76
File Name                       : ps622dm7550_0001.tif
Directory                       : .
File Size                       : 149 MB
File Modification Date/Time     : 2024:06:04 09:57:25-07:00
File Access Date/Time           : 2024:06:04 09:57:26-07:00
File Inode Change Date/Time     : 2024:06:04 09:57:25-07:00
File Permissions                : -rw-r--r--
File Type                       : TIFF
File Type Extension             : tif
MIME Type                       : image/tiff
Exif Byte Order                 : Little-endian (Intel, II)
Image Width                     : 6369
Image Height                    : 7835
Bits Per Sample                 : 8 8 8
Compression                     : LZW
Photometric Interpretation      : RGB
Make                            : Phase One
Camera Model Name               : iXH 150MP
Strip Offsets                   : (Binary data 168 bytes, use -b option to extract)
Orientation                     : Horizontal (normal)
Samples Per Pixel               : 3
Rows Per Strip                  : 432
Strip Byte Counts               : (Binary data 150 bytes, use -b option to extract)
X Resolution                    : 600
Y Resolution                    : 600
Planar Configuration            : Chunky
Resolution Unit                 : inches
Software                        : Capture One 20 Windows
XMP Toolkit                     : XMP Core 5.5.0
Lens                            : Phase One RS 72mm MkII/iXG
Image Number                    : 89184
Firmware                        : iXH 150MP, v1.03.4 (FWR)
Caption Writer                  : 
Headline                        : 
City                            : 
State                           : 
Country                         : 
Source                          : 
Instructions                    : 
Category                        : 
Authors Position                : 
Transmission Reference          : 
Credit                          : 
Legacy IPTC Digest              : 1FBF68003B2A1BE6C093034E41B6A914
Creator Tool                    : Capture One 20 Windows
Location                        : 
Intellectual Genre              : 
Country Code                    : 
Parent MEID                     : 
Original File Name              : 
Creator Work Email              : 
Creator Work Telephone          : 
Creator Postal Code             : 
Creator Work URL                : 
Creator Address                 : 
Creator City                    : 
Creator Country                 : 
Creator Region                  : 
Description                     : 
Rights                          : 
Title                           : 
Subject                         : 20240530 covers
Usage Terms                     : 
Hierarchical Subject            : 20240530 covers
Current IPTC Digest             : 1ed1c929252dbd4bd44fb7172d352349
Coded Character Set             : UTF8
Application Record Version      : 4
Keywords                        : 20240530 covers
Date Created                    : 2024:05:30
Time Created                    : 15:01:13
Digital Creation Date           : 2024:05:30
Digital Creation Time           : 15:01:13
Exposure Time                   : 1/100
F Number                        : 8.0
Exposure Program                : Program AE
ISO                             : 125
Exif Version                    : 0230
Date/Time Original              : 2024:05:30 15:01:13
Create Date                     : 2024:05:30 15:01:13
Shutter Speed Value             : 1/100
Aperture Value                  : 8.0
Exposure Compensation           : 0
Light Source                    : Unknown
Focal Length                    : 72.0 mm
Exif Image Width                : 6369
Exif Image Height               : 7835
Focal Plane X Resolution        : 2659.574463
Focal Plane Y Resolution        : 2659.574463
Focal Plane Resolution Unit     : cm
Sensing Method                  : One-chip color area
File Source                     : Digital Camera
Scene Type                      : Directly photographed
White Balance                   : Auto
Image Unique ID                 : 000000004E4130303030343100015C60
Serial Number                   : NA000041
Lens Info                       : 72mm f/5.599992889-21.99997864
Lens Model                      : Phase One RS 72mm MkII/iXG
Lens Serial Number              : UL001181
Profile CMM Type                : Adobe Systems Inc.
Profile Version                 : 2.1.0
Profile Class                   : Display Device Profile
Color Space Data                : RGB
Profile Connection Space        : XYZ
Profile Date Time               : 2000:08:11 19:51:59
Profile File Signature          : acsp
Primary Platform                : Apple Computer Inc.
CMM Flags                       : Not Embedded, Independent
Device Manufacturer             : none
Device Model                    : 
Device Attributes               : Reflective, Glossy, Positive, Color
Rendering Intent                : Perceptual
Connection Space Illuminant     : 0.9642 1 0.82491
Profile Creator                 : Adobe Systems Inc.
Profile ID                      : 0
Profile Copyright               : Copyright 2000 Adobe Systems Incorporated
Profile Description             : Adobe RGB (1998)
Media White Point               : 0.95045 1 1.08905
Media Black Point               : 0 0 0
Red Tone Reproduction Curve     : (Binary data 14 bytes, use -b option to extract)
Green Tone Reproduction Curve   : (Binary data 14 bytes, use -b option to extract)
Blue Tone Reproduction Curve    : (Binary data 14 bytes, use -b option to extract)
Red Matrix Column               : 0.60974 0.31111 0.01947
Green Matrix Column             : 0.20528 0.62567 0.06087
Blue Matrix Column              : 0.14919 0.06322 0.74457
Aperture                        : 8.0
Image Size                      : 6369x7835
Megapixels                      : 49.9
Scale Factor To 35 mm Equivalent: 1.1
Shutter Speed                   : 1/100
Date/Time Created               : 2024:05:30 15:01:13
Digital Creation Date/Time      : 2024:05:30 15:01:13
Circle Of Confusion             : 0.026 mm
Field Of View                   : 24.7 deg
Focal Length                    : 72.0 mm (35 mm equivalent: 82.1 mm)
Hyperfocal Distance             : 24.58 m
Light Value                     : 12.3
Lens ID                         : Phase One RS 72mm MkII/iXG

The one that does work


ExifTool Version Number         : 12.76
File Name                       : ps622dm7550_0002.tif
Directory                       : .
File Size                       : 81 MB
File Modification Date/Time     : 2024:06:04 09:57:22-07:00
File Access Date/Time           : 2024:06:04 09:57:23-07:00
File Inode Change Date/Time     : 2024:06:04 09:57:22-07:00
File Permissions                : -rw-r--r--
File Type                       : TIFF
File Type Extension             : tif
MIME Type                       : image/tiff
Exif Byte Order                 : Little-endian (Intel, II)
Image Width                     : 6023
Image Height                    : 7791
Bits Per Sample                 : 8 8 8
Compression                     : LZW
Photometric Interpretation      : RGB
Make                            : Phase One
Camera Model Name               : iXG 100MP
Strip Offsets                   : (Binary data 143 bytes, use -b option to extract)
Orientation                     : Horizontal (normal)
Samples Per Pixel               : 3
Rows Per Strip                  : 464
Strip Byte Counts               : (Binary data 135 bytes, use -b option to extract)
X Resolution                    : 600
Y Resolution                    : 600
Planar Configuration            : Chunky
Resolution Unit                 : inches
Software                        : Capture One 20 Windows
XMP Toolkit                     : XMP Core 5.5.0
Creator Tool                    : Capture One 20 Windows
Lens                            : Schneider Kreuznach RS-72mm/iXG
Image Number                    : 28646
Firmware                        : iXG 100MP, Factory Firmware: 3.11.4
Caption Writer                  : 
Headline                        : 
City                            : 
State                           : 
Country                         : 
Source                          : 
Instructions                    : 
Category                        : 
Authors Position                : 
Transmission Reference          : 
Credit                          : 
Legacy IPTC Digest              : 37814F3DE02E76512B7DD44EA8D1D7E6
Location                        : 
Intellectual Genre              : 
Country Code                    : 
Parent MEID                     : 
Original File Name              : 
Creator Work Email              : 
Creator Work Telephone          : 
Creator Postal Code             : 
Creator Work URL                : 
Creator Address                 : 
Creator City                    : 
Creator Country                 : 
Creator Region                  : 
Description                     : 
Rights                          : 
Title                           : 
Subject                         : v1 left
Usage Terms                     : 
Hierarchical Subject            : v1 left
Current IPTC Digest             : 45bd56fe4f9854df4cffcd188fb18c3e
Coded Character Set             : UTF8
Application Record Version      : 4
Keywords                        : v1 left
Date Created                    : 2024:05:14
Time Created                    : 21:56:49
Digital Creation Date           : 2024:05:14
Digital Creation Time           : 21:56:49
Exposure Time                   : 1/30
F Number                        : 8.0
Exposure Program                : Manual
ISO                             : 400
Exif Version                    : 0230
Date/Time Original              : 2024:05:14 21:56:49
Create Date                     : 2024:05:14 21:56:49
Shutter Speed Value             : 1/30
Aperture Value                  : 8.0
Exposure Compensation           : 0
Metering Mode                   : Average
Light Source                    : Flash
Focal Length                    : 72.0 mm
Exif Image Width                : 6023
Exif Image Height               : 7791
Focal Plane X Resolution        : 2173.913055
Focal Plane Y Resolution        : 2173.913055
Focal Plane Resolution Unit     : cm
Sensing Method                  : One-chip color area
File Source                     : Digital Camera
Scene Type                      : Directly photographed
White Balance                   : Unknown (4)
Image Unique ID                 : 00005000508600000400E05800006FE6
Serial Number                   : YN020045
Lens Info                       : 72mm f/21.99997864-5.599992889
Lens Model                      : Schneider Kreuznach RS-72mm/iXG
Lens Serial Number              : 15507821
Profile CMM Type                : Adobe Systems Inc.
Profile Version                 : 2.1.0
Profile Class                   : Display Device Profile
Color Space Data                : RGB
Profile Connection Space        : XYZ
Profile Date Time               : 2000:08:11 19:51:59
Profile File Signature          : acsp
Primary Platform                : Apple Computer Inc.
CMM Flags                       : Not Embedded, Independent
Device Manufacturer             : none
Device Model                    : 
Device Attributes               : Reflective, Glossy, Positive, Color
Rendering Intent                : Perceptual
Connection Space Illuminant     : 0.9642 1 0.82491
Profile Creator                 : Adobe Systems Inc.
Profile ID                      : 0
Profile Copyright               : Copyright 2000 Adobe Systems Incorporated
Profile Description             : Adobe RGB (1998)
Media White Point               : 0.95045 1 1.08905
Media Black Point               : 0 0 0
Red Tone Reproduction Curve     : (Binary data 14 bytes, use -b option to extract)
Green Tone Reproduction Curve   : (Binary data 14 bytes, use -b option to extract)
Blue Tone Reproduction Curve    : (Binary data 14 bytes, use -b option to extract)
Red Matrix Column               : 0.60974 0.31111 0.01947
Green Matrix Column             : 0.20528 0.62567 0.06087
Blue Matrix Column              : 0.14919 0.06322 0.74457
Aperture                        : 8.0
Image Size                      : 6023x7791
Megapixels                      : 46.9
Scale Factor To 35 mm Equivalent: 1.0
Shutter Speed                   : 1/30
Date/Time Created               : 2024:05:14 21:56:49
Digital Creation Date/Time      : 2024:05:14 21:56:49
Circle Of Confusion             : 0.031 mm
Field Of View                   : 29.3 deg
Focal Length                    : 72.0 mm (35 mm equivalent: 68.8 mm)
Hyperfocal Distance             : 20.60 m
Light Value                     : 8.9
Lens ID                         : Schneider Kreuznach RS-72mm/iXG