search

dfandrich / gpscorrelate

C program to match GPS tracks to photographs, and store the matches in the EXIF data in the photographs.
https://dfandrich.github.io/gpscorrelate/
GNU General Public License v2.0
24 stars 8 forks source link

man page says timezone defaults to computer timezone and ignores picture timezone tag? #24

Open marcmerlin opened 5 months ago

marcmerlin commented 5 months ago

All new cameras tag the timezone the picture was taken in Date/Time Original : 2023:11:06 16:15:35 Offset Time : +07:00 Offset Time Original : +07:00 Offset Time Digitized : +07:00

merlin [mc]$ gpscorrelate -g z20231020_Thailand_Vietnam.gpx -t -v *.jpg gives me Date/Time Original : 2023:11:06 16:15:35.181+07:00 GPS Date/Time : 2023:11:07 00:15:35Z

and the GPS tag is just not the correct one. merlin [mc]$ gpscorrelate -R -z+07:00 -g z20231020_Thailand_Vietnam.gpx -t -v *.jpg fixes it, but that means I have to read the GPS offset in the picture and give it to gpscorrelate, instead of it getting it itself. Also, me doing it manually won't work well if a directory has a mix of pictures from different timezones,

Is that working as expected? If so, can the code be improved to use the timezone inside the exif tag? Thanks

dfandrich commented 5 months ago

It's working as designedl; any time zone tag within the image is currently ignored. If a time zone tag is present, it should really be used instead as it is direct evidence instead of inference.

The only test images I have in my collection with time zone information are a few from Nikon DSLRs and they are using a nonstandard MakerNote tag for this. Can you point to upload some test images with time zones?

marcmerlin commented 5 months ago

Sure, thing, I will give you 3 different cameras that do this (last one is cell phone so the picture should already be geotagged) Panasonic TZ200 look for Offset Time : +07:00 Offset Time Original : +07:00 Offset Time Digitized : +07:00 109_20231106_Saigon_Panasonic

merlin [mc]$ exiftool 109_20231106_Saigon_Panasonic.jpg ExifTool Version Number : 12.57 File Name : 109_20231106_Saigon_Panasonic.jpg Directory : . File Size : 651 kB File Modification Date/Time : 2024:01:23 03:26:55-08:00 File Access Date/Time : 2023:11:08 04:11:18-08:00 File Inode Change Date/Time : 2024:01:23 03:26:55-08:00 File Permissions : -rw-r--r-- File Type : JPEG File Type Extension : jpg MIME Type : image/jpeg Exif Byte Order : Little-endian (Intel, II) Make : Panasonic Camera Model Name : DC-ZS200D Orientation : Horizontal (normal) X Resolution : 180 Y Resolution : 180 Resolution Unit : inches Software : Ver.1.0 Modify Date : 2023:11:06 16:15:35 Y Cb Cr Positioning : Co-sited Exposure Time : 1/80 F Number : 6.3 Exposure Program : Program AE ISO : 160 Sensitivity Type : Standard Output Sensitivity Standard Output Sensitivity : 160 Exif Version : 0231 Date/Time Original : 2023:11:06 16:15:35 Create Date : 2023:11:06 16:15:35 Offset Time : +07:00 Offset Time Original : +07:00 Offset Time Digitized : +07:00 Components Configuration : Y, Cb, Cr, - Compressed Bits Per Pixel : 4 Exposure Compensation : +0.33 Max Aperture Value : 4.9 Metering Mode : Multi-segment Light Source : Unknown Flash : Off, Did not fire Focal Length : 29.5 mm Image Quality : High Firmware Version : 0.1.0.0 White Balance : Auto Focus Mode : Auto AF Area Mode : 49-area Image Stabilization : On, Optical Macro Mode : Off Shooting Mode : Program Audio : No Data Dump : (Binary data 24584 bytes, use -b option to extract) Flash Bias : 0 Internal Serial Number : (XGL) 2023:01:02 no. 0104 Panasonic Exif Version : 0414 Color Effect : Off Time Since Power On : 00:01:31.83 Burst Mode : Off Sequence Number : 0 Contrast Mode : 2 Noise Reduction : Standard Self Timer : Off (0) Rotation : Horizontal (normal) AF Assist Lamp : Enabled but Not Used Optical Zoom Mode : Standard Conversion Lens : Off Travel Day : n/a Battery Level : Full World Time Location : Destination Advanced Scene Type : 1 Faces Detected : 0 JPEG Quality : High Color Temp Kelvin : 6200 Bracket Settings : No Bracket WB Shift AB : 0 WB Shift GM : 0 Flash Curtain : n/a Long Exposure Noise Reduction : On Panasonic Image Width : 0 Panasonic Image Height : 0 AF Point Position : 0.62 0.5 Num Face Positions : 0 Lens Type : N/A Lens Serial Number : N/A Accessory Type : NO-ACCESSORY Accessory Serial Number : 0000000 Lens Firmware Version : 0.21.21.0 Faces Recognized : 0 Title : Baby Name : Location : Country : State : City : Landmark : Intelligent Resolution : Standard HDR Shot : Off Burst Speed : 0 Intelligent D-Range : Off Clear Retouch : Off City 2 : Photo Style : Vivid WB Shift Intelligent Auto : 0 Accelerometer Z : 282 Accelerometer X : 5 Accelerometer Y : 10 Camera Orientation : Normal Roll Angle : 1 Pitch Angle : -2.1 WB Shift Creative Control : 0 Sweep Panorama Direction : Off Sweep Panorama Field Of View : 0 Timer Recording : Off Internal ND Filter : 0 HDR : Off Shutter Type : Mechanical Filter Effect : Off Clear Retouch Value : undef Touch AE : Off Monochrome Filter Effect : Off Highlight Shadow : 0 0 Time Stamp : 2023:11:06 09:15:35 Video Burst Resolution : Off or 4K Multi Exposure : Off Red Eye Removal : Off Video Burst Mode : Off Diffraction Correction : Off Focus Bracket : 0 Long Exposure NR Used : Yes Post Focus Merging : Post Focus Auto Merging or None Video Preburst : No Lens Type Make : 0 Sensor Type : Multi-aspect Monochrome Grain Effect : Off Time Lapse Shot Number : 0 Maker Note Version : 0154 Scene Mode : Off Highlight Warning : No Dark Focus Environment : No WB Red Level : 2747 WB Green Level : 1024 WB Blue Level : 1830 Text Stamp : Off Baby Age : (not set) Sub Sec Time : 181 Sub Sec Time Original : 181 Sub Sec Time Digitized : 181 Flashpix Version : 0100 Color Space : sRGB Exif Image Width : 5472 Exif Image Height : 3080 Interoperability Index : R98 - DCF basic file (sRGB) Interoperability Version : 0100 Sensing Method : One-chip color area File Source : Digital Camera Scene Type : Directly photographed Custom Rendered : Normal Exposure Mode : Auto Digital Zoom Ratio : 0 Focal Length In 35mm Format : 84 mm Scene Capture Type : Standard Gain Control : Low gain up Contrast : Normal Saturation : Normal Sharpness : Normal GPS Version ID : 2.2.0.0 GPS Latitude Ref : North GPS Longitude Ref : East GPS Altitude Ref : Above Sea Level GPS Time Stamp : 00:15:35 GPS Map Datum : WGS-84 GPS Date Stamp : 2023:11:07 PrintIM Version : 0250 Compression : JPEG (old-style) Thumbnail Offset : 29880 Thumbnail Length : 0 XMP Toolkit : XMP Core 4.4.0-Exiv2 Rating : 0 Instance ID : uuid:d874e788-25f8-4d1d-947a-6e77822b5d6a Image Width : 5472 Image Height : 3080 Encoding Process : Baseline DCT, Huffman coding Bits Per Sample : 8 Color Components : 3 Y Cb Cr Sub Sampling : YCbCr4:2:2 (2 1) Aperture : 6.3 Blue Balance : 1.787109 Image Size : 5472x3080 Megapixels : 16.9 Red Balance : 2.682617 Scale Factor To 35 mm Equivalent: 2.8 Shutter Speed : 1/80 Create Date : 2023:11:06 16:15:35.181+07:00 Date/Time Original : 2023:11:06 16:15:35.181+07:00 Modify Date : 2023:11:06 16:15:35.181+07:00 GPS Altitude : 24.9 m Above Sea Level GPS Date/Time : 2023:11:07 00:15:35Z GPS Latitude : 10 deg 46' 16.21" N GPS Longitude : 106 deg 41' 53.31" E Advanced Scene Mode : Off Circle Of Confusion : 0.011 mm Field Of View : 24.2 deg Focal Length : 29.5 mm (35 mm equivalent: 84.0 mm) GPS Position : 10 deg 46' 16.21" N, 106 deg 41' 53.31" E Hyperfocal Distance : 13.09 m Light Value : 11.0

marcmerlin commented 5 months ago

Pixel 8 Pro has the same Offset Time : +07:00 Offset Time Original : +07:00 Offset Time Digitized : +07:00

merlin [mc]$ exiftool 110_20231106_Saigon_Google.jpg ExifTool Version Number : 12.57 File Name : 110_20231106_Saigon_Google.jpg Directory : . File Size : 1691 kB File Modification Date/Time : 2024:01:23 02:47:20-08:00 File Access Date/Time : 2024:01:23 02:47:20-08:00 File Inode Change Date/Time : 2024:01:23 02:47:20-08:00 File Permissions : -rw-r--r-- File Type : JPEG File Type Extension : jpg MIME Type : image/jpeg Exif Byte Order : Little-endian (Intel, II) Make : Google Camera Model Name : Pixel 8 Pro Orientation : Horizontal (normal) X Resolution : 72 Y Resolution : 72 Resolution Unit : inches Software : HDR+ 1.0.575362751zd Modify Date : 2023:11:06 17:18:32 Y Cb Cr Positioning : Centered Exposure Time : 1/100 F Number : 1.9 Exposure Program : Program AE ISO : 363 Exif Version : 0232 Date/Time Original : 2023:11:06 17:18:32 Create Date : 2023:11:06 17:18:32 Offset Time : +07:00 Offset Time Original : +07:00 Offset Time Digitized : +07:00 Components Configuration : Y, Cb, Cr, - Shutter Speed Value : 1/100 Aperture Value : 2.0 Brightness Value : 1.71 Exposure Compensation : 0 Max Aperture Value : 2.0 Subject Distance : 4.871 m Metering Mode : Center-weighted average Flash : Off, Did not fire Focal Length : 2.2 mm Sub Sec Time : 115 Sub Sec Time Original : 115 Sub Sec Time Digitized : 115 Flashpix Version : 0100 Color Space : sRGB Exif Image Width : 4080 Exif Image Height : 3072 Interoperability Index : R98 - DCF basic file (sRGB) Interoperability Version : 0100 Sensing Method : One-chip color area Scene Type : Directly photographed Custom Rendered : Custom Exposure Mode : Auto White Balance : Auto Digital Zoom Ratio : 0 Focal Length In 35mm Format : 12 mm Scene Capture Type : Standard Contrast : Normal Saturation : Normal Sharpness : Normal Subject Distance Range : Distant Lens Make : Google Lens Model : Pixel 8 Pro back camera 2.23mm f/1.95 Composite Image : Composite Image Captured While Shooting GPS Version ID : 2.2.0.0 GPS Latitude Ref : North GPS Longitude Ref : East GPS Altitude Ref : Above Sea Level GPS Time Stamp : 10:18:28 GPS Img Direction Ref : Magnetic North GPS Img Direction : 31 GPS Date Stamp : 2023:11:06 Compression : JPEG (old-style) Thumbnail Offset : 1315 Thumbnail Length : 0 XMP Toolkit : Adobe XMP Core 5.1.0-jc003 Version : 1.0 Has Extended XMP : 93BF302D067E68D5D761860B7E0F4FCA Directory Item Semantic : Primary Directory Item Mime : image/jpeg Directory Item Length : 92436 Profile CMM Type : Profile Version : 4.0.0 Profile Class : Display Device Profile Color Space Data : RGB Profile Connection Space : XYZ Profile Date Time : 2023:03:09 10:57:00 Profile File Signature : acsp Primary Platform : Unknown () CMM Flags : Not Embedded, Independent Device Manufacturer : Google Device Model : Device Attributes : Reflective, Glossy, Positive, Color Rendering Intent : Perceptual Connection Space Illuminant : 0.9642 1 0.82491 Profile Creator : Google Profile ID : 61473528d5aaa311e143dfc93efaa268 Profile Description : sRGB IEC61966-2.1 Profile Copyright : Copyright (c) 2023 Google Inc. Media White Point : 0.9642 1 0.82491 Media Black Point : 0 0 0 Red Matrix Column : 0.43604 0.22249 0.01392 Green Matrix Column : 0.38512 0.7169 0.09706 Blue Matrix Column : 0.14305 0.06061 0.71391 Red Tone Reproduction Curve : (Binary data 32 bytes, use -b option to extract) Chromatic Adaptation : 1.04788 0.02292 -0.05019 0.02959 0.99048 -0.01704 -0.00922 0.01508 0.75168 Blue Tone Reproduction Curve : (Binary data 32 bytes, use -b option to extract) Green Tone Reproduction Curve : (Binary data 32 bytes, use -b option to extract) Image Width : 4080 Image Height : 3072 Encoding Process : Baseline DCT, Huffman coding Bits Per Sample : 8 Color Components : 3 Y Cb Cr Sub Sampling : YCbCr4:2:0 (2 2) Aperture : 1.9 Image Size : 4080x3072 Megapixels : 12.5 Scale Factor To 35 mm Equivalent: 5.4 Shutter Speed : 1/100 Create Date : 2023:11:06 17:18:32.115+07:00 Date/Time Original : 2023:11:06 17:18:32.115+07:00 Modify Date : 2023:11:06 17:18:32.115+07:00 GPS Altitude : 16.2 m Above Sea Level GPS Date/Time : 2023:11:06 10:18:28Z GPS Latitude : 10 deg 48' 58.93" N GPS Longitude : 106 deg 39' 47.39" E Circle Of Confusion : 0.006 mm Depth Of Field : inf (0.42 m - inf) Field Of View : 112.6 deg Focal Length : 2.2 mm (35 mm equivalent: 12.0 mm) GPS Position : 10 deg 48' 58.93" N, 106 deg 39' 47.39" E Hyperfocal Distance : 0.46 m Light Value : 6.7 Lens ID : Pixel 8 Pro back camera 2.23mm f/1.95

marcmerlin commented 5 months ago

Sony RX100M7 same thing too Offset Time : +07:00 Offset Time Original : +07:00 Offset Time Digitized : +07:00

merlin [mc]$ exiftool 115_20231106_Saigon_SONY.jpg ExifTool Version Number : 12.57 File Name : 115_20231106_Saigon_SONY.jpg Directory : . File Size : 1917 kB File Modification Date/Time : 2023:11:08 04:10:43-08:00 File Access Date/Time : 2023:11:08 04:10:43-08:00 File Inode Change Date/Time : 2024:01:23 02:47:14-08:00 File Permissions : -rw-r--r-- File Type : JPEG File Type Extension : jpg MIME Type : image/jpeg Exif Byte Order : Little-endian (Intel, II) Image Description : Make : SONY Camera Model Name : DSC-RX100M7 Orientation : Horizontal (normal) X Resolution : 350 Y Resolution : 350 Resolution Unit : inches Software : DSC-RX100M7 v1.00 Modify Date : 2023:11:06 19:13:00 Y Cb Cr Positioning : Co-sited Exposure Time : 1/40 F Number : 2.8 ISO : 100 Sensitivity Type : Recommended Exposure Index Recommended Exposure Index : 100 Exif Version : 0231 Date/Time Original : 2023:11:06 19:13:00 Create Date : 2023:11:06 19:13:00 Offset Time : +07:00 Offset Time Original : +07:00 Offset Time Digitized : +07:00 Components Configuration : Y, Cb, Cr, - Compressed Bits Per Pixel : 2 Brightness Value : 4.025 Exposure Compensation : -0.7 Max Aperture Value : 2.8 Metering Mode : Multi-segment Light Source : Unknown Flash : Off, Did not fire Focal Length : 9.0 mm Brightness : 0 Long Exposure Noise Reduction : On (unused) High ISO Noise Reduction : Normal HDR : Off; Uncorrected image WB Shift AB GM : 0 0 WB Shift AB GM Precise : 0.00 0.00 Face Info Offset : 94 Sony Date Time : 2023:11:06 19:13:00 Sony Image Width : 4864 Faces Detected : 0 Face Info Length : 37 Meta Version : DC7303320222000 Creative Style : Standard Color Temperature : Auto Color Compensation Filter : 0 Scene Mode : Standard Zone Matching : ISO Setting Used Dynamic Range Optimizer : Auto Image Stabilization : On Color Mode : Standard Full Image Size : 4864x3648 Preview Image Size : 1440x1080 File Format : ARW 2.3.5 Flash Exposure Compensation : 0 White Balance Fine Tune : 0 White Balance : Auto Sony Model ID : DSC-RX100M7 Multi Frame Noise Reduction : Off Picture Effect : Off Soft Skin Effect : Off Vignetting Correction : n/a Lateral Chromatic Aberration : n/a Distortion Correction Setting : n/a Lens Spec : 24-200mm F2.8-4.5 Auto Portrait Framed : No Flash Action : Did not fire Electronic Front Curtain Shutter: Off Focus Mode : AF-A AF Area Mode Setting : Wide Flexible Spot Position : 0 0 AF Tracking : Off Focal Plane AF Points Used : 2 Focal Plane AF Point Area : 640 480 Focal Plane AF Point Location 1 : 156 242 Focal Plane AF Point Location 2 : 156 216 Multi Frame NR Effect : Normal Focus Location : 4864 3648 1185 1839 Variable Low Pass Filter : n/a Priority Set In AWB : Standard Metering Mode 2 : Multi-segment Exposure Standard Adjustment : 0 RAW File Type : Compressed RAW Quality : Fine Flash Level : Normal Release Mode : Normal Sequence Number : Single Anti-Blur : On (Continuous) High ISO Noise Reduction 2 : Normal Release Mode 2 : Normal Sequence Image Number : 1 Sequence File Number : 1 Sequence Length : 1 file Camera Orientation : Horizontal (normal) Quality 2 : JPEG Sony Image Height : 3648 Model Release Year : 2018 ISO Setting : Auto ISO Auto Min : 100 ISO Auto Max : 6400 Ambient Temperature : 30 C AF Area Mode : Multi Camera Temperature : 32 C Exposure Program : Program AE Intelligent Auto : Off Sony ISO : 100 Base ISO : 100 Stops Above Base ISO : 0 Sony Exposure Time 2 : 1/38 Sony Max Aperture Value : 3.0 Sony Image Width Max : 5496 Sony Image Height Max : 3672 Picture Effect 2 : Off Distortion Correction : Applied Lens Zoom Position : 0% Release Mode 3 : Normal Self Timer : Off Flash Mode : Fill-flash HDR Setting : Off Picture Profile : Gamma Still - Standard/Neutral (PP2) WB RGB Levels : 487 256 469 Min Focal Length : 9.0 mm Max Focal Length : 72.0 mm User Comment : Flashpix Version : 0100 Color Space : sRGB Exif Image Width : 4864 Exif Image Height : 3648 Interoperability Index : R98 - DCF basic file (sRGB) Interoperability Version : 0100 File Source : Digital Camera Scene Type : Directly photographed Custom Rendered : Normal Exposure Mode : Auto Digital Zoom Ratio : 1 Focal Length In 35mm Format : 24 mm Scene Capture Type : Standard Contrast : Normal Saturation : Normal Sharpness : Normal Lens Info : 9-72mm f/2.8-4.5 GPS Version ID : 2.3.0.0 GPS Latitude Ref : North GPS Longitude Ref : East GPS Time Stamp : 12:13:01 GPS Status : Measurement Active GPS Measure Mode : 2-Dimensional Measurement GPS Map Datum : WGS-84 GPS Date Stamp : 2023:11:06 GPS Differential : No Correction PrintIM Version : 0300 Compression : JPEG (old-style) Thumbnail Offset : 35074 Thumbnail Length : 0 Rating : 0 Image Width : 4864 Image Height : 3648 Encoding Process : Baseline DCT, Huffman coding Bits Per Sample : 8 Color Components : 3 Y Cb Cr Sub Sampling : YCbCr4:2:2 (2 1) Aperture : 2.8 Blue Balance : 1.832031 Image Size : 4864x3648 Megapixels : 17.7 Red Balance : 1.902344 Scale Factor To 35 mm Equivalent: 2.7 Shutter Speed : 1/40 Create Date : 2023:11:06 19:13:00+07:00 Date/Time Original : 2023:11:06 19:13:00+07:00 Modify Date : 2023:11:06 19:13:00+07:00 GPS Date/Time : 2023:11:06 12:13:01Z GPS Latitude : 10 deg 46' 2.70" N GPS Longitude : 106 deg 41' 38.27" E Circle Of Confusion : 0.011 mm Field Of View : 73.7 deg Focal Length : 9.0 mm (35 mm equivalent: 24.0 mm) GPS Position : 10 deg 46' 2.70" N, 106 deg 41' 38.27" E Hyperfocal Distance : 2.57 m Light Value : 8.3

marcmerlin commented 5 months ago

For now, I wrote this. It's not perfect since it will not support timezone changes within a direction, but otherwise it should work:

TZ=$(ls -1 *.jpg | head -1 | xargs exiftool | grep -i 'Offset Time *:' | sed "s/.*: //")

[[ $(echo $TZ | wc -c) != 7 ]] && echo "Failed TZ; $TZ" && exit
echo "Timezone offset from first picture: $TZ"
sleep 2

gpscorrelate -R -z$TZ -g .track.gpx -t -v *.jpg
dfandrich commented 5 months ago

The Offset Time tags were added to EXIF relatively recently (ver. 3.21 in 2016). I know the last time I looked for a standardized way of representing this, it didn't exist. It makes to add support, probably by default.

marcmerlin commented 3 months ago

any chance this can be added? my workaround is ok, except when I have mixed timezones in a directory, and then it falls over :)

dfandrich commented 3 months ago

It most definitely can be added, but I'm desperately trying to get the long-overdue release out (that's stalled on a French translation) so unless someone sends a PR it will happen after that.