darktable-org / darktable

darktable is an open source photography workflow application and raw developer
https://www.darktable.org
GNU General Public License v3.0
9.77k stars 1.14k forks source link

HighRes RAWs of Panasonic Lumix S1R can not be edited #8338

Closed achimwessling closed 1 year ago

achimwessling commented 3 years ago

Describe the bug The Lumix S1R has a high resolution mode, which results in RAW-Files with 16776 x 11250 pixel. The previews of those files are shown in the light table. All exif attributes of the files are displayed correctly. If you try to open those files in the darkroom, you get an error about corrupted exif.

To Reproduce Try to open the attached / linked RAW in darkroom module.

Expected behavior It should be possible to also open those big RAWs from the high res mode.

Screenshots

grafik

$ exiv2 P1001413.RW2
Dateiname       : P1001413.RW2
Dateigröße      : 346429440 Bytes
MIME-Typ        : image/x-panasonic-rw2
Bildgröße       : 16776 x 11250
Kamerahersteller: Panasonic
Kameramodell    : DC-S1R
Zeitstempel des Bildes: 2020:09:15 16:00:41
Bildnummer      :
Belichtungszeit : 1/200 s
Blende          : F16
Belichtungskontrolle: -33/50 EV
Blitz           : Blitz nicht ausgelöst, festgelegter Modus
Blitzkontrolle  : 0
Brennweite      : 16.0 mm (35 mm äquivalent: 16.0 mm)
Entfernung des Motivs:
ISO Geschwindigkeit: 100
Belichtungsmodus: Blendenpriorität
Messmodus       : Mehr-Segment
Makromodus      : Aus
Bildqualität    : Roh
Exif-Auflösung  :
Weißabgleich    : Automatisch
Vorschau        : image/jpeg, 4712 Bytes
Copyright       :
Exif-Kommentar  :
16:44:12 600 achim@ZenBook:~/Bilder/RAW$ 

Platform (please complete the following information):

$ darktable --version
this is darktable 3.4.1
copyright (c) 2009-2021 johannes hanika
darktable-dev@lists.darktable.org

compile options:
  bit depth is 64 bit
  normal build
  SSE2 optimized codepath enabled
  OpenMP support enabled
  OpenCL support enabled
  Lua support enabled, API version 6.1.0
  Colord support enabled
  gPhoto2 support enabled
  GraphicsMagick support enabled
  ImageMagick support disabled
  OpenEXR support enabled
16:51:21 602 achim@ZenBook:~/Bilder/RAW$ 
$ cat /proc/version 
Linux version 5.10.17-towo.1-siduction-amd64 (towo@siduction.org) (gcc-10 (Debian 10.2.1-6) 10.2.1 20210110, GNU ld (GNU Binutils for Debian) 2.35.1) #1 SMP PREEMPT siduction 5.10-17 (2021-02-18)
16:54:51 606 achim@ZenBook:~/Bilder/RAW$

Additional context

johnny-bit commented 3 years ago

Please check if such raw files are uploaded to raw.pixls.us where raw file samples are gathered.

achimwessling commented 3 years ago

raw.pixls.us

Just did so.

github-actions[bot] commented 3 years ago

This issue did not get any activity in the past 30 days and will be closed in 365 days if no update occurs. Please check if the master branch has fixed it and report again or close the issue.

NFecDe commented 2 years ago

Is there any chance that someone can have a look on this? I edited in the past RW2 high-Res mode files of my S1R after converting them to DNG.

Since DT is supporting RW2 of the Panasonic S cameras I stopped converting the files to DNG. I hope that the issue with RW2 high-res files is minor, because in common RW2 support works very good (my opinion). In case I shall provide new example files on raw.pixls.us or support some how different, please let me know.

I am using Darktable 3.6 on Linux.

TurboGit commented 2 years ago

Is there any chance that someone can have a look on this?

This someone is you. We need raw samples for all mode to be upload in raw.pixls.us. If it is already done then you just have to wait.

kmilos commented 2 years ago

The highres RW2 files seem to use a different/new codec, see https://github.com/darktable-org/rawspeed/issues/246

However, the sample from S1R is indeed still missing.

NFecDe commented 2 years ago

Thank for you quick replies! Today I took with my S1R two HighRes shots which I am currently uploading to raw.pixls.us. The camera offers a mode 1 & 2 HighRes option (with & without movement compensation). Therefore two HighRes pictures + the same picture NON-HighRes.

For NON-HighRes the RW2 support for the S1R is working. But I remember back in early 2020 the RW2 of the S1R cameras was not working. The older Micro Four Third cameras like GH5 and G9 save RAW as RW2 as well, but this RW2 is not the same like the S-Cameras of Panasonic are using.

I cross fingers that at least withing the S-Camera range of Panasonic the RW2 format is the same.

I saw at raw.pixls.us that there are request for pictures from the S1R in different aspect ratios. I will take such pictures and upload them as well.

Also I am thinking about writing to Panasonic (JP) if they see any chance to offer access to the official file specification. I assume they give Adobe, PhaseOne an many others these information, so why not also to open source projects too.

NFecDe commented 2 years ago

The highres RW2 files seem to use a different/new codec, see darktable-org/rawspeed#246

However, the sample from S1R is indeed still missing.

Exact same issue with the S1R and S5 (+ likely the S1 too).

Error messages I am getting are the same, example: [rawspeed] (P1011786.RW2) virtual rawspeed::RawImage rawspeed::Rw2Decoder::decodeRawInternal(), line 151: Version 7 is unsupported [dt_imageio_export_with_flags] mipmap allocation for 'unused' failed

johnny-bit commented 2 years ago

You've got to send those files to raw.pixls.us so rawspeed library has workable samples.

pt., 31 gru 2021 o 15:59 NFecDe @.***> napisał(a):

The highres RW2 files seem to use a different/new codec, see darktable-org/rawspeed#246 https://github.com/darktable-org/rawspeed/issues/246

However, the sample from S1R is indeed still missing.

Exact same issue with the S1R and S5 (+ likely the S1 too).

Error messages I am getting are the same, example: [rawspeed] (P1011786.RW2) virtual rawspeed::RawImage rawspeed::Rw2Decoder::decodeRawInternal(), line 151: Version 7 is unsupported [dt_imageio_export_with_flags] mipmap allocation for 'unused' failed

— Reply to this email directly, view it on GitHub https://github.com/darktable-org/darktable/issues/8338#issuecomment-1003395218, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACRRKFIVDDQOLG7E6LUZRO3UTXAO3ANCNFSM4YIWYA7A . You are receiving this because you commented.Message ID: @.***>

-- Pozdrawiam, Hubert Kowalski

NFecDe commented 2 years ago

I uploaded the requested RAW files to raw.pixls.us on the 31st of December 2021. But so far the files are not listed in the repo. I assume that there is some kind of approval process: image

In case there is no approval process, would be great to know because then I would do the upload again.

You've got to send those files to raw.pixls.us so rawspeed library has workable samples. pt., 31 gru 2021 o 15:59 NFecDe @.> napisał(a): The highres RW2 files seem to use a different/new codec, see darktable-org/rawspeed#246 <darktable-org/rawspeed#246> However, the sample from S1R is indeed still missing. Exact same issue with the S1R and S5 (+ likely the S1 too). Error messages I am getting are the same, example: [rawspeed] (P1011786.RW2) virtual rawspeed::RawImage rawspeed::Rw2Decoder::decodeRawInternal(), line 151: Version 7 is unsupported [dt_imageio_export_with_flags] mipmap allocation for 'unused' failed — Reply to this email directly, view it on GitHub <#8338 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACRRKFIVDDQOLG7E6LUZRO3UTXAO3ANCNFSM4YIWYA7A . You are receiving this because you commented.Message ID: @.> -- Pozdrawiam, Hubert Kowalski

johnny-bit commented 2 years ago

Yes, there's an approval process going on.

pon., 3 sty 2022 o 08:46 NFecDe @.***> napisał(a):

I uploaded the requested RAW files to raw.pixls.us on the 31st of December 2021. But so far the files are not listed in the repo. I assume that there is some kind of approval process: [image: image] https://user-images.githubusercontent.com/61116955/147908596-6ed83952-320b-4ea9-a7fe-0bcd56dd7043.png

In case there is no approval process, would be great to know because then I would do the upload again.

You've got to send those files to raw.pixls.us so rawspeed library has workable samples. pt., 31 gru 2021 o 15:59 NFecDe @.

> napisał(a): … <#m-8445625425920414565> The highres RW2 files seem to use a different/new codec, see darktable-org/rawspeed#246 https://github.com/darktable-org/rawspeed/issues/246 <darktable-org/rawspeed#246 https://github.com/darktable-org/rawspeed/issues/246> However, the sample from S1R is indeed still missing. Exact same issue with the S1R and S5 (+ likely the S1 too). Error messages I am getting are the same, example: [rawspeed] (P1011786.RW2) virtual rawspeed::RawImage rawspeed::Rw2Decoder::decodeRawInternal(), line 151: Version 7 is unsupported [dt_imageio_export_with_flags] mipmap allocation for 'unused' failed — Reply to this email directly, view it on GitHub <#8338 (comment) https://github.com/darktable-org/darktable/issues/8338#issuecomment-1003395218>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACRRKFIVDDQOLG7E6LUZRO3UTXAO3ANCNFSM4YIWYA7A https://github.com/notifications/unsubscribe-auth/ACRRKFIVDDQOLG7E6LUZRO3UTXAO3ANCNFSM4YIWYA7A . You are receiving this because you commented.Message ID: @.> -- Pozdrawiam, Hubert Kowalski

— Reply to this email directly, view it on GitHub https://github.com/darktable-org/darktable/issues/8338#issuecomment-1003916686, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACRRKFP7DMWY3LI6DPO2JQ3UUFH6TANCNFSM4YIWYA7A . You are receiving this because you commented.Message ID: @.***>

-- Pozdrawiam, Hubert Kowalski

glasscake commented 2 years ago

Is there any update on this? These high res images still do not work natively. If there is anything I can do to help feel free to request.

NFecDe commented 2 years ago

Is there any update on this? These high res images still do not work natively. If there is anything I can do to help feel free to request.

Would be great to have it supported. I tried to upload files several times ( see above) but they never show up in the repo. So I have up and I live with converting them to DNG first (Adobe DNG Converter works well).

LebedevRI commented 1 year ago

This is now supported in master (928115e76f6d9864762dd606696e414d27c22524), but for some reason there are still no relevant samples from that camera on RPU. Please, feel free to contribute the full set (normal shot + high-res one) of the same scenery (see description on RPU).

NFecDe commented 1 year ago

I really tried to supply samples via the portal, but I was not successful. I am not sure why my files after uploading to raw.pixls.us[https://raw.pixls.us] are not showing up in the end. In case I can upload/submit them an alternative way, I will do it immediately. I live with the workaround converting all HigRes files to DNG using Adobe DNG converted running with Wine.

But with the new Panasonic S5ii, which has the potential to get very popular, native support maybe really handy for a lot of people.


06.02.2023 00:37:45 Roman Lebedev @.***>:

This is now supported in master (928115e[https://github.com/darktable-org/darktable/commit/928115e76f6d9864762dd606696e414d27c22524]), but for some reason there are still no relevant samples from that camera on RPU. Please, feel free to contribute the full set (normal shot + high-res one) of the same scenery (see description on RPU).

— Reply to this email directly, view it on GitHub[https://github.com/darktable-org/darktable/issues/8338#issuecomment-1418297917], or unsubscribe[https://github.com/notifications/unsubscribe-auth/AOSJEG2UIRYB7KWPCWYUTRLWWA2UHANCNFSM4YIWYA7A]. You are receiving this because you commented.[Verfolgungsbild][https://github.com/notifications/beacon/AOSJEGZ7JWROLSO6H3NW7EDWWA2UHA5CNFSM4YIWYA7KYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOKSEYEPI.gif]

fishrdev commented 1 year ago

I just contributed a full set of high-res pictures of the same scenery to RPU. Hopefully they get approved and we can resolve this.

achimwessling commented 1 year ago

I never understand why mine have not been accepted. Hopefully yours get through.

NFecDe commented 1 year ago

Crossing fingers for you too. I had the same issues with posting my pictures like Achim.Am 19.07.2023 um 17:17 schrieb Achim Weßling @.***>: I never understand why mine have not been accepted. Hopefully yours get through.

—Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you commented.Message ID: @.***>

kmilos commented 1 year ago

Is this working now since dt 4.4, can it be closed?

There are still no high-res samples for the S1R on RPU though, only S5...