search

JuliaImages / ExifViewer.jl

Metadata reader in Julia, wrapper over LibExif
https://juliaimages.org/ExifViewer.jl/dev/
MIT License
28 stars 1 forks source link

Most efficient way to read large number of file #12

Open VLucet opened 1 year ago

VLucet commented 1 year ago

Hi ! I have about 2.7 million images I'd like to efficiently read EXIF data from in Julia. ExifViewer seems much faster than ImageMagick for that task. Do you have any advice on how to complete this task most efficiently with ExifViewer?

ashwani-rathee commented 1 year ago

Hey @VLucet !!

I think the optimization for speed will come from by using keyword_arguments, so if you know which tags you specifically want to read and which IFD they are in, then we use

julia> read_tags(data; ifds =  specificidnum, read_all = false, tags= [ "EXIF....", "EXIF....."])
VLucet commented 1 year ago

Okay, thanks! I'll test that.

ashwani-rathee commented 1 year ago

I think we are likely to gain a exponential speed factor gain after use of SnoopPrecompile, so reopening it till then.

ashwani-rathee commented 1 year ago

With #19, experience for extracting exif will improve by alot, see the PR message to get more info. I'll go over the package again with JET.jl and other tools to find more spaces of improvements and get those fixed soon.