UGS-GIO / rockcore

UGS Core Research Center Inventory web application that compiles a large data set of rock core data and displays it on an interactive web map
https://geology.utah.gov/apps/rockcore/
0 stars 0 forks source link

Photo downloads #12

Open Vandenberg5 opened 4 years ago

Vandenberg5 commented 4 years ago

Now that i am at home using Wi-Fi, the size of the photos create significant download delays. This will be a problem for many users. We should think about reducing the resolution of the photos for faster download.

marthajensen commented 4 years ago

Do you want all the photos in the application reduced in resolution - similar to what I did with DM-15-1?

Vandenberg5 commented 4 years ago

possibly, i have tried to look at several photos and it does take a bit of time, not horrible, but slightly annoying. I worry that folks with worse bandwidth would not even be able to look at them at all. I am open to solutions to make the site as accessible as possible.

marshallrobinson commented 4 years ago

Just adding my experience: This issue has been reported to me by other peers I have shared the app with outside of UGS. They mentioned that the images were not showing up at all in the preview pane. I would also suggest resampling the photos to a size that finds a balance of detail vs file size.

marshallrobinson commented 4 years ago

I assume Peter would still keep the full-size photos saved in Google Drive (somewhere backed up and accessible to the E&M group) in case people need access to them.

Vandenberg5 commented 4 years ago

I found that sometimes the photos don't show up in the preview pane, but if i leave it open long enough, they eventually show up, not ideal. Who is the right person to reduce photo file size (and change orientation)? Martha? Peter? Cheryl?

Vandenberg5 commented 4 years ago

yes, we need to archive full size images somewhere.

marshallrobinson commented 4 years ago

That was my next question as well. My team doesn't have much non-grant-funded time available so if you have staff that can do this for all of the currently-available photos, then that would be a big help. Even if you have staff that can help out with this, we should get a rough time estimate to fix all of these photos in order to help weigh the priority of this issue.

Here's a rough outline of things that would need to happen: @marthajensen, and Cheryl/Peter would need to all work together to plan out a proof of concept to make sure we get the right size/quality photo and see if that improves the loading time. Once loading-time is improved, then bulk-resampling can be done to all the photos (making sure to not change the file structure).

Vandenberg5 commented 4 years ago

Can Martha work with Cheryl to get this done? I can send a note to Cheryl and Peter explaining the problem, etc.

marshallrobinson commented 4 years ago

Yes, @marthajensen can work with them (I sent a Github invite to Peter just now so he can follow along on this - and other - issue).

Go ahead and send a note to Cheryl and Peter (please cc me too), but let's keep all of the future correspondence about this specific issue within Github so conversations don't become disconnected. (I'll invite Cheryl too).

marthajensen commented 4 years ago

My recommendation would be to pick a well with lots of photos and resize all of the photos for that well to a few different resolutions. Once we do that, I can look into the load times for each set of photo resolutions and work with the group to pinpoint a best resolution/load time scenario. Here is an easy way to resize all photos at once in Windows Explorer https://www.online-tech-tips.com/windows-10/how-to-bulk-resize-photos-using-windows-10/

marthajensen commented 4 years ago

Sorry that one was for Outlook specifically - I mean this one https://www.easytechguides.com/resize-pictures.html

CherylGustin commented 4 years ago

Let me know what to do and I will help with whatever I can.

marthajensen commented 4 years ago

@Vandenberg5 do you have a well you want to do this test on?

@CherylGustin If @Vandenberg5 doesn't have a preference, how about we test this on well 43-007-10049-T000 #54. The photos are located on the Server at ""\......\core_photos\UDP9\4300710049T000_Amoco_54"" However, @CherylGustin isn't able to access the Server folder, so I set up a testing folder on Google Shared Drive at :\Shared drives\UGS_Shared\Web Services\Projects\Rock Core. I put the Amoco #54 well photos at that location, but if you want to test another well @Vandenberg5 let me know and I'll move those photos over.

This well has 74 photos making it a good candidate because this is a mid amount of photos - the photos at wells range from 8 to over 200. For these photos, I am getting a load time of 4.1 minutes at an internet speed of 260 Mbps. Some of the photos are erroring as well (showing a grey or orange box instead of the photo). image Maybe that's something that we could fix at the same time?

I would suggest we convert these photos to medium resolution and medium-low resolution photos and see what kind of load times and picture clarity we get for the different options.

Vandenberg5 commented 4 years ago

sounds good to me

CherylGustin commented 4 years ago

I have done the first folder. You will see both a 200dpi folder as well as a 11 inches folder. Obviously I reduced the images in 200 DPI folder to 200 dpi resolution. In the 11 inches folder I simply changed the photos to 11 inches tall and reduced the .jpg file to an 11 image quality save option.

Vandenberg5 commented 4 years ago

don't forget to archive the full size versions

CherylGustin commented 4 years ago

I didn't replace any original files. Some are damaged as Martha said.

Vandenberg5 commented 4 years ago

ugh

marthajensen commented 4 years ago

@Vandenberg5 Have a look at the app.. the photos for #54 are currently set at 200 dpi (file size is about 1/3 of the original) and are loading in 1.1 minutes for me. See what you think of the resolution. @CherylGustin also made a set of photos that are about 1/2 the size of the originals - we can test those next.

Vandenberg5 commented 4 years ago

They loaded in about 30-40 seconds, they are still fairly high resolution (I can zoom way in, you could make them a bit smaller yet), but there was a glitch in the middle section where photos weren't showing up:

image

CherylGustin commented 4 years ago

Those are the ones I was getting a damaged file error with.

Vandenberg5 commented 4 years ago

How do you fix it?

On Wed, Aug 19, 2020 at 8:32 AM CherylGustin notifications@github.com wrote:

Those are the ones I was getting a damaged file error with.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/UGS-GIO/rockcore/issues/12#issuecomment-676454651, or unsubscribe https://github.com/notifications/unsubscribe-auth/AQUWTZIUW2LUMBQGJK7BW3TSBPO77ANCNFSM4QCKBTVQ .

-- Michael D. Vanden Berg, P.G. Energy and Minerals Program Manager, Senior Geologist Utah Geological Survey 1594 W. North Temple, Suite 3110, Salt Lake City, UT 84116 801-538-5419 (o); 801-416-6577 (m) michaelvandenberg@utah.gov

CherylGustin commented 4 years ago

May have to retake those photos. Martha said the originals that Peter loaded looked like that as well.

Vandenberg5 commented 4 years ago

ask Peter if he has an archive of these photos

m

On Wed, Aug 19, 2020 at 8:37 AM CherylGustin notifications@github.com wrote:

May have to retake those photos. Martha said the originals that Peter loaded looked like that as well.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/UGS-GIO/rockcore/issues/12#issuecomment-676462060, or unsubscribe https://github.com/notifications/unsubscribe-auth/AQUWTZPTHG6YSA7WCRPJLFLSBPPSFANCNFSM4QCKBTVQ .

-- Michael D. Vanden Berg, P.G. Energy and Minerals Program Manager, Senior Geologist Utah Geological Survey 1594 W. North Temple, Suite 3110, Salt Lake City, UT 84116 801-538-5419 (o); 801-416-6577 (m) michaelvandenberg@utah.gov

marthajensen commented 4 years ago

Mike - Cheryl and I have uploaded a further reduced set of photos. Each photo is now ~1mb (last set were about ~1.5 mb). Do you mind opening an incognito window when you open the app this time? Icognito should give you an idea of what a first time visitor to the website might expect when looking at this well

Vandenberg5 commented 4 years ago

i didn't see much difference, maybe 5-10 seconds faster. the resolution is still good and you are able to zoom in enough to see detail.

On Wed, Aug 19, 2020 at 11:59 AM Martha Jensen notifications@github.com wrote:

Mike - Cheryl and I have uploaded a further reduced set of photos. Each photo is now ~1mb (last set were about ~1.5 mb). Do you mind opening an incognito window when you open the app this time? Icognito should give you an idea of what a first time visitor to the website might expect when looking at this well

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/UGS-GIO/rockcore/issues/12#issuecomment-676574717, or unsubscribe https://github.com/notifications/unsubscribe-auth/AQUWTZPWQUMBZX45HURMQR3SBQHHFANCNFSM4QCKBTVQ .

-- Michael D. Vanden Berg, P.G. Energy and Minerals Program Manager, Senior Geologist Utah Geological Survey 1594 W. North Temple, Suite 3110, Salt Lake City, UT 84116 801-538-5419 (o); 801-416-6577 (m) michaelvandenberg@utah.gov

marthajensen commented 4 years ago

Hi Mike - Cheryl and I tried out one more group of photos - 150 dpi this time. I think they are clear and load fast. Let me know what you think. Each photo is about .5-.65 mb.

Vandenberg5 commented 4 years ago

Agree, I think they look good and they load in less than 5 sec

On Tue, Aug 25, 2020 at 6:56 AM Martha Jensen notifications@github.com wrote:

Hi Mike - Cheryl and I tried out one more group of photos - 150 dpi this time. I think they are clear and load fast. Let me know what you think. Each photo is about 500-650 mb.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/UGS-GIO/rockcore/issues/12#issuecomment-680007718, or unsubscribe https://github.com/notifications/unsubscribe-auth/AQUWTZNTQV6ECYKUANXYCPLSCOYI3ANCNFSM4QCKBTVQ .

-- Michael D. Vanden Berg, P.G. Energy and Minerals Program Manager, Senior Geologist Utah Geological Survey 1594 W. North Temple, Suite 3110, Salt Lake City, UT 84116 801-538-5419 (o); 801-416-6577 (m) michaelvandenberg@utah.gov

marthajensen commented 3 years ago

@Vandenberg5 --- @CherylGustin and @PNatCoreCenter have been cleaning up and resizing the application core photos (the original photos are archived on the Google Shared Drive). The following 3 wells are displaying photos that have been reduced in size:

43-007-10063-T000 43-007-10070-T000 43-013-30009-0000

Please have a look and let us know if the photos load fast and are high enough resolution for the app.

Vandenberg5 commented 3 years ago

The first two wells look good, the photos are good and they load fast

the third well (4301330009), the core is not from this well, it is labeled wrong. this is very obviously a Paradox Basin core, but the location is in the Uinta Basin. the label on the core photos must be incorrect. this needs to be fixed.

Mike

On Wed, Oct 7, 2020 at 1:01 PM Martha Jensen notifications@github.com wrote:

@Vandenberg5 https://github.com/Vandenberg5 --- @CherylGustin https://github.com/CherylGustin and @PNatCoreCenter https://github.com/PNatCoreCenter have been cleaning up and resizing the application core photos (the original photos are archived on the Google Shared Drive). The following 3 wells are displaying photos that have been reduced in size:

43-007-10063-T000 43-007-10070-T000 43-013-30009-0000

Please have a look and let us know if the photos load fast and are high enough resolution for the app.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/UGS-GIO/rockcore/issues/12#issuecomment-705133285, or unsubscribe https://github.com/notifications/unsubscribe-auth/AQUWTZM6H25OWGCF3OAPIKDSJS3JZANCNFSM4QCKBTVQ .

-- Michael D. Vanden Berg, P.G. Energy and Minerals Program Manager, Senior Geologist Utah Geological Survey 1594 W. North Temple, Suite 3110, Salt Lake City, UT 84116 801-538-5419 (o); 801-416-6577 (m) michaelvandenberg@utah.gov

PNatCoreCenter commented 3 years ago

Is the photo resolution going to work?

Peter

On Wed, Oct 7, 2020 at 1:01 PM Martha Jensen notifications@github.com wrote:

@Vandenberg5 https://github.com/Vandenberg5 --- @CherylGustin https://github.com/CherylGustin and @PNatCoreCenter https://github.com/PNatCoreCenter have been cleaning up and resizing the application core photos (the original photos are archived on the Google Shared Drive). The following 3 wells are displaying photos that have been reduced in size:

43-007-10063-T000 43-007-10070-T000 43-013-30009-0000

Please have a look and let us know if the photos load fast and are high enough resolution for the app.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/UGS-GIO/rockcore/issues/12#issuecomment-705133285, or unsubscribe https://github.com/notifications/unsubscribe-auth/AQXGRS452TKQMQ3MMDK3ZQDSJS3J3ANCNFSM4QCKBTVQ .

-- Peter Nielsen P.G. Curator - Utah Core Research Center

Vandenberg5 commented 3 years ago

yes, it works

but please look at photos for 4301330009, they are not Uinta Basin

m

On Thu, Oct 15, 2020 at 5:07 PM PNatCoreCenter notifications@github.com wrote:

Is the photo resolution going to work?

Peter

On Wed, Oct 7, 2020 at 1:01 PM Martha Jensen notifications@github.com wrote:

@Vandenberg5 https://github.com/Vandenberg5 --- @CherylGustin https://github.com/CherylGustin and @PNatCoreCenter https://github.com/PNatCoreCenter have been cleaning up and resizing the application core photos (the original photos are archived on the Google Shared Drive). The following 3 wells are displaying photos that have been reduced in size:

43-007-10063-T000 43-007-10070-T000 43-013-30009-0000

Please have a look and let us know if the photos load fast and are high enough resolution for the app.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/UGS-GIO/rockcore/issues/12#issuecomment-705133285, or unsubscribe < https://github.com/notifications/unsubscribe-auth/AQXGRS452TKQMQ3MMDK3ZQDSJS3J3ANCNFSM4QCKBTVQ

.

-- Peter Nielsen P.G. Curator - Utah Core Research Center

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/UGS-GIO/rockcore/issues/12#issuecomment-709635734, or unsubscribe https://github.com/notifications/unsubscribe-auth/AQUWTZJL5UYC5VWPNOAXO7DSK56DXANCNFSM4QCKBTVQ .

-- Michael D. Vanden Berg, P.G. Energy and Minerals Program Manager, Senior Geologist Utah Geological Survey 1594 W. North Temple, Suite 3110, Salt Lake City, UT 84116 801-538-5419 (o); 801-416-6577 (m) michaelvandenberg@utah.gov

PNatCoreCenter commented 3 years ago

I will look at the photographs. I have found a couple of other wells with wrong UWI numbers.

Peter

On Thu, Oct 15, 2020 at 5:07 PM Peter Nielsen peternielsen@utah.gov wrote:

Is the photo resolution going to work?

Peter

On Wed, Oct 7, 2020 at 1:01 PM Martha Jensen notifications@github.com wrote:

@Vandenberg5 https://github.com/Vandenberg5 --- @CherylGustin https://github.com/CherylGustin and @PNatCoreCenter https://github.com/PNatCoreCenter have been cleaning up and resizing the application core photos (the original photos are archived on the Google Shared Drive). The following 3 wells are displaying photos that have been reduced in size:

43-007-10063-T000 43-007-10070-T000 43-013-30009-0000

Please have a look and let us know if the photos load fast and are high enough resolution for the app.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/UGS-GIO/rockcore/issues/12#issuecomment-705133285, or unsubscribe https://github.com/notifications/unsubscribe-auth/AQXGRS452TKQMQ3MMDK3ZQDSJS3J3ANCNFSM4QCKBTVQ .

-- Peter Nielsen P.G. Curator - Utah Core Research Center

-- Peter Nielsen P.G. Curator - Utah Core Research Center