UGS-GIO / geohaz

UGS Geologic Hazards Portal web application that compiles a large data set of geologic hazards data and displays it on an interactive web map
https://geology.utah.gov/apps/hazards
2 stars 0 forks source link

Add Southern UT Fault Mapping data to hazards portal #75

Closed AHiscock closed 2 years ago

AHiscock commented 2 years ago

Myself and Tyler K. have finished up our new southern UT fault mapping. Here is a list of the faultnums that need to be copied into the Hazards Portal within our study area boundary (located here - M:\Shared drives\UGS_Shared\Hazards\Fault Mapping\SUFM_Project Extent\SUFM_ProjectExtent.shp)

Data is on UGHP SDE in this feature class: UGHP.UGHPADMIN.QFault_SUFM FaultNums: 997a 997b 998a 998b 998c 1004b 2520 2522 2524 2527 2528 2529 2532 2533 2534 2535 2536 2537 2550 2558

I don't have the special-study zones associated with these faults quite ready yet (they are being reviewed by Steve, hopefully he'll have them done today or tomorrow, and then I can provide that data as well).

This is my first time startting a GitHub issue, so I hope I provided everything you need! Let me know if I missed anything. I will be on A/L starting this Wednesday (9/29) through 10/11, with some limited email access/checking going on.

marthajensen commented 2 years ago

@AHiscock

Just a few questions --

Has the SUFM data already been through the Hazards review process (including topology)? Is there a report reference for the data that needs to be included in the Hazards portal?

I doubt I'll get to this before you leave. Would Emily be the best person to ask questions to as they arise? Will she be the person who reviews the data before publishing it to the web?

AHiscock commented 2 years ago

@marthajensen

Yes, it has been through the Hazards review process. I ran topology on it last week, since we no longer have a Gordon. I haven't run topology in a long time, but I'm 99% sure I did it right. I set up a report reference link in GeoData, like we did for our last fault mapping project. Just a note - the link is set to private currently, and won't be "live" with the final report until we get it completed and through review. We've told the USGS we would have the FTR report submitted to them by the end of October. Here's the reference report link - https://geodata.geology.utah.gov/pages/view.php?ref=65953

No worries about getting to this before I leave. I just spoke with Emily, and she's ok with being the person for questions and such while I am gone.

Thanks Martha.

AHiscock commented 2 years ago

@marthajensen

OK - I have finished the special study zones that go with this fault mapping. They are all in a shapefile located here M:\Shared drives\UGS_Shared\Hazards\Fault Mapping\SUFM_SpecialStudyZones\SUFM_SSZ_Master.shp

Everything should be ready to go from me. As I mentioned, @emkleb should be available for any questions that may come up while I am gone.

Thanks Martha and Emily!

marthajensen commented 2 years ago

@emkleb The data is ready for review. Please review the following pieces of data:

Hazards Portal:

Study Areas "G:\Shared drives\UGS_Hazards_Geotech\Geologic Hazards Online Data\Working and editing geodatabase\Geologic_Hazards_Geodatabase_Review_Version.gdb\Study_Areas

Quaternary Faults "G:\Shared drives\UGS_Hazards_Geotech\Geologic Hazards Online Data\Working and editing geodatabase\Geologic_Hazards_Geodatabase_Review_Version.gdb\Quaternary_Faults

Special Study Zone "G:\Shared drives\UGS_Hazards_Geotech\Geologic Hazards Online Data\Working and editing geodatabase\Geologic_Hazards_Geodatabase_Review_Version.gdb\Surface_Fault_Rupture_Hazard_Special_Study_Zone

Reporting tool data

"G:\Shared drives\UGS_Hazards_Geotech\Geologic Hazards Online Data\Final_Report_Tables\HazardUnitTextTable.csv"

"G:\Shared drives\UGS_Hazards_Geotech\Geologic Hazards Online Data\Final_Report_Tables\MappedHazardsTable.csv"

UGRC data:

This is the undissolved version of the feature class that we provide to the UGRC "G:\Shared drives\UGS_Hazards_Geotech\Geologic Hazards Online Data\Master_QfaultsData\Qfaults_AGRC.gdb\Qfaults

Once you give me the go-ahead, I will move the data to the LIVE version of our geodatabase.

emkleb commented 2 years ago

@marthajensen, here is my review. Please address a couple items listed below.

I apologize for my slightly delayed review. I didn't see the Github email, and I only checked on it today.

Hazards Portal: Study Areas "G:\Shared drives\UGS_Hazards_Geotech\Geologic Hazards Online Data\Working and editing geodatabase\Geologic_Hazards_Geodatabase_Review_Version.gdb\Study_Areas

"G:\Shared drives\UGS_Hazards_Geotech\Geologic Hazards Online Data\Working and editing geodatabase\Geologic_Hazards_Geodatabase_Review_Version.gdb\Quaternary_Faults

Special Study Zone "G:\Shared drives\UGS_Hazards_Geotech\Geologic Hazards Online Data\Working and editing geodatabase\Geologic_Hazards_Geodatabase_Review_Version.gdb\Surface_Fault_Rupture_Hazard_Special_Study_Zone

This is the undissolved version of the feature class that we provide to the UGRC "G:\Shared drives\UGS_Hazards_Geotech\Geologic Hazards Online Data\Master_QfaultsData\Qfaults_AGRC.gdb\Qfaults

AHiscock commented 2 years ago

@marthajensen @emkleb Looks like you guys have made good progress on all of this while I was gone. Thanks so much! Let me know if I need to do anything.

AHiscock commented 2 years ago

@marthajensen and @emkleb

While reviewing and cleaning up the new SSZ's for our new data, I decided to take a quick look at the Quaternary_Faults feature class here: "G:\Shared drives\UGS_Hazards_Geotech\Geologic Hazards Online Data\Working and editing geodatabase\Geologic_Hazards_Geodatabase_Review_Version.gdb\Quaternary_Faults I found a few issues, hopefully it's not that big of a deal:

I'm available all day tomorrow if you'd like to have a little meeting so I can explain this better. If @emkleb is available, maybe we should include her as well. Let me know. I'm also not so sure how this works on GitHub, hopefully you both get an email to let you know I posted all this in GitHub.

marthajensen commented 2 years ago

@AHiscock

ok - When you get the SUFM study area fixed, let me know.

I think I understand what needs to be done. In the qfaults master feature class, I need to select and erase all the faults with the faultnum's listed in this issue, but only within the new SUFM study area. I then need to copy in your new faults.

If you want to meet and discuss this in more detail, I am available

AHiscock commented 2 years ago

@marthajensen

Done making changes. Here's a summary of what I've done:

Study Areas "G:\Shared drives\UGS_Hazards_Geotech\Geologic Hazards Online Data\Working and editing geodatabase\Geologic_Hazards_Geodatabase_Review_Version.gdb\Study_Areas

Special Study Zone "G:\Shared drives\UGS_Hazards_Geotech\Geologic Hazards Online Data\Working and editing geodatabase\Geologic_Hazards_Geodatabase_Review_Version.gdb\Surface_Fault_Rupture_Hazard_Special_Study_Zone

I think thats it! Let me know when you are done and ready for me to review again. Thanks!

marthajensen commented 2 years ago

@AHiscock

I've rewrote parts of the workflow script and ran it again to encompass the study area issue that we ran into.

Please check the following datasets:

Hazards Portal

Study Areas

"G:\Shared drives\UGS_Hazards_Geotech\Geologic Hazards Online Data\Working and editing geodatabase\Geologic_Hazards_Geodatabase_Review_Version.gdb\Study_Areas

Quaternary Faults

"G:\Shared drives\UGS_Hazards_Geotech\Geologic Hazards Online Data\Working and editing geodatabase\Geologic_Hazards_Geodatabase_Review_Version.gdb\Quaternary_Faults

Reporting tool data

"G:\Shared drives\UGS_Hazards_Geotech\Geologic Hazards Online Data\Final_Report_Tables\HazardUnitTextTable.csv"

"G:\Shared drives\UGS_Hazards_Geotech\Geologic Hazards Online Data\Final_Report_Tables\MappedHazardsTable.csv"

Quaternary Faults for UGRC

"G:\Shared drives\UGS_Hazards_Geotech\Geologic Hazards Online Data\Master_QfaultsData\Qfaults_AGRC.gdb"

AHiscock commented 2 years ago

@marthajensen

Everything looks good to me. All the faults that were previously missing are now there, so it seems like your new script worked perfectly.

For the "Summary" field issue, I noticed that as well, but I am not familiar what that field is even used for or where the information in it comes from? I also noticed that the new data doesn't have anything in the "USGS_Link" field. Our Bear Lake/Oquirrh data we pushed to the portal earlier this year has a link in the "USGS_Link" field but nothing in the "Summary" field. How crucial is it that we have info in the "Summary" field? Maybe @emkleb can chime in with some insight, since I don't know how important these fields are.

emkleb commented 2 years ago

The Summary field is not necessary to push outside of UGS. It is a legacy field used by USGS, but it's not maintained by them anymore. It might not hurt to keep it, because it contains a lot of good geologic information in addition to the other attributes.

option 1- keep the field, and just have some parts of the same fault number have a summary, and some without (ex. 1004b). Might be a little sloppy, but it preserves the information. This information can also be found on the USGS archived report pages (example for 1004b https://earthquake.usgs.gov/cfusion/qfault/show_report_AB_archive.cfm?fault_id=1004&section_id=b ). option 2- remove the field completely from the UGRC delivery.

I'm in favor of option 2, since we do have the URL for the USGS webpage, where users will be able to find the summary information that is in the summary field.

On Thu, Oct 21, 2021 at 9:50 AM Adam Hiscock @.***> wrote:

@marthajensen https://github.com/marthajensen

Everything looks good to me. All the faults that were previously missing are now there, so it seems like your new script worked perfectly.

For the "Summary" field issue, I noticed that as well, but I am not familiar what that field is even used for or where the information in it comes from? I also noticed that the new data doesn't have anything in the "USGS_Link" field. Our Bear Lake/Oquirrh data we pushed to the portal earlier this year has a link in the "USGS_Link" field but nothing in the "Summary" field. How crucial is it that we have info in the "Summary" field? Maybe @emkleb https://github.com/emkleb can chime in with some insight, since I don't know how important these fields are.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/UGS-GIO/geohaz/issues/75#issuecomment-948746090, or unsubscribe https://github.com/notifications/unsubscribe-auth/AHC3P2TAFMQZ7EUUJ5CWE2TUIAZEXANCNFSM5E26DYWA . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

AHiscock commented 2 years ago

@emkleb - Thanks for the response. I think option 2 sounds good. One question - Our new data has nothing in the USGS_Link URL field, I'm guessing we need to get that added?

@marthajensen is out until Monday, so we can just resolve this then.

The Summary field is not necessary to push outside of UGS. It is a legacy field used by USGS, but it's not maintained by them anymore. It might not hurt to keep it, because it contains a lot of good geologic information in addition to the other attributes. option 1- keep the field, and just have some parts of the same fault number have a summary, and some without (ex. 1004b). Might be a little sloppy, but it preserves the information. This information can also be found on the USGS archived report pages (example for 1004b https://earthquake.usgs.gov/cfusion/qfault/show_report_AB_archive.cfm?fault_id=1004&section_id=b ). option 2- remove the field completely from the UGRC delivery. I'm in favor of option 2, since we do have the URL for the USGS webpage, where users will be able to find the summary information that is in the summary field. On Thu, Oct 21, 2021 at 9:50 AM Adam Hiscock @.***> wrote: @marthajensen https://github.com/marthajensen Everything looks good to me. All the faults that were previously missing are now there, so it seems like your new script worked perfectly. For the "Summary" field issue, I noticed that as well, but I am not familiar what that field is even used for or where the information in it comes from? I also noticed that the new data doesn't have anything in the "USGS_Link" field. Our Bear Lake/Oquirrh data we pushed to the portal earlier this year has a link in the "USGS_Link" field but nothing in the "Summary" field. How crucial is it that we have info in the "Summary" field? Maybe @emkleb https://github.com/emkleb can chime in with some insight, since I don't know how important these fields are. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#75 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AHC3P2TAFMQZ7EUUJ5CWE2TUIAZEXANCNFSM5E26DYWA . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

marthajensen commented 2 years ago

@AHiscock What URL should I add to the USGS link field?

I was looking through the data we currently have and the USGS links are all slightly different

Should the citation field also be filled out to say "Hiscock and Knudsen, 2021"?

AHiscock commented 2 years ago

@marthajensen The citation field should be "Knudsen and others, 2021"

As far as the USGS link field - shouldn't each faultnum have the USGS link for that fault num? Like for example, all fault nums 1004b should have this link: https://earthquake.usgs.gov/cfusion/qfault/show_report_AB.cfm?fault_id=1004&section_id=b And all faultnum 997 should have this link: https://earthquake.usgs.gov/cfusion/qfault/show_report_AB.cfm?fault_id=997&section_id=b This may be a question for @emkleb

I can compile a list of links for each of the faultnum's we updated in this project if that would help. Then you can just plug them into the USGS_Link field.

marthajensen commented 2 years ago

@AHiscock

Hi Adam,

If you can provide me the list of USGS_links when you have time that would be great! Thanks!

emkleb commented 2 years ago

Yes, the USGS link should have those URLs. I see that in the version in the review version doesn't have all of them compiled: M:\Shared drives\UGS_Hazards_Geotech\Geologic Hazards Online Data\Working and editing geodatabase\Geologic_Hazards_Geodatabase_Review_Version.gdb

This is a legacy issue from copying the SDE version of q-faults.

marthajensen commented 2 years ago

@JCastleton

Your turn! We have some new fault data ready for the web for the Washington/Hurricane/Sevier-Toroweap Fault Zones. Please review the following datasets:

Hazards Portal:

Study Areas "G:\Shared drives\UGS_Hazards_MapPortal\Hazards Portal\LIVE Geodatabase\Geologic_Hazards_Geodatabase_Final_LIVE_Version.gdb\Study_Areas"

Quaternary Faults "G:\Shared drives\UGS_Hazards_MapPortal\Hazards Portal\LIVE Geodatabase\Geologic_Hazards_Geodatabase_Final_LIVE_Version.gdb\Quaternary_Faults

Data was added or modified for fault numbers 997a, 997b, 998a, 998b, 998c, 1004b, 2520, 2522, 2524, 2527, 2528, 2529, 2532, 2533, 2534, 2535, 2536, 2537, 2550, 2558

Special Study Zone "G:\Shared drives\UGS_Hazards_MapPortal\Hazards Portal\LIVE Geodatabase\Geologic_Hazards_Geodatabase_Final_LIVE_Version.gdb\Surface_Fault_Rupture_Hazard_Special_Study_Zone

Reporting tool data

Hazard Unit Text Table

"G:\Shared drives\UGS_Hazards_Geotech\Geologic Hazards Online Data\Final_Report_Tables\HazardUnitTextTable.csv"

This data is also located in the final live gdb ("G:\Shared drives\UGS_Hazards_MapPortal\Hazards Portal\LIVE Geodatabase\Final_Report_Tables_LIVE.gdb") but its probably easier to review as a CSV in the folder above. The only thing that changed in the HazardUnitTextTable is the Quaternary Fault data at the bottom of the table

Mapped Hazards Table

"G:\Shared drives\UGS_Hazards_Geotech\Geologic Hazards Online Data\Final_Report_Tables\MappedHazardsTable.csv"

The only thing that changed in this table is last two rows, listing the new faults and their associated codes (Row 117 and 118). The name in these rows needs to match the name in the Study_Areas feature class. The MappedHazardsTable is also in the "G:\Shared drives\UGS_Hazards_MapPortal\Hazards Portal\LIVE Geodatabase\Final_Report_Tables_LIVE.gdb"

AHiscock commented 2 years ago

@JCastleton

Just to follow up - we'd like to have this data live by the end of the week to coincide with when we submit our FTR text to the USGS, so if you could review it today or early tomorrow that would be great. I apologize I didn't let you know sooner about our deadline.

JCastleton commented 2 years ago

I have reviewed the gdb and tables. Everything looks great!

marthajensen commented 2 years ago

@JCastleton

You are a rockstar! Thanks. I'll publish this in the morning :)

emkleb commented 2 years ago

@marthajensen @AHiscock Quick note- We also need to get this final data into the master Q-faults SDE feature class. I think Adam or I are capable of it, but it might be helpful if Martha does it so we can make sure we aren't missing any data, as well as see if any issues come up that may be relevant to our larger efforts to re-do Q-faults SDE.

marthajensen commented 2 years ago

@AHiscock @emkleb

@AHiscock I changed around the qfault symbology this morning to thinner lines when zoomed in. Have a look and let me know

@emkleb Let's take care of adding the new data to the SDE during our meeting on Wednesday.

AHiscock commented 2 years ago

@marthajensen That looks MUCH better. Thanks. image