Vizzuality / mangrove-atlas

Global Mangrove Watch
https://globalmangrovewatch.org
MIT License
10 stars 6 forks source link

Mangroves in Protected Areas Data #333

Closed klongleywood closed 2 years ago

klongleywood commented 2 years ago

The 3rd tab (national) in the attached file contains data we can use to populate the mangroves in protected areas widget. It does not include the new basemap as my understanding is it's still under review?

It might be helpful to discuss whether these populations can be updated on the fly in the future with new versions of the WDPA?

Mangrove_Protection_Calculations_20210430.xlsx

tamaramegan commented 2 years ago

Hi @lhilarides and @klongleywood, which WDPA version are you using for this calculations? The data from this table has data until 2010. Should we use the latest WDPA version from Nov 2021 or do you have a preferred version that matches these calculations?

klongleywood commented 2 years ago

Hi @tamaramegan - when you say that this has data through 2010, do you mean 2016? The table I sent should have data through 2016.

If we're talking on-the-fly calculations, ideally we'd use the most recent version of WDPA data. That said, we have a call later this week to discuss some nuances of this table, including correlating the PA designation year to the mangrove extent, so let's talk more about this on Friday.

tamaramegan commented 2 years ago

@klongleywood yes, I meant until 2016! The question is about which WDPA layer should we be showing on the map. If you have a specific version you want to share or if we should start working with the latest available (Nov 2021)

klongleywood commented 2 years ago

Got it! Yes, then I think showing the latest available data makes the most sense.

klongleywood commented 2 years ago

@tamaramegan @dhakelila An update on this -- @lhilarides and I just met with some of our colleagues who are working on an updated version of the protected area analysis, and we agreed that to get a first version of this widget running by February, we would keep fairly simple. Rather than worrying about the time series, we will just include statistics for the current time step.

So, the statistics by country will still be the same (Area in Protected Areas and % of Mangroves in Protected Areas), but it will just be for one year (for now). They are expecting to have the updated statistics by early January, and we will try our best to hold them to this timeline, but since the data will be structured as a simplified version of the table I previously sent, I hope we can work on the design starting now, and then ingest the new statistics as they become available next month. Let me know if you have questions/concerns?

dhakelila commented 2 years ago

Hi Kate, when do you expect the whole data to come?

I'm trying to evaluate the risks of going ahead with this as I already expressed my preference to have all the materials before Xmas.

Time will be short. Take into account that you will need to review the widget before the event. Also, in terms of development, does it means that we'll work on a version for a single year now and then, upgrade the widget to afford for multiple years? That will mean extra work in our end and I'm afraid we can't afford that. So if we want to have that version ready by February, I'd say that we'll need to keep that version on the current scope.

Let me know what do you think.

klongleywood commented 2 years ago

@dhakelila and fyi @lhilarides

When you say the whole data, do you mean the data by year, or just the data for the latest baseline? If it's the latter, we have been told early January. I'm afraid I don't have a sense of the rest of the calculations, but definitely not in time for a February release.

I do understand your preference for the data being available pre-Christmas, but if we publish the data that we have as-is, it will not be consistent with future peer-reviewed publications, meaning that we would require another update or we would lose credibility. We are trying to minimize both outcomes by creating a simplified version for just one year. I hear what you are saying about needing more time if we need to upgrade later on and we can definitely discuss the budget/scope implications for that in the next scoping/budgeting phase.

I understand too that timing will be tight, but if we can agree on the format/function of the app, which should be quite simple, especially with just one year, it will just be a matter of updating the data when it becomes available. Let's chat more about this when we meet next week.

klongleywood commented 2 years ago

Hi @dhakelila @tamaramegan -- an update on this. Our team met today and we decided that we could run the preliminary analysis before the holiday. Moving forward, we would keep this widget just showing the most recent baseline/WDPA, and not worry about integrating previous years.

We may need to update the data table once the published data is released, but that wouldn't involve any change to the widget, just the underlying table.

dhakelila commented 2 years ago

Hi @klongleywood,

We were also discussing this today.

We thought that what we can do in order to get things done on time is to create ourselves a data sample with the data you already provided and use it to develop the widget, then, provide that sample to you so the only thing you need to do when data is ready is to populate that table and send it back to us so we import to the project.

If you can provide the data before Xmas it is ok, but we can also proceed the other way if that sounds ok!

What we do need is approval for the design of the widget for a single year and the agreement that the widget will only show one year in this current scope.

I'm sending a screenshot with our proposal for that widget. Screenshot 2021-12-13 at 16 18 02

klongleywood commented 2 years ago

Hi @dhakelila (and fyi @lhilarides) -- this mock-up looks like it's for restoration, not protection. Can you send one that speaks to the protection stats? It will probably look similar, but I just want to make sure we're on the same page...

dhakelila commented 2 years ago

🤦‍♀️ I'm really sorry! I shared the wrong screenshot. But you are right, the one for Protection stats will be very similar. Screenshot 2021-12-15 at 22 11 10

dhakelila commented 2 years ago

@klongleywood , @lhilarides

Clarification about the Protected Areas layer: We have ready the pipeline and we could get a dataset, but Lammert, we prefer if you can provide it. If time goes by and you don't get the data, Lammert, then we'll provide one dataset.

dhakelila commented 2 years ago

@klongleywood , @lhilarides

We'll prepare staging next week with the actual data so you can start checking. Then, we'll upload new data as soon as we get it.

AngelArcones commented 2 years ago

I'm attaching here the example for the new data model for the protected areas widget, as a reference on how new data is needed. Mangrove_protected_area.csv Also, in order to add the location ID to the new data, I include this file with the ID of all the countries that are currently in the API, and their ISO code. Some countries' names may not perfectly match between the new data and the API info, so it is important to check and correct such cases (or use ISO code if available). Country_location_id.csv

(edit: initially the Country_location_id file was incorrect, I've uploaded it now with the correct content)

dhakelila commented 2 years ago

@klongleywood, @lhilarides, when do you think you will be sending the data? Just for us to be ready and upload it asap when we have it.

klongleywood commented 2 years ago
aagm commented 2 years ago

Hi sharing here the link to download a cleaned and filtered version from the latest Feb file of wdpa data. take into account that this version is not simplified: https://storage.googleapis.com/mangrove_atlas/boundaries/processed/wdpa_protected_areas_public.zip

lhilarides commented 2 years ago

Thanks so much Alicia! I've downloaded the file and will start the processing. Will keep you updated

lhilarides commented 2 years ago

Hi @aagm , I just checked the WDPA dataset, but it only contains marine protected areas. Since there are quite a lot of mangroves in protected areas that are not marine one, we are also going to need the non-marine ones. Do you have a cleaned / filtered version of the WDPA that includes these? Thanks in advance!

aagm commented 2 years ago

Hi, we are folowing the similar rules for WDPA used to generate the version that is uploaded into the platform. That means that We are applying the next filtering option to the main WDPA dataset:

If terrestrial is needed we can provide it (we will apply then a different filter related coastal countries to avoid working with unnecesary data), but then numbers calculated from it, there will be a missmatch between the numbers derived from it and what we are visualizing in the map.

lhilarides commented 2 years ago

Hi @aagm : thanks for explaining! The terrestrial class is also needed as there are many terrestrial protected areas that overlap with the mangrove extent layer. Not including the terrestrial areas in the stats or on the map would mean our statistics for mangrove extent in protected areas per country become meaningless. Just to clarify: "terrestrial" areas can also be located in areas you and I would call coastal. The MARINE attribute of the WDPA layer is very inaccurate in this regard. If it helps: instead of using the bbox you could perhaps intersect the mangrove extent layer with the WDPA layer?

aagm commented 2 years ago

Hi! latest wdpa data updated: this is the Link to download:

dhakelila commented 2 years ago

@aagm I think this is still relevant for the WDPA task at hand

dhakelila commented 2 years ago

Only missing to upload the data that Lammert sent.

lhilarides commented 2 years ago

I've updated the "mangroves in protected areas" data for GMW version 3.14. This can be dowloaded here: https://wetlandsint-my.sharepoint.com/:x:/g/personal/lammert_hilarides_wetlands_org/Ed4f0IFoEN9Ou1qoKT1PM94BYU_1t9wzY-N6QYJQvly8uA?e=Pzoas0

can you upload this to the api @aagm ? also @klongleywood , here's the long awaited data

dhakelila commented 2 years ago

@lhilarides , you sent us the updated dataset last week and Alicia was working on Friday to get it done. Why has this changed? I don't understand.

lhilarides commented 2 years ago

@lhilarides , you sent us the updated dataset last week and Alicia was working on Friday to get it done. Why has this changed? I don't understand.

The data sent last week came from UNEP-WCMC's Oceans+ platform but was still based on GMW v2. We'd like the numbers between Oceans+ and GMW to correspond, but since WCMC don't have time to update to GMWv3 now we have to calculate this ourselves for the time being. I tried to do this with the WDPA dataset provided above, but this contains >20.000 protected area boundaries, 17.000 of which don't have any mangroves at all (e.g. deserts in Australia) and should therefore not be included.

I then took the latest WDPA (July 2022), applied the filters mentioned above and end up with 3049 protected area boundaries, which I ran the calculations on. The datastructure of the output is the same as the previous

aagm commented 2 years ago

Also i will add here the link for the geospatial data: https://wetlandsint-my.sharepoint.com/:u:/g/personal/lammert_hilarides_wetlands_org/EUf-aN6kyIFDtX3VZGTFmmUBqcSsFKOYHNVjmBBqTuJ_Sg?e=c7UkjU

dhakelila commented 2 years ago

All the requested changes on this thread are now completed. Please, check and close the issue if you agree.