[DataCap Application] ArcticDEM (AWS Dataset)

[Fredmiu]

Data Owner Name

The Polar Geospatial Center (PGC)

Data Owner Country/Region

United States

Data Owner Industry

Environment

Website

https://www.pgc.umn.edu/

Social Media

https://github.com/PolarGeospatialCenter
https://www.facebook.com/polargeospatial
https://twitter.com/polargeospatial

Total amount of DataCap being requested

5PiB

Weekly allocation of DataCap requested

600TiB

On-chain address for first allocation

f1lgibduac75fp3xil2vl7ypnavnevnsa5dxuw2qa

Data Type of Application

Public, Open Dataset (Research/Non-Profit)

Custom multisig

• [ ] Use Custom Multisig

Identifier

No response

Share a brief history of your project and organization

Founded in 2007, the Polar Geospatial Center (PGC) solves geospatial problems at both poles by working with researchers on mapping and remote sensing projects in the most remote locations on Earth. The ArticDEM project seeks to fill the need for high-resolution time-series elevation data in the Arctic.

Is this project associated with other projects/ecosystem stakeholders?

No

If answered yes, what are the other projects/ecosystem stakeholders

No response

Describe the data being stored onto Filecoin

The time-dependent nature of the strip DEM files allows users to perform change detection analysis and to compare observations of topography data acquired in different seasons or years. The mosaic DEM tiles are assembled from multiple strip DEMs with the intention of providing a more consistent and comprehensive product over large areas. ArcticDEM data is constructed from in-track and cross-track high-resolution (~0.5 meter) imagery acquired by the Maxar constellation of optical imaging satellites.

Where was the data currently stored in this dataset sourced from

AWS Cloud

If you answered "Other" in the previous question, enter the details here

No response

How do you plan to prepare the dataset

IPFS, lotus, singularity

If you answered "other/custom tool" in the previous question, enter the details here

No response

Please share a sample of the data

https://registry.opendata.aws/pgc-arcticdem/

Confirm that this is a public dataset that can be retrieved by anyone on the Network

• [X] I confirm

If you chose not to confirm, what was the reason

No response

What is the expected retrieval frequency for this data

Yearly

For how long do you plan to keep this dataset stored on Filecoin

More than 3 years

In which geographies do you plan on making storage deals

Greater China, Asia other than Greater China, North America, South America

How will you be distributing your data to storage providers

HTTP or FTP server, Shipping hard drives

How do you plan to choose storage providers

Slack, Filmine, Big data exchange

If you answered "Others" in the previous question, what is the tool or platform you plan to use

No response

If you already have a list of storage providers to work with, fill out their names and provider IDs below

No response

How do you plan to make deals to your storage providers

Lotus client, Singularity

If you answered "Others/custom tool" in the previous question, enter the details here

No response

Can you confirm that you will follow the Fil+ guideline

Yes

[large-datacap-requests[bot]]

Thanks for your request!

Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!

[large-datacap-requests[bot]]

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

[Sunnyiscoming]

Can you introduce your organizaion? Please share more detailed information about sps you will cooperate with.

[cryptowhizzard]

Hi @Fredmiu

Thank you for applying for datacap. As Filecoin FIL+ notary i am screening your application and conducting due diligence.

Looking at your application i have some questions: As you are brand new on Github and have no history of past applications. Can you give me an introduction who you are and an introduction about your company?

What hardware do you have over there to prepare this dataset? What is your internet connection speed? Do you already have the data downloaded on the premises? Can you show us some visible proof of the size of your data and the storage / packing hardware you have there?

As last question i would like you to fill out this form to provide us with the necessary information to make a educated decision on your LDN request if we would like to support it.

Thanks!

[Fredmiu]

@Sunnyiscoming Hello, we are a small team participating in web3. We are looking for more sp for cooperation. Everything is in progress. Waiting for datacap approval so that I can reach cooperation with sps sooner. Thank you!

[Sunnyiscoming]

Datacap Request Trigger

Total DataCap requested

5PiB

Expected weekly DataCap usage rate

600TiB

Client address

f1lgibduac75fp3xil2vl7ypnavnevnsa5dxuw2qa

[large-datacap-requests[bot]]

DataCap Allocation requested

Multisig Notary address

f02049625

Client address

f1lgibduac75fp3xil2vl7ypnavnevnsa5dxuw2qa

DataCap allocation requested

256TiB

Id

4aca848a-b9f7-4a0e-99af-1095ab3d0993

[github-actions[bot]]

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

[Fredmiu]

Can any notaries help sign my application?

[Wengeding]

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacedophduhs42tdckcjb6fbzlswjnydd7gybbcihl2yangaziv7qzwa

Address

f1lgibduac75fp3xil2vl7ypnavnevnsa5dxuw2qa

Datacap Allocated

256.00TiB

Signer Address

f1txfsjmix4vlzido4dkildrnbw26owtlbslexmpa

Id

4aca848a-b9f7-4a0e-99af-1095ab3d0993

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedophduhs42tdckcjb6fbzlswjnydd7gybbcihl2yangaziv7qzwa

[MEIYAN666]

The applicant reached me on Slack and willing to support its first allocation.

[MEIYAN666]

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceb77xemtj6i5hpa2lnoeoifcngoxo3l7vveidhurkbq5ab5x7k3na

Address

f1lgibduac75fp3xil2vl7ypnavnevnsa5dxuw2qa

Datacap Allocated

256.00TiB

Signer Address

f1bwugfihrmn3iyunzyxst5nttql3dge4khwmurtq

Id

4aca848a-b9f7-4a0e-99af-1095ab3d0993

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceb77xemtj6i5hpa2lnoeoifcngoxo3l7vveidhurkbq5ab5x7k3na

[github-actions[bot]]

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

[github-actions[bot]]

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

[Fredmiu]

yes, keep it open

[github-actions[bot]]

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

[Fredmiu]

yes, keep it open

[C00kies77]

checker:manualTrigger

[cryptowhizzard]

checker:manualTrigger

[cryptowhizzard]

checker:manualTrigger

[filplus-checker-app[bot]]

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

• Overall Graphsync retrieval success rate: 0.00%
• Overall HTTP retrieval success rate: 60.00%
• Overall Bitswap retrieval success rate: 0.00%

Storage Provider Distribution

⚠️ 1 storage providers sealed more than 90% of total datacap - f02244750: 100.00%

⚠️ All storage providers are located in the same region.

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 2 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

[cryptowhizzard]

0% retrieval. This application can be closed?

[Fredmiu]

Overall HTTP retrieval success rate: 60.00%

@cryptowhizzard Can you read the report carefully?

[cryptowhizzard]

Overall HTTP retrieval success rate: 60.00%

@cryptowhizzard Can you read the report carefully?

Excuse me! Sorry about that. I indeed missed a line.

I will try HTTP retrieval with you next days to do due diligence on your data. Thanks!

[cryptowhizzard]

Another question here,

I notice you are storing with one SP. This SP is heavily involved in fraud. Can you share their details?

@filplus-govteam can you do KYC here please?

See the 25 LDN's this SP is involved in:

https://github.com/filecoin-project/filecoin-plus-large-datasets/issues?q=is%3Aissue+f1727w2vwjctfo7hflr5trgqkl3c7texh7pl4grzq

[cryptowhizzard]

Screenshot for visibility.

[github-actions[bot]]

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

[Fredmiu]

I don't know the history between the sp and other clients. It is't my duty. I can ensure that the sp can be retrieved.

[cryptowhizzard]

Yup,

I managed to get a part of the file ... your bandwidth filters were not strong enough.

File can be downloaded here:

http://www.datasetcreators.com/downloadedcarfiles/httpretrievals/1961-f02204302-f02244750-46992222-baga6ea4seaqjzgalv5unczzpcxrh7qdvau4am45yrdxshpnqxawvvkvzglw52kq

This is what's in it.

Any comments on why you are storing crap?

[github-actions[bot]]

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

[large-datacap-requests[bot]]

DataCap Allocation requested

Request number 2

Multisig Notary address

f02049625

Client address

f1lgibduac75fp3xil2vl7ypnavnevnsa5dxuw2qa

DataCap allocation requested

512TiB

Id

566a8b4d-1cc7-47cc-891a-8fe0176716a4

[large-datacap-requests[bot]]

Stats & Info for DataCap Allocation

Multisig Notary address

f02049625

Client address

f1lgibduac75fp3xil2vl7ypnavnevnsa5dxuw2qa

Rule to calculate the allocation request amount

100% weekly > 0.5PiB, requesting 0.5PiB

DataCap allocation requested

512TiB

Total DataCap granted for client so far

256TiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

4.75PiB

Stats

Number of deals	Number of storage providers	Previous DC Allocated	Top provider	Remaining DC
256	1	256TiB	100	240TiB

[Fredmiu]

@cryptowhizzard Stop reaching the ill-founded conclusion. We've been following the rules of the community.

[cryptowhizzard]

Dear Fredmiu,

As notary I am doing due diligence on your LDN. I could not get retrieval to work. Can you please upload the car file of CID baga6ea4seaqjzgalv5unczzpcxrh7qdvau4am45yrdxshpnqxawvvkvzglw52kq ?

You can use our upload system at http://send.datasetcreators.com. Please select 7 days for the system to keep the file and post the link you received here so I (and other notaries) can download your content.

[cryptowhizzard]

@Fredmiu

Prove me wrong then.

[github-actions[bot]]

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

[Fredmiu]

Keep open.

[Casey-PG]

checker:manualTrigger

[filplus-checker-app[bot]]

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

• Overall Graphsync retrieval success rate: 0.00%
• Overall HTTP retrieval success rate: 24.11%
• Overall Bitswap retrieval success rate: 0.00%

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

[Casey-PG]

Report is great, willing to support!

[Casey-PG]

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacea6plm4sxc6rg6uuji4uqie6ean3rtnu42jav5civfj2k4a3247kq

Address

f1lgibduac75fp3xil2vl7ypnavnevnsa5dxuw2qa

Datacap Allocated

512.00TiB

Signer Address

f1d4yb3wags3mtddzesxoo63jv7dmlec3bq4yteni

Id

566a8b4d-1cc7-47cc-891a-8fe0176716a4

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacea6plm4sxc6rg6uuji4uqie6ean3rtnu42jav5civfj2k4a3247kq

[BobbyChoii]

LGTM, there's nothing to be picky about.

[BobbyChoii]

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacebhn7pn2bexwicpalakzpg35pt7gmrwbpq36cipf4gjjzolfimxgs

Address

f1lgibduac75fp3xil2vl7ypnavnevnsa5dxuw2qa

Datacap Allocated

512.00TiB

Signer Address

f1irqs2gmctiv3jcdfwuch7oxvf4ixh3k4b2wc24i

Id

566a8b4d-1cc7-47cc-891a-8fe0176716a4

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebhn7pn2bexwicpalakzpg35pt7gmrwbpq36cipf4gjjzolfimxgs

[github-actions[bot]]

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

[Fredmiu]

Yes Keep open.

[github-actions[bot]]

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

[Fredmiu]

Yes Keep open.

[github-actions[bot]]

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

[Fredmiu]

Yes Keep open.

[herrehesse]

checker:manualTrigger