[DataCap Application] <FogMeta Lab> - <Digital Earth Africa GeoMAD>

[hengdingy]

Data Owner Name

FogMeta Lab

Data Owner Country/Region

China

Data Owner Industry

Web3 / Crypto

Website

https://fogmeta.com

Social Media

Twitter: https://twitter.com/FogMeta
GitHub: https://github.com/FogMeta

Total amount of DataCap being requested

5PiB

Weekly allocation of DataCap requested

1PiB

On-chain address for first allocation

f1jmckzpw3exdfnh5eybg66ai6cvmhdiqjtc3y2aa

Custom multisig

• [ ] Use Custom Multisig

Identifier

No response

Share a brief history of your project and organization

FogMeta Lab's research spans multiple levels from system technology, infrastructure, and middleware to services and solutions, and involves future systems, network technology and business, distributed systems and management, information management, and interactive and innovative services. Based on the views on and practices in the industry, FogMeta also solves the problem of business complexity through operations optimization and other technologies.

Is this project associated with other projects/ecosystem stakeholders?

No

If answered yes, what are the other projects/ecosystem stakeholders

No response

Describe the data being stored onto Filecoin

"GeoMAD is the Digital Earth Africa (DE Africa) surface reflectance geomedian and triple Median Absolute Deviation data service. It is a cloud-free composite of satellite data compiled over specific timeframes. The geomedian component combines measurements collected over the specified timeframe to produce one representative, multispectral measurement for every pixel unit of the African continent. The end result is a comprehensive dataset that can be used to generate true-colour images for visual inspection of anthropogenic or natural landmarks. The full spectral dataset can be used to develop more complex algorithms. For each pixel, invalid data is discarded, and remaining observations are mathematically summarised using the geomedian statistic. Flyover coverage provided by collecting data over a period of time also helps scope intermittently cloudy areas. Variations between the geomedian and the individual measurements are captured by the three Median Absolute Deviation (MAD) layers. These are higher-order statistical measurements calculating variation relative to the geomedian. The MAD layers can be used on their own or together with geomedian to gain insights about the land surface, and understand change over time. Calculating GeoMAD over different timeframes and sensors provides a range of insights to the environment. An annual timeframe allows better correction for cloud cover and reduces artifacts for comparison over multiple years. A semiannual timeframe, for example six-month blocks, better captures seasonal variation within one year, but can also be used to compare equivalent periods from different years. Likewise, Landsat sensors allows full utility of the surface reflectance archive dating back to 1984, while more recent Sentinel-2 data provides higher-frequency flyovers and better resolution. The Digital Earth Africa GeoMAD service currently provides annual and six-month semiannual datasets, with separate services for Landsat and Sentinel-2 sensors."

Source: https://registry.opendata.aws/deafrica-geomad/

Where was the data currently stored in this dataset sourced from

AWS Cloud

If you answered "Other" in the previous question, enter the details here

No response

How do you plan to prepare the dataset

IPFS, lotus, graphsplit, others/custom tool

If you answered "other/custom tool" in the previous question, enter the details here

We'd also like to use the Swan Client tool (https://github.com/filswan/go-swan-client#Graphsplit) to prepare the dataset.

Please share a sample of the data

s3://deafrica-services/gm_s2_annual/ (58.6 TiB)
s3://deafrica-services/gm_s2_semiannual/ (108.4 TiB)
s3://deafrica-services/gm_ls8_annual/ (6.0 TiB)
s3://deafrica-services/gm_ls5_ls7_annual/ (17.7 TiB)
s3://deafrica-services-inventory/ (114.8 GiB)

Confirm that this is a public dataset that can be retrieved by anyone on the Network

• [X] I confirm

If you chose not to confirm, what was the reason

No response

What is the expected retrieval frequency for this data

Monthly

For how long do you plan to keep this dataset stored on Filecoin

2 to 3 years

In which geographies do you plan on making storage deals

Greater China, Asia other than Greater China, Africa, North America, South America, Europe, Australia (continent), Antarctica

How will you be distributing your data to storage providers

Cloud storage (i.e. S3), HTTP or FTP server, IPFS, Shipping hard drives

How do you plan to choose storage providers

Slack, Partners, Others

If you answered "Others" in the previous question, what is the tool or platform you plan to use

We'd also like to use FilSwan platform (https://filswan.com/) to choose storage providers who meet our requirements.

If you already have a list of storage providers to work with, fill out their names and provider IDs below

The storage providers we'd like to work with are presented below. Some of them are from the FilSwan platform.
f01955033
f02029115
f03624
f010088
f02301
f08399
f02401
f01955030
f0187709
f01163272
f01402814
f01390330
f01225882
f0717969
f03223
f01395673
f01072221
f0143858
f01786736
f0836160
f032824
f01443744
f01871352
f01907556
f01955028
f01947280
f01946551
f02012951
f01970630
f0240185

How do you plan to make deals to your storage providers

Boost client, Lotus client, Others/custom tool

If you answered "Others/custom tool" in the previous question, enter the details here

Swan Client tool
https://github.com/filswan/go-swan-client

Can you confirm that you will follow the Fil+ guideline

Yes

[large-datacap-requests[bot]]

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

[Sunnyiscoming]

s3://deafrica-services/gm_s2_annual/ (58.6 TiB) s3://deafrica-services/gm_s2_semiannual/ (108.4 TiB) s3://deafrica-services/gm_ls8_annual/ (6.0 TiB) s3://deafrica-services/gm_ls5_ls7_annual/ (17.7 TiB) s3://deafrica-services-inventory/ (114.8 GiB)

Do you want to store these data in this application? How many copies you will store?

[hengdingy]

s3://deafrica-services/gm_s2_annual/ (58.6 TiB) s3://deafrica-services/gm_s2_semiannual/ (108.4 TiB) s3://deafrica-services/gm_ls8_annual/ (6.0 TiB) s3://deafrica-services/gm_ls5_ls7_annual/ (17.7 TiB) s3://deafrica-services-inventory/ (114.8 GiB)

Do you want to store these data in this application? How many copies you will store?

@Sunnyiscoming Considering the retrieval success rate, we will store the 14 copies to the Filecoin network. The buckets data size about 190TiB, every piece size will be 16GiB(required 32GiB datacap), so all data need 1901024/1632*14/1024=5320TiB datacap.

[Sunnyiscoming]

Datacap Request Trigger

Total DataCap requested

5PiB

Expected weekly DataCap usage rate

1PiB

Client address

f1jmckzpw3exdfnh5eybg66ai6cvmhdiqjtc3y2aa

[large-datacap-requests[bot]]

DataCap Allocation requested

Multisig Notary address

f02049625

Client address

f1jmckzpw3exdfnh5eybg66ai6cvmhdiqjtc3y2aa

DataCap allocation requested

256TiB

Id

ff54e91f-7058-4e9c-b0f0-35032c680dfc

[cryptowhizzard]

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacecqghmsfxcsrtfuldd5k3yzqlgq3hoy3hab5zk2flvsrwq2tmo2ma

Address

f1jmckzpw3exdfnh5eybg66ai6cvmhdiqjtc3y2aa

Datacap Allocated

256.00TiB

Signer Address

f1krmypm4uoxxf3g7okrwtrahlmpcph3y7rbqqgfa

Id

ff54e91f-7058-4e9c-b0f0-35032c680dfc

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecqghmsfxcsrtfuldd5k3yzqlgq3hoy3hab5zk2flvsrwq2tmo2ma

[zcfil]

@hengdingy Hello ,Looking at your application i have some questions: 1.Are these data completely public？ 2.Is it randomly assigned to the storage provider you listed or specified？

[hengdingy]

@hengdingy Hello ,Looking at your application i have some questions: 1.Are these data completely public？ 2.Is it randomly assigned to the storage provider you listed or specified？

@zcfil yes, all datasets are from https://registry.opendata.aws/deafrica-geomad/, they are completely public.

and all datasets will be assigned to the storage providers by FilSwan's bidding engine. The lists of storage providers in the application are just some of the active storage providers. The dataset will be assigned to more than the listed storage providers.

[zcfil]

@galen-mcandrew @raghavrmadya @Kevin-FF-USA Because my hardware wallet has not been updated to the multi-signature address f02049625 for a long time, my use of the lotus command to sign did not trigger the above git message reply. Can I do this? Because I have been reviewing LDNs for a long time and have not contributed to the community, I am in a hurry.

Request Approve Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network bafy2bzacealntbwrtsd2vvcuwlhiz7cg4jyx2azn2hz3smdsdcrmppdz2o73s

Address f1jmckzpw3exdfnh5eybg66ai6cvmhdiqjtc3y2aa

Datacap Allocated 256.00TiB

Signer Address f17xummecmkqgjhm4fesktesaieumn7ugarwucwty

Id none

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacealntbwrtsd2vvcuwlhiz7cg4jyx2azn2hz3smdsdcrmppdz2o73s

[large-datacap-requests[bot]]

We have found some problems in the information provided in the Approved Comment. We could not find Address field in the information provided We could not find Datacap Allocated field in the information provided We could not find Signer Address field in the information provided We could not find Message sent to Filecoin Network** field in the information provided

Please, take a look at the comment and edit the body of the comment providing all the required information.

[large-datacap-requests[bot]]

We have found some problems in the information provided in the Approved Comment. We could not find Address field in the information provided We could not find Datacap Allocated field in the information provided We could not find Signer Address field in the information provided We could not find Message sent to Filecoin Network** field in the information provided

Please, take a look at the comment and edit the body of the comment providing all the required information.

[large-datacap-requests[bot]]

We have found some problems in the information provided in the Approved Comment. We could not find Address field in the information provided We could not find Datacap Allocated field in the information provided We could not find Signer Address field in the information provided We could not find Message sent to Filecoin Network** field in the information provided

Please, take a look at the comment and edit the body of the comment providing all the required information.

[large-datacap-requests[bot]]

We have found some problems in the information provided in the Approved Comment. We could not find Address field in the information provided We could not find Datacap Allocated field in the information provided We could not find Signer Address field in the information provided We could not find Message sent to Filecoin Network** field in the information provided

Please, take a look at the comment and edit the body of the comment providing all the required information.

[Normalnoise]

checker:manualTrigger

[filplus-checker-app[bot]]

DataCap and CID Checker Report[^1]

No active deals found for this client.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[hengdingy]

checker:manualTrigger

[filplus-checker-app[bot]]

DataCap and CID Checker Report[^1]

No active deals found for this client.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[github-actions[bot]]

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

[hengdingy]

checker:manualTrigger

[Normalnoise]

checker:manualTrigger

[filplus-checker-app[bot]]

DataCap and CID Checker Report[^1]

No active deals found for this client.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[github-actions[bot]]

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

[hengdingy]

checker:manualTrigger

[github-actions[bot]]

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

[Normalnoise]

checker:manualTrigger

[Normalnoise]

checker:manualTrigger

[github-actions[bot]]

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

[hengdingy]

keep alive

[Normalnoise]

checker:manualTrigger

[github-actions[bot]]

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

[hengdingy]

checker:manualTrigger

[github-actions[bot]]

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

[Normalnoise]

checker:manualTrigger

[filplus-checker-app[bot]]

DataCap and CID Checker Report[^1]

No active deals found for this client.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[github-actions[bot]]

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

[hengdingy]

keep live

[github-actions[bot]]

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

[Normalnoise]

checker:manualTrigger

[filplus-checker-app[bot]]

DataCap and CID Checker Report[^1]

No active deals found for this client.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[github-actions[bot]]

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

[hengdingy]

checker:manualTrigger

[filplus-checker-app[bot]]

DataCap and CID Checker Report[^1]

No active deals found for this client.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[github-actions[bot]]

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

[Sunnyiscoming]

Please provide ID, City, Country, Organization of each SP here.

[hengdingy]

Please provide ID, City, Country, Organization of each SP here.

https://github.com/filecoin-project/filecoin-plus-large-datasets/issues/2286#issuecomment-1835787739 @Sunnyiscoming

[hengdingy]

checker:manualTrigger

[filplus-checker-app[bot]]

DataCap and CID Checker Report[^1]

No active deals found for this client.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[hengdingy]

checker:manualTrigger

[filplus-checker-app[bot]]

DataCap and CID Checker Report[^1]

No active deals found for this client.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[hengdingy]

checker:manualTrigger