search

filecoin-project / filecoin-plus-large-datasets

Hub for client applications for DataCap at a large scale
109 stars 62 forks source link

[DataCap Application] Digital Earth Africa GeoMAD for Drust-Agee #1123

Closed Agee-Drust closed 1 year ago

Agee-Drust commented 2 years ago

Large Dataset Notary Application

To apply for DataCap to onboard your dataset to Filecoin, please fill out the following.

Core Information

Please respond to the questions below by replacing the text saying "Please answer here". Include as much detail as you can in your answer.

Project details

Share a brief history of your project and organization.

I'm a member in Filecoin, but I have ambitious with Filecoin and Filecoin slingshot about ensuring meaningful data is stored and retrieved from the Filecoin Network.

What is the primary source of funding for this project?

My own source.

What other projects/ecosystem stakeholders is this project associated with?

No

Use-case details

Describe the data being stored onto Filecoin

Sentinel-2 GeoMAD (Annual) data
Sentinel-2 GeoMAD (Semi-Annual) data
Landsat 8 GeoMAD (Annual) data
Landsat 5 and 7 GeoMAD (Annual) data

Where was the data in this dataset sourced from?

The data is from AWS Open dataset.

Can you share a sample of the data? A link to a file, an image, a table, etc., are good ways to do this. 

https://registry.opendata.aws/deafrica-geomad/

Confirm that this is a public dataset that can be retrieved by anyone on the Network (i.e., no specific permissions or access rights are required to view the data).

I confirm. This is a open dataset.

What is the expected retrieval frequency for this data?

Follow LDN Application rules. 1-2 times half a year.

For how long do you plan to keep this dataset stored on Filecoin?

More than 1 year.

DataCap allocation plan

In which geographies (countries, regions) do you plan on making storage deals?

All regions.

How will you be distributing your data to storage providers? Is there an offline data transfer process?

After CAR files are ready, I will upload it to the server for SP, or I will prepare disks. Then I will propose offline deals after they get files.

How do you plan on choosing the storage providers with whom you will be making deals? This should include a plan to ensure the data is retrievable in the future both by you and others.

I plan to make deals with SPs that support data retrieval and have stable sealing rate.
Also, I welcome every one who are interested with this deal.

How will you be distributing deals across storage providers?

Try to make every SP under 25% of deals.

Do you have the resources/funding to start making deals as soon as you receive DataCap? What support from the community would help you onboard onto Filecoin?

Enough.
large-datacap-requests[bot] commented 2 years ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

raghavrmadya commented 2 years ago

Please share how exactly will you follow LDN rules. Who are the SPs you have been in touch with and be specific about geographic distribution

Agee-Drust commented 2 years ago

Please share how exactly will you follow LDN rules. Who are the SPs you have been in touch with and be specific about geographic distribution

@raghavrmadya Hi Raghav, here is my former application and it can approve that I have been following the rules of LDN. https://github.com/filecoin-project/filecoin-plus-large-datasets/issues/427

This is the datacap allocation I already had. 87

I'd like to cooperate with SPs in all regions. I've been in touch with SPs in USA, Korea, Sinapore, Japan. SPs: f01895783, f01917257, f01917241, f01924325

I will continue to follow the rules of LDN, for the purpose of distributed storage.

simonkim0515 commented 1 year ago

Datacap Request Trigger

Total DataCap requested

5PiB

Expected weekly DataCap usage rate

100TiB

Client address

f1rzap6ssv7d7odff4azw7nky6uorn3fy7hyogbey

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Multisig Notary address

f02049625

Client address

f1rzap6ssv7d7odff4azw7nky6uorn3fy7hyogbey

DataCap allocation requested

50TiB

Id

4919cc30-da9b-466a-a7b6-7103a4a5f285

PluskitOfficial commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacea3ogl5iak7pqurfldurawkwip3sidjjyr5tph2sqibarbcjhgjg2

Address

f1rzap6ssv7d7odff4azw7nky6uorn3fy7hyogbey

Datacap Allocated

50.00TiB

Signer Address

f1tgnlhtcmhwipfm7thsftxhn5k52velyjlazpvka

Id

4919cc30-da9b-466a-a7b6-7103a4a5f285

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacea3ogl5iak7pqurfldurawkwip3sidjjyr5tph2sqibarbcjhgjg2

MetaWaveInfo commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacebehtvvmwyv5r5xdg6dyybjcu3stqz2et3eziqebebsjsej4kzcsa

Address

f1rzap6ssv7d7odff4azw7nky6uorn3fy7hyogbey

Datacap Allocated

50.00TiB

Signer Address

f1ktlkcxnmzxcdaoqfsunrg3vocfbmgv4n3mrn74a

Id

4919cc30-da9b-466a-a7b6-7103a4a5f285

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebehtvvmwyv5r5xdg6dyybjcu3stqz2et3eziqebebsjsej4kzcsa

Sunnyiscoming commented 1 year ago

Is there any problem with using datacap?

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 2

Multisig Notary address

f02049625

Client address

f1rzap6ssv7d7odff4azw7nky6uorn3fy7hyogbey

DataCap allocation requested

100TiB

Id

14dabb50-337b-4a27-a526-041672efeb3f

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 3 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the full report.

Casey-PG commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacedflr5efduiqp66stfplzulczxfajejgsy7sgiuvgrubupsv2mjpk

Address

f1rzap6ssv7d7odff4azw7nky6uorn3fy7hyogbey

Datacap Allocated

100.00TiB

Signer Address

f1d4yb3wags3mtddzesxoo63jv7dmlec3bq4yteni

Id

14dabb50-337b-4a27-a526-041672efeb3f

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedflr5efduiqp66stfplzulczxfajejgsy7sgiuvgrubupsv2mjpk

MEIYAN666 commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacedlifeutzxhzqod2jxw3t43p6mxwectiiq4fydt4yobqdnyq6kqr6

Address

f1rzap6ssv7d7odff4azw7nky6uorn3fy7hyogbey

Datacap Allocated

100.00TiB

Signer Address

f1bwugfihrmn3iyunzyxst5nttql3dge4khwmurtq

Id

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedlifeutzxhzqod2jxw3t43p6mxwectiiq4fydt4yobqdnyq6kqr6

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 3

Multisig Notary address

f02049625

Client address

f1rzap6ssv7d7odff4azw7nky6uorn3fy7hyogbey

DataCap allocation requested

200TiB

Id

53cd2dc2-2205-487c-8517-a9a3fc8f7d6e

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f02049625

Client address

f1rzap6ssv7d7odff4azw7nky6uorn3fy7hyogbey

Rule to calculate the allocation request amount

200% of weekly dc amount requested

DataCap allocation requested

200TiB

Total DataCap granted for client so far

9094.9YiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

-1.09B

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
3200 3 100TiB 47.16 0B
TakiChain commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceco6xmpswz5gqtcsvd77l66bm7lx3b6gtjaglf5vupfggbzcui222

Address

f1rzap6ssv7d7odff4azw7nky6uorn3fy7hyogbey

Datacap Allocated

200.00TiB

Signer Address

f15impf3j2zcaex4lhyxndxswuuhv24vzstuqtxsi

Id

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceco6xmpswz5gqtcsvd77l66bm7lx3b6gtjaglf5vupfggbzcui222

Bennyyangpu commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacecs2cekbboyva3ly27cuv7leo2gxgw563lkvrb7ksenbt43hwklj2

Address

f1rzap6ssv7d7odff4azw7nky6uorn3fy7hyogbey

Datacap Allocated

200.00TiB

Signer Address

f174fg3bqbln3zjnkxtyf6s54txqkr7yqkj6cig7y

Id

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecs2cekbboyva3ly27cuv7leo2gxgw563lkvrb7ksenbt43hwklj2

Casey-PG commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceb6ptfjztnbdimaodbbyaawxwpmgcqjdcmfualy5t7tpsz3r3naig

Address

f1rzap6ssv7d7odff4azw7nky6uorn3fy7hyogbey

Datacap Allocated

200.00TiB

Signer Address

f1d4yb3wags3mtddzesxoo63jv7dmlec3bq4yteni

Id

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceb6ptfjztnbdimaodbbyaawxwpmgcqjdcmfualy5t7tpsz3r3naig

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

Sunyaoyaomk commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

⚠️ All retrieval success ratios are below 1%.

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 5

Multisig Notary address

f02049625

Client address

f1rzap6ssv7d7odff4azw7nky6uorn3fy7hyogbey

DataCap allocation requested

400TiB

Id

a9ec88d0-243b-440b-b55b-4134093002e8

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f02049625

Client address

f1rzap6ssv7d7odff4azw7nky6uorn3fy7hyogbey

Rule to calculate the allocation request amount

400% of weekly dc amount requested

DataCap allocation requested

400TiB

Total DataCap granted for client so far

1.8189894035458583e+34YiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

1.8189894035458583e+34YiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
14632 9 200TiB 17.9 12.75TiB
Agee-Drust commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 36.94% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

AthSmith commented 1 year ago

Looked into the CID report and retrieval performance, it's good to go. Kindly improve Deal Data Replication performance for the next tranche, keep eyes on it.

AthSmith commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceb4fiuxwp3bzpsnya2etvrnpfp4cj7z3dpdwxmmmg5vmxdphpvtmy

Address

f1rzap6ssv7d7odff4azw7nky6uorn3fy7hyogbey

Datacap Allocated

400.00TiB

Signer Address

f1vxbqrf7rfum3n6m5u6eb4re6xj7amvsaqnzu64y

Id

a9ec88d0-243b-440b-b55b-4134093002e8

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceb4fiuxwp3bzpsnya2etvrnpfp4cj7z3dpdwxmmmg5vmxdphpvtmy

BobbyChoii commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 36.94% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

BobbyChoii commented 1 year ago

Report LGTM, willing to support!

BobbyChoii commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceblxr2bkyjaxt2c547hr3cwalmcoeklxlxuddeohxtvflmy56bnsa

Address

f1rzap6ssv7d7odff4azw7nky6uorn3fy7hyogbey

Datacap Allocated

400.00TiB

Signer Address

f174fg3bqbln3zjnkxtyf6s54txqkr7yqkj6cig7y

Id

a9ec88d0-243b-440b-b55b-4134093002e8

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceblxr2bkyjaxt2c547hr3cwalmcoeklxlxuddeohxtvflmy56bnsa

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 14 days, so for now it is being closed. Please feel free to contact the Fil+ Gov team to re-open the application if it is still being processed. Thank you!

-- Commented by Stale Bot.

Sunnyiscoming commented 1 year ago

Hello, @Agee-Drust per the https://github.com/filecoin-project/notary-governance/issues/922 for Open, Public Dataset applicants, please complete the following Fil+ registration form to identify yourself as the applicant and also please add the contact information of the SP entities you are working with to store copies of the data.

This information will be reviewed by Fil+ Governance team to confirm validity and then the application will be allowed to move forward for additional notary review.