[DataCap Application] <Re-forecast>

Laycuicui commented 10 months ago

Data Owner Name

NOAA

What is your role related to the dataset

Data Preparer

Data Owner Country/Region

United States

Data Owner Industry

Environment

Website

http://www.noaa.gov/

Social Media

https://twitter.com/NOAA

Total amount of DataCap being requested

5PiB

Expected size of single dataset (one copy)

390TiB

Number of replicas to store

8

Weekly allocation of DataCap requested

1PiB

On-chain address for first allocation

f1pwdlbf25qbim777n4au5spaexfpgsxg7fprqd5y

Data Type of Application

Public, Open Dataset (Research/Non-Profit)

Custom multisig

[ ] Use Custom Multisig

Identifier

No response

Share a brief history of your project and organization

NOAA is an agency that enriches life through science. Our reach goes from the surface of the sun to the depths of the ocean floor as we work to keep the public informed of the changing environment around them. I'm a DP with some experience of distribute data.

Is this project associated with other projects/ecosystem stakeholders?

No

If answered yes, what are the other projects/ecosystem stakeholders

No response

Describe the data being stored onto Filecoin

NOAA has generated a multi-decadal reanalysis and reforecast data set to accompany the next-generation version of its ensemble prediction system, the Global Ensemble Forecast System, version 12 (GEFSv12).

Where was the data currently stored in this dataset sourced from

AWS Cloud

If you answered "Other" in the previous question, enter the details here

No response

If you are a data preparer. What is your location (Country/Region)

None

If you are a data preparer, how will the data be prepared? Please include tooling used and technical details?

IPFS, lotus, singularity

If you are not preparing the data, who will prepare the data? (Provide name and business)

No response

Has this dataset been stored on the Filecoin network before? If so, please explain and make the case why you would like to store this dataset again to the network. Provide details on preparation and/or SP distribution.

No response

Please share a sample of the data

https://registry.opendata.aws/noaa-gefs-reforecast/

Confirm that this is a public dataset that can be retrieved by anyone on the Network

[X] I confirm

If you chose not to confirm, what was the reason

No response

What is the expected retrieval frequency for this data

Sporadic

For how long do you plan to keep this dataset stored on Filecoin

2 to 3 years

In which geographies do you plan on making storage deals

Greater China, Asia other than Greater China, North America, Europe, Australia (continent)

How will you be distributing your data to storage providers

HTTP or FTP server

How do you plan to choose storage providers

Slack, Partners

If you answered "Others" in the previous question, what is the tool or platform you plan to use

No response

If you already have a list of storage providers to work with, fill out their names and provider IDs below

No response

How do you plan to make deals to your storage providers

No response

If you answered "Others/custom tool" in the previous question, enter the details here

No response

Can you confirm that you will follow the Fil+ guideline

Yes

herrehesse commented 10 months ago

New account, no history, no reputation, asking for 5 PiB and has no SP's listed.

Can we close this LDN right away @kevzak ?

Sunnyiscoming commented 10 months ago

Have you prepared enough token for sector pledge?
Has this dataset been stored on Filecoin before? If so, why are you choosing to store it again?
Best practice for storing large datasets includes ideally, storing it in 3 or more regions, with 4 or more storage provider operators or owners.You should list Miner ID, Business Entity, Location of sps you will cooperate with.
Per the https://github.com/filecoin-project/notary-governance/issues/922 for Open, Public Dataset applicants, please complete the following Fil+ registration form to identify yourself as the applicant and also please add the contact information of the SP entities you are working with to store copies of the data.

Laycuicui commented 10 months ago

Have you prepared enough token for sector pledge?

Has this dataset been stored on Filecoin before? If so, why are you choosing to store it again?

Best practice for storing large datasets includes ideally, storing it in 3 or more regions, with 4 or more storage provider operators or owners.You should list Miner ID, Business Entity, Location of sps you will cooperate with.

Per the Modification: Changes required to public open dataset application flow notary-governance#922 for Open, Public Dataset applicants, please complete the following Fil+ registration form to identify yourself as the applicant and also please add the contact information of the SP entities you are working with to store copies of the data.

Yes, SPs are ready.
As human significant public datasets have been stored before, but not many times, the SPs we work with are being stored for the first time.
Submitted Forms
Submitted Forms

herrehesse commented 10 months ago

@Laycuicui No we can not, until you share a full SP list in here.

github-actions[bot] commented 9 months ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

ghost commented 9 months ago

SP list provided SP 1 f02830476 xing HK No / SP 2 f02829749 xing HK No / SP 3 f02830451 no email HK No DevOps SP 4 f02809368 Tom Liu Japan No / SP 5 f02812314 Jerry Zhang USA No /

no email for HK, Jerry email bounced. Will email xing to confirm

Laycuicui commented 9 months ago

SP list provided SP 1 f02830476 xing HK No / SP 2 f02829749 xing HK No / SP 3 f02830451 no email HK No DevOps SP 4 f02809368 Tom Liu Japan No / SP 5 f02812314 Jerry Zhang USA No /

no email for HK, Jerry email bounced. Will email xing to confirm

Is there a problem with the display of the table? Correction.

SP 3 f02830451 （Slack contact DevOps）

SP 5 f02812314 Jerry Zhang USA wsbopen@outlook.com

ghost commented 9 months ago

SP list provided SP 1 f02830476 xing HK No / SP 2 f02829749 xing HK No / SP 3 f02830451 no email HK No DevOps SP 4 f02809368 Tom Liu Japan No / SP 5 f02812314 Jerry Zhang USA No / no email for HK, Jerry email bounced. Will email xing to confirm

Is there a problem with the display of the table? Correction.

SP 3 f02830451 （Slack contact DevOps）

SP 5 f02812314 Jerry Zhang USA wsbopen@outlook.com

no email back from Xing Jerry email bounces, does not work.

Sunnyiscoming commented 9 months ago

SP List provided: [{"providerID": "f02830476 ", "City": "HK", "Country": "CN", "SPOrg","XYZ"}, {"providerID": "f02829749 ", "City": "HK", "Country": "CN", "SPOrg","XYZ"}, {"providerID": "f02830451 ", "City": "HK", "Country": "CN", "SPOrg","XYZ"}, {"providerID": "f02809368 ", "City": "XYZ", "Country": "Japan", "SPOrg","XYZ"}, {"providerID": "f02812314 ", "City": "XYZ", "Country": "USA ","SPOrg","XYZ"},]

Laycuicui commented 9 months ago

SP list provided SP 1 f02830476 xing HK No / SP 2 f02829749 xing HK No / SP 3 f02830451 no email HK No DevOps SP 4 f02809368 Tom Liu Japan No / SP 5 f02812314 Jerry Zhang USA No / no email for HK, Jerry email bounced. Will email xing to confirm

Is there a problem with the display of the table? Correction. SP 3 f02830451 （Slack contact DevOps） SP 5 f02812314 Jerry Zhang USA wsbopen@outlook.com

no email back from Xing Jerry email bounces, does not work.

Xing have respond.

Jerry new e-mail：446024747@qq.com

ghost commented 9 months ago

@Laycuicui email is not working. The easier way to do this is for you to collect the SP information as proof of distribution and send to filplus.govteam@gmail.com

Laycuicui commented 9 months ago

@Laycuicui email is not working. The easier way to do this is for you to collect the SP information as proof of distribution and send to filplus.govteam@gmail.com

Plesase check！Hope go on～Thanks ！

ghost commented 9 months ago

Thank you. So we can validate: -Xing in Hong Kong

Jerry has not been verified. awaiting more information via email

ghost commented 9 months ago

There is nothing matching with his name and actual address.

ghost commented 8 months ago

@Laycuicui - waiting for more information, check email please

github-actions[bot] commented 8 months ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

Laycuicui commented 8 months ago

@Laycuicui - waiting for more information, check email please

Happy New Year! The email has been reorganized and sent. Thank you. @Filplus-govteam @kevzak

Hi @Filplus-govteam @kevzak @Sunnyiscoming any updation？

ghost commented 8 months ago

@Laycuicui we've never received any email verification. Last email was 13 days ago to you.

ghost commented 7 months ago

@Laycuicui the email was replied to. The proof of SP location is not sufficient, please provide other form.

Laycuicui commented 7 months ago

@Laycuicui the email was replied to. The proof of SP location is not sufficient, please provide other form.

The e-mail reply again,thanks!

ghost commented 7 months ago

OK, thank you .. @Sunnyiscoming you can trigger as needed

large-datacap-requests[bot] commented 7 months ago

Deleting comment

@Sunnyiscoming hasn't the permissions to post this comment.

Please, contact the assignee of this issue.

Sunnyiscoming commented 7 months ago

Datacap Request Trigger

Total DataCap requested

5PiB

Expected weekly DataCap usage rate

1PiB

Client address

f1pwdlbf25qbim777n4au5spaexfpgsxg7fprqd5y

large-datacap-requests[bot] commented 7 months ago

DataCap Allocation requested

Multisig Notary address

f02049625

Client address

f1pwdlbf25qbim777n4au5spaexfpgsxg7fprqd5y

DataCap allocation requested

256TiB

Id

3e2ef17a-8fe8-4142-975b-e628cb4a0eee

1ane-1 commented 7 months ago

SP List provided: [{"providerID": "f02830476 ", "City": "HK", "Country": "CN", "SPOrg","XYZ"}, {"providerID": "f02829749 ", "City": "HK", "Country": "CN", "SPOrg","XYZ"}, {"providerID": "f02830451 ", "City": "HK", "Country": "CN", "SPOrg","XYZ"}, {"providerID": "f02809368 ", "City": "XYZ", "Country": "Japan", "SPOrg","XYZ"}, {"providerID": "f02812314 ", "City": "XYZ", "Country": "USA ","SPOrg","XYZ"},] Support for the first round.

1ane-1 commented 7 months ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceahvabxcjut7mdjtrpom6s5uz3e2qjjxlcau6ubqtobqrxp7yvjiq

Address

f1pwdlbf25qbim777n4au5spaexfpgsxg7fprqd5y

Datacap Allocated

256.00TiB

Signer Address

f1mdk7s2vntzm6hu35yuo6vjubtrpfnb2awhgvrri

Id

3e2ef17a-8fe8-4142-975b-e628cb4a0eee

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceahvabxcjut7mdjtrpom6s5uz3e2qjjxlcau6ubqtobqrxp7yvjiq

woshidama323 commented 7 months ago

LGTM Will Support

woshidama323 commented 7 months ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceazmy33arqrwdxiil2ok4ucu6b5cp65bnvvre5yjz4ysgqdovzlmo

Address

f1pwdlbf25qbim777n4au5spaexfpgsxg7fprqd5y

Datacap Allocated

256.00TiB

Signer Address

f12tk3adljauwnd3hjbigpfxb7b7gdlj63p6afwtq

Id

3e2ef17a-8fe8-4142-975b-e628cb4a0eee

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceazmy33arqrwdxiil2ok4ucu6b5cp65bnvvre5yjz4ysgqdovzlmo

Laycuicui commented 7 months ago

checker:manualTrigger

filplus-checker-app[bot] commented 7 months ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

⚠️ 1 storage providers sealed more than 90% of total datacap - f02222322: 100.00%

⚠️ All storage providers are located in the same region.

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 2 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard.

aggregation-and-compliance-bot[bot] commented 7 months ago

Client f02948241 does not follow the datacap usage rules. More info here. This application has been failing the requirements for 7 days. Please take appropiate action to fix the following DataCap usage problems.	Criteria	Treshold	Reason
Percent of used DataCap stored with top provider	< 75	The percent of Data from the client that is stored with their top provider is 76.52%. This should be less than 75%

Laycuicui commented 7 months ago

checker:manualTrigger

filplus-checker-app[bot] commented 7 months ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard.

filplus-checker-app[bot] commented 6 months ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard.

large-datacap-requests[bot] commented 6 months ago

DataCap Allocation requested

Request number 2

Multisig Notary address

f02049625

Client address

f1pwdlbf25qbim777n4au5spaexfpgsxg7fprqd5y

DataCap allocation requested

512TiB

Id

e2c19dae-a8de-45f8-b3cd-b464ab9eead3

Aaron01230 commented 6 months ago

checker:manualTrigger

filplus-checker-app[bot] commented 6 months ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard.

stcloudlisa commented 6 months ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacebtibgrarms5k5fwoeyxmmyn53zbo6op7hoxdqpao3agpgjm7l4qa

Address

f1pwdlbf25qbim777n4au5spaexfpgsxg7fprqd5y

Datacap Allocated

512.00TiB

Signer Address

f1jvvltduw35u6inn5tr4nfualyd42bh3vjtylgci

Id

e2c19dae-a8de-45f8-b3cd-b464ab9eead3

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebtibgrarms5k5fwoeyxmmyn53zbo6op7hoxdqpao3agpgjm7l4qa

Aaron01230 commented 6 months ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacecn37hemlobzxocipnxilpalyz3ud5tfr7eurag42zfrwffxs7ok4

Address

f1pwdlbf25qbim777n4au5spaexfpgsxg7fprqd5y

Datacap Allocated

512.00TiB

Signer Address

f1xrnysd4gimg64d4l6qi7ulzwwq22c6vfg6lpw3i

Id

e2c19dae-a8de-45f8-b3cd-b464ab9eead3

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecn37hemlobzxocipnxilpalyz3ud5tfr7eurag42zfrwffxs7ok4

kernelogic commented 6 months ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceabnvkszput53nzg7vho3dla7jgf3qqdru65z466ewmvglixztqwu

Address

f1pwdlbf25qbim777n4au5spaexfpgsxg7fprqd5y

Datacap Allocated

512.00TiB

Signer Address

f1yjhnsoga2ccnepb7t3p3ov5fzom3syhsuinxexa

Id

e2c19dae-a8de-45f8-b3cd-b464ab9eead3

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceabnvkszput53nzg7vho3dla7jgf3qqdru65z466ewmvglixztqwu

large-datacap-requests[bot] commented 6 months ago

DataCap Allocation requested

Request number 2

Multisig Notary address

f02049625

Client address

f1pwdlbf25qbim777n4au5spaexfpgsxg7fprqd5y

DataCap allocation requested

512TiB

Id

13b93c61-790a-4a3d-985c-bbd0896bd9b9

woshidama323 commented 6 months ago

checker:manualTrigger

filplus-checker-app[bot] commented 6 months ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard.

woshidama323 commented 6 months ago

100.00% of deals are for data replicated across less than 4 storage providers.

Wish you fix this next round Will support first , Keep tracing

woshidama323 commented 6 months ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceckrgvghvs3h5r2e7bya53fqpjxg5beqs5utnvmzyyvwqw6tbbxrw

Address

f1pwdlbf25qbim777n4au5spaexfpgsxg7fprqd5y

Datacap Allocated

512.00TiB

Signer Address

f12tk3adljauwnd3hjbigpfxb7b7gdlj63p6afwtq

Id

13b93c61-790a-4a3d-985c-bbd0896bd9b9

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceckrgvghvs3h5r2e7bya53fqpjxg5beqs5utnvmzyyvwqw6tbbxrw

filplus-checker-app[bot] commented 6 months ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard.

Bitrise0111 commented 6 months ago

report shows healthy! support.

large-datacap-requests[bot] commented 5 months ago

DataCap Allocation requested

Request number 4

Multisig Notary address

f02049625

Client address

f1pwdlbf25qbim777n4au5spaexfpgsxg7fprqd5y

DataCap allocation requested

2PiB

Id

b23114fe-9ad0-4527-988d-dc271d1af07c

data-programs commented 3 months ago

This user’s identity has been verified through filplus.storage

filecoin-project / filecoin-plus-large-datasets