filecoin-project / filecoin-plus-large-datasets

Hub for client applications for DataCap at a large scale
109 stars 62 forks source link

[DataCap Application] NOAA Geostationary Operational Environmental Satellites (GOES) 17, 18<1/2> #1849

Closed VincentShii closed 11 months ago

VincentShii commented 1 year ago

Data Owner Name

The National Oceanic and Atmospheric Administration

Data Owner Country/Region

United States

Data Owner Industry

Life Science / Healthcare

Website

https://github.com/awslabs/open-data-docs/tree/main/docs/noaa/noaa-goes16

Social Media

https://www.noaa.gov/
https://twitter.com/NOAA

Total amount of DataCap being requested

5PiB

Weekly allocation of DataCap requested

1PiB

On-chain address for first allocation

f1bgxaqwgnrkbwe4wheancxkxf532jlgm4a65gh4y

Data Type of Application

Public, Open Dataset (Research/Non-Profit)

Custom multisig

Identifier

No response

Share a brief history of your project and organization

organization: Yuga was founded in 2019 with core members mainly from Microsoft, AWS and other major leading organizations. Till now we have about 20 employees in Shanghai office. We've been dedicated to building and optimizing industry-leading order encapsulation components for three years, enabling rapid processing and encapsulation of real data, and continuously empowering storage providers and data content providers.

Project: NOAA is an agency that enriches life through science. Our agency holds key leadership roles in shaping international ocean, fisheries, climate, space and weather policies.

Is this project associated with other projects/ecosystem stakeholders?

No

If answered yes, what are the other projects/ecosystem stakeholders

No response

Describe the data being stored onto Filecoin

GOES satellites provide continuous weather imagery and monitoring of meteorological and space environment data across North America.

Where was the data currently stored in this dataset sourced from

AWS Cloud

If you answered "Other" in the previous question, enter the details here

No response

How do you plan to prepare the dataset

lotus

If you answered "other/custom tool" in the previous question, enter the details here

No response

Please share a sample of the data

https://registry.opendata.aws/noaa-goes/

Confirm that this is a public dataset that can be retrieved by anyone on the Network

If you chose not to confirm, what was the reason

No response

What is the expected retrieval frequency for this data

Yearly

For how long do you plan to keep this dataset stored on Filecoin

1.5 to 2 years

In which geographies do you plan on making storage deals

Asia other than Greater China, North America, South America, Europe

How will you be distributing your data to storage providers

Shipping hard drives, Lotus built-in data transfer

How do you plan to choose storage providers

Slack, Filmine, Big data exchange, Partners

If you answered "Others" in the previous question, what is the tool or platform you plan to use

No response

If you already have a list of storage providers to work with, fill out their names and provider IDs below

No response

How do you plan to make deals to your storage providers

Lotus client

If you answered "Others/custom tool" in the previous question, enter the details here

No response

Can you confirm that you will follow the Fil+ guideline

Yes

large-datacap-requests[bot] commented 1 year ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

large-datacap-requests[bot] commented 1 year ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

Sunnyiscoming commented 1 year ago

Datacap Request Trigger

Total DataCap requested

5PiB

Expected weekly DataCap usage rate

1PiB

Client address

f1bgxaqwgnrkbwe4wheancxkxf532jlgm4a65gh4y

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Multisig Notary address

f02049625

Client address

f1bgxaqwgnrkbwe4wheancxkxf532jlgm4a65gh4y

DataCap allocation requested

256TiB

Id

63c89052-7d7a-4bd2-8471-9685e1e10588

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Multisig Notary address

f02049625

Client address

f1bgxaqwgnrkbwe4wheancxkxf532jlgm4a65gh4y

DataCap allocation requested

256TiB

Id

8cb5c66d-ced1-41a7-aeb2-202d25128ade

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report[^1]

No application info found for this issue on https://filplus.d.interplanetary.one/clients.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report[^1]

No application info found for this issue on https://filplus.d.interplanetary.one/clients.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

TakiChain commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacebjwlfdf2fwzjxkh5pz7ynefrlwrn5lsnl4ldygnxyqod54cgzd7g

Address

f1bgxaqwgnrkbwe4wheancxkxf532jlgm4a65gh4y

Datacap Allocated

256.00TiB

Signer Address

f15impf3j2zcaex4lhyxndxswuuhv24vzstuqtxsi

Id

8cb5c66d-ced1-41a7-aeb2-202d25128ade

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebjwlfdf2fwzjxkh5pz7ynefrlwrn5lsnl4ldygnxyqod54cgzd7g

Bennyyangpu commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceayx4cjbi5haa2vppg63gmwrxd5yun4brqpbsf4fnpgkgj2jgjzic

Address

f1bgxaqwgnrkbwe4wheancxkxf532jlgm4a65gh4y

Datacap Allocated

256.00TiB

Signer Address

f174fg3bqbln3zjnkxtyf6s54txqkr7yqkj6cig7y

Id

8cb5c66d-ced1-41a7-aeb2-202d25128ade

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceayx4cjbi5haa2vppg63gmwrxd5yun4brqpbsf4fnpgkgj2jgjzic

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 2

Multisig Notary address

f02049625

Client address

f1bgxaqwgnrkbwe4wheancxkxf532jlgm4a65gh4y

DataCap allocation requested

512TiB

Id

e34cf631-56b2-48ff-92cb-740be251c367

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f02049625

Client address

f1bgxaqwgnrkbwe4wheancxkxf532jlgm4a65gh4y

Rule to calculate the allocation request amount

10% of total dc amount requested

DataCap allocation requested

512TiB

Total DataCap granted for client so far

256TiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

4.75PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
null null 256TiB null 66.31TiB
filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 60.02% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the full report.

Casey-PG commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceaixqomlpicgvn2hjjsukpo745mvmp272n5s4b63wu66pzlumt47c

Address

f1bgxaqwgnrkbwe4wheancxkxf532jlgm4a65gh4y

Datacap Allocated

512.00TiB

Signer Address

f1d4yb3wags3mtddzesxoo63jv7dmlec3bq4yteni

Id

e34cf631-56b2-48ff-92cb-740be251c367

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceaixqomlpicgvn2hjjsukpo745mvmp272n5s4b63wu66pzlumt47c

cryptowhizzard commented 1 year ago

Hi,

I have checked on your application. Can you tell me why you don't follow on the rules of distribution? This application is only in China and needs 3 other continents to be stored on at least.

Scherm­afbeelding 2023-04-12 om 15 08 02

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 3

Multisig Notary address

f02049625

Client address

f1bgxaqwgnrkbwe4wheancxkxf532jlgm4a65gh4y

DataCap allocation requested

1PiB

Id

5c039bfc-e60f-4a7b-ac9a-6a1ae5174732

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f02049625

Client address

f1bgxaqwgnrkbwe4wheancxkxf532jlgm4a65gh4y

Rule to calculate the allocation request amount

20% of total dc amount requested

DataCap allocation requested

1PiB

Total DataCap granted for client so far

465661.3YiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

-5.62B

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
11832 9 512TiB 32.97 133.62TiB
filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 33.95% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the full report.

MEIYAN666 commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacect65n56swti6seuvg2w53tcg3bfcx7v6o7sv72qcjl62ijp6mhzu

Address

f1bgxaqwgnrkbwe4wheancxkxf532jlgm4a65gh4y

Datacap Allocated

1.00PiB

Signer Address

f1bwugfihrmn3iyunzyxst5nttql3dge4khwmurtq

Id

5c039bfc-e60f-4a7b-ac9a-6a1ae5174732

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacect65n56swti6seuvg2w53tcg3bfcx7v6o7sv72qcjl62ijp6mhzu

MEIYAN666 commented 1 year ago

Good summary report and ongoing communication from the applicant. We would like to see more and more useful datasets get onboarded.

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 4

Multisig Notary address

f02049625

Client address

f1bgxaqwgnrkbwe4wheancxkxf532jlgm4a65gh4y

DataCap allocation requested

2PiB

Id

afd297e9-6264-404a-9efa-b8962525c6ba

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f02049625

Client address

f1bgxaqwgnrkbwe4wheancxkxf532jlgm4a65gh4y

Rule to calculate the allocation request amount

40% of total dc amount requested

DataCap allocation requested

2PiB

Total DataCap granted for client so far

931322574615478927360.0YiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

-1.12B

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
38703 15 1PiB 16.05 261.40TiB
Bennyyangpu commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacea6jwf42qepvwbgewjuymlj3ntazgfapih5uhaizsxqga2rzitayc

Address

f1bgxaqwgnrkbwe4wheancxkxf532jlgm4a65gh4y

Datacap Allocated

2.00PiB

Signer Address

f174fg3bqbln3zjnkxtyf6s54txqkr7yqkj6cig7y

Id

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacea6jwf42qepvwbgewjuymlj3ntazgfapih5uhaizsxqga2rzitayc

cryptowhizzard commented 1 year ago

Hi

None of the data stored is retrievable here. Why did you sign this application @Aifabot-Cloud . It is against the FIL+ rules and guidelines.

Secondly the distribution of this application is not OK and not according to the FIL+ rules and guidelines.

@Ehume-Yuga why did you not follow the rules and guidelines of FIL+?

Scherm­afbeelding 2023-05-06 om 19 27 19
TakiChain commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 53.40% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the full report.

TakiChain commented 1 year ago

Hope to improve this indicator of Deal Data Replication in the next few rounds. willing to help onboard more valuable dataset.

TakiChain commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacebh56viorbirku5wlo4en7dydkc4mghf7j6uekwhw6kdd6b4ybjqo

Address

f1bgxaqwgnrkbwe4wheancxkxf532jlgm4a65gh4y

Datacap Allocated

2.00PiB

Signer Address

f15impf3j2zcaex4lhyxndxswuuhv24vzstuqtxsi

Id

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebh56viorbirku5wlo4en7dydkc4mghf7j6uekwhw6kdd6b4ybjqo

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

VincentShii commented 1 year ago

@TakiChain Thank you!

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

VincentShii commented 1 year ago

Keep it open!

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

VincentShii commented 1 year ago

Keep it open!

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

VincentShii commented 1 year ago

keep open

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

VincentShii commented 1 year ago

keep open

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 14 days, so for now it is being closed. Please feel free to contact the Fil+ Gov team to re-open the application if it is still being processed. Thank you!

-- Commented by Stale Bot.

clriesco commented 1 year ago

Removed stale label, reopened issue :)

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 5

Multisig Notary address

f02049625

Client address

f1bgxaqwgnrkbwe4wheancxkxf532jlgm4a65gh4y

DataCap allocation requested

1.25PiB

Id

902bfe3b-43e7-40e3-bd6c-d6a6c71ad9b2

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f02049625

Client address

f1bgxaqwgnrkbwe4wheancxkxf532jlgm4a65gh4y

Rule to calculate the allocation request amount

400% weekly > 2PiB, requesting 2PiB

DataCap allocation requested

1.25PiB

Total DataCap granted for client so far

1.862645149230957e+37YiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

1.862645149230957e+37YiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
44585 16 2PiB 14.19 1.90PiB
cryptowhizzard commented 1 year ago

Hello,

I have downloaded the data but this data is not the data the applicant said he was storing.

Scherm­afbeelding 2023-09-06 om 14 55 36 Scherm­afbeelding 2023-09-06 om 14 57 08

My retrieved sample can be downloaded here:

http://www.datasetcreators.com/downloadedcarfiles/httpretrievals/1849-f02100522-f01122339-36037183-baga6ea4seaqpqruxm7rr3qsvwfdbgorzxh4ienrcalanndysohsamzrc3ffboda

ls -l 1849-f02100522-f01122339-36037183-baga6ea4seaqpqruxm7rr3qsvwfdbgorzxh4ienrcalanndysohsamzrc3ffboda -rw-r--r-- 1 root root 1405729464 Aug 7 08:59 1849-f02100522-f01122339-36037183-baga6ea4seaqpqruxm7rr3qsvwfdbgorzxh4ienrcalanndysohsamzrc3ffboda

Sample done at august 7th . Deal ID 36037183

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

VincentShii commented 1 year ago

Can you check once more? SPs' replies are different with you. There's some error in your program.

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

VincentShii commented 1 year ago

Yes

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

VincentShii commented 1 year ago

Yes

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.