filecoin-project / filecoin-plus-large-datasets

Hub for client applications for DataCap at a large scale
110 stars 62 forks source link

[DataCap Application] < Edwardext> - <Sentinel-1 SLC dataset for South and Southeast Asia, Taiwan, Korea and Japan> #1841

Open edwardext opened 1 year ago

edwardext commented 1 year ago

Data Owner Name

European Space Agency

Data Owner Country/Region

France

Data Owner Industry

Environment

Website

https://www.esa.int/

Social Media

https://www.facebook.com/EuropeanSpac
https://www.youtube.com/user/ESA

Total amount of DataCap being requested

5PiB

Weekly allocation of DataCap requested

400TiB

On-chain address for first allocation

f13zrk4biqmbjdg4y2675aoqpb6d3tktjce32346y

Data Type of Application

None

Custom multisig

Identifier

No response

Share a brief history of your project and organization

I am a researcher and developer in blockchain technology.        
In 2020, I participated in the Filecoin Space Race as a member of the technical support team, providing technical assistance to other service providers (SPs).       
I am deeply interested in Filecoin's complex storage system and have a deep understanding of mining technology, as well as extensive industry experience.        
Through system optimization, hardware matching optimization, and process optimization, I have developed a mining system based on Lotus that is suitable for large-scale production.
I have a team of three developers in China, and we are currently developing an ecosystem application based on FVM.
Based on my recognition of Filecoin's valid data, I would like to provide the public dataset as valid data storage and recommend it to SPs that I know or work with.
I will supervise and guide my collaborating SPs to strictly follow the valid data  encapsulating rules established by the community.

Is this project associated with other projects/ecosystem stakeholders?

Yes

If answered yes, what are the other projects/ecosystem stakeholders

I participate in the application of the public dataset:#1827

Describe the data being stored onto Filecoin

The S1 Single Look Complex dataset is a collection of Synthetic Aperture Radar data in the C-Band wavelength gathered by SAR sensors on Sentinel-1A and Sentinel-1B, two satellites orbiting the Earth a combination revisit time of six days, operated by the European Space Agency.  The data provides radar amplitude and phase information ideal for studying natural hazards and emergency response, land applications, oil spill monitoring, sea-ice conditions, and associated climate change effects.

Where was the data currently stored in this dataset sourced from

AWS Cloud

If you answered "Other" in the previous question, enter the details here

No response

How do you plan to prepare the dataset

others/custom tool

If you answered "other/custom tool" in the previous question, enter the details here

Self-developed packing tool

Please share a sample of the data

https://registry.opendata.aws/sentinel1-slc-seasia-pds/
s3://sentinel1-slc-seasia-pds/

Confirm that this is a public dataset that can be retrieved by anyone on the Network

If you chose not to confirm, what was the reason

No response

What is the expected retrieval frequency for this data

Sporadic

For how long do you plan to keep this dataset stored on Filecoin

1 to 1.5 years

In which geographies do you plan on making storage deals

Greater China, Asia other than Greater China, Africa, North America, South America, Europe, Australia (continent), Antarctica

How will you be distributing your data to storage providers

HTTP or FTP server, IPFS, Shipping hard drives, Others

How do you plan to choose storage providers

Slack, Partners

If you answered "Others" in the previous question, what is the tool or platform you plan to use

No response

If you already have a list of storage providers to work with, fill out their names and provider IDs below

f01980952 CN
f01943941 CN
f0150816 CN
f02031264 SGP
f02052244 US
f02052252 US

How do you plan to make deals to your storage providers

Lotus client

If you answered "Others/custom tool" in the previous question, enter the details here

No response

Can you confirm that you will follow the Fil+ guideline

Yes

large-datacap-requests[bot] commented 1 year ago

Thanks for your request!

Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!
large-datacap-requests[bot] commented 1 year ago

Thanks for your request!

Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!
large-datacap-requests[bot] commented 1 year ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

large-datacap-requests[bot] commented 1 year ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

Sunnyiscoming commented 1 year ago

Datacap Request Trigger

Total DataCap requested

5PiB

Expected weekly DataCap usage rate

400TiB

Client address

f13zrk4biqmbjdg4y2675aoqpb6d3tktjce32346y

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Multisig Notary address

f02049625

Client address

f13zrk4biqmbjdg4y2675aoqpb6d3tktjce32346y

DataCap allocation requested

200TiB

Id

8514171b-ebaa-4493-90fe-db0003024b57

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Multisig Notary address

f02049625

Client address

f13zrk4biqmbjdg4y2675aoqpb6d3tktjce32346y

DataCap allocation requested

200TiB

Id

ca5a5458-9ba7-4730-be91-99669426af9b

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report[^1]

No application info found for this issue on https://filplus.d.interplanetary.one/clients.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report[^1]

No application info found for this issue on https://filplus.d.interplanetary.one/clients.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

DirectionTechnology commented 1 year ago

Continuous public dataset application. I will keep track of your subsequent allocation and encapsulating.

DirectionTechnology commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacebnoqndhtb22zv6eioyx3bkaafuskmrbugqmkluspbxvq6kgqre5i

Address

f13zrk4biqmbjdg4y2675aoqpb6d3tktjce32346y

Datacap Allocated

200.00TiB

Signer Address

f1inkdoatsbfumdvpctxbgcatscewr3rus5pxmsgi

Id

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebnoqndhtb22zv6eioyx3bkaafuskmrbugqmkluspbxvq6kgqre5i

TimGuo7 commented 1 year ago

looks awesome and happy to support.

TimGuo7 commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacedu2l3tz5tyem3ibv2upsyfhh7vv34n4ac2mtv5wsmao6eeh2qjkc

Address

f13zrk4biqmbjdg4y2675aoqpb6d3tktjce32346y

Datacap Allocated

200.00TiB

Signer Address

f1yslbnnqzrjlyuxsmyxfbqcc7xthcavgpripjevi

Id

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedu2l3tz5tyem3ibv2upsyfhh7vv34n4ac2mtv5wsmao6eeh2qjkc

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 2

Multisig Notary address

f02049625

Client address

f13zrk4biqmbjdg4y2675aoqpb6d3tktjce32346y

DataCap allocation requested

400TiB

Id

f5142099-87df-4824-8c5b-f78bb50b2928

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f02049625

Client address

f13zrk4biqmbjdg4y2675aoqpb6d3tktjce32346y

Rule to calculate the allocation request amount

100% of weekly dc amount requested

DataCap allocation requested

400TiB

Total DataCap granted for client so far

200TiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

4.80PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
942 1 200TiB 100 49.81TiB
filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

⚠️ 1 storage providers sealed more than 50% of total datacap - f02031264: 100.00%

⚠️ All storage providers are located in the same region.

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the full report.

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

⚠️ 1 storage providers sealed more than 50% of total datacap - f02031264: 100.00%

⚠️ All storage providers are located in the same region.

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the full report.

edwardext commented 1 year ago

There was only one node encapsulate in the first round, which was due to inconsistent SP speeds because of data transfer and device preparation. In the early stages, this was acceptable. In the next round , other SPs will gradually join to ensure that the overall encapsulation process follows the rules.

NewHuoPool commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacebhsofjy5wwmzibinf4ej4pdcllm2kwmgf22ftgnfu5hdjsj4omio

Address

f13zrk4biqmbjdg4y2675aoqpb6d3tktjce32346y

Datacap Allocated

400.00TiB

Signer Address

f16karfxq7lxdy7izqrzrk75jf3not34k6sg6zvcy

Id

f5142099-87df-4824-8c5b-f78bb50b2928

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebhsofjy5wwmzibinf4ej4pdcllm2kwmgf22ftgnfu5hdjsj4omio

Tom-OriginStorage commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

⚠️ 1 storage providers sealed more than 50% of total datacap - f02031264: 100.00%

⚠️ All storage providers are located in the same region.

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the full report.

Tom-OriginStorage commented 1 year ago

Communicate with applicants that there will be new SPs joining in the second round, and will continue to pay attention to the new SPs joining situation

Tom-OriginStorage commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacebzmzzxjmb2qxr6bcis2bzb5up4tcinwyo4lke6kqtdbcmouxtnfi

Address

f13zrk4biqmbjdg4y2675aoqpb6d3tktjce32346y

Datacap Allocated

400.00TiB

Signer Address

f1q6bpjlqia6iemqbrdaxr2uehrhpvoju3qh4lpga

Id

f5142099-87df-4824-8c5b-f78bb50b2928

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebzmzzxjmb2qxr6bcis2bzb5up4tcinwyo4lke6kqtdbcmouxtnfi

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 14 days, so for now it is being closed. Please feel free to re-open if this is relevant, or start a new application for DataCap anytime. Thank you!

edwardext commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the full report.

edwardext commented 1 year ago

We are currently storing this project, and the report can explain everything. Can we reopen it? @fabriziogianni7 @simonkim0515 @panges2

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 2

Multisig Notary address

f02049625

Client address

f13zrk4biqmbjdg4y2675aoqpb6d3tktjce32346y

DataCap allocation requested

400TiB

Id

63d97bf2-6367-4967-a2e0-e87c47b22170

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f02049625

Client address

f13zrk4biqmbjdg4y2675aoqpb6d3tktjce32346y

Rule to calculate the allocation request amount

100% of weekly dc amount requested

DataCap allocation requested

400TiB

Total DataCap granted for client so far

200TiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

4.80PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
9600 4 200TiB 33.32 0B
github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

edwardext commented 1 year ago

Things are progressing as planned.

liyunzhi-666 commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

⚠️ 1 storage providers sealed more than 30% of total datacap - f02031264: 33.41%

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the full report.

liyunzhi-666 commented 1 year ago

⚠️ 1 storage providers sealed more than 30% of total datacap - f02031264: 33.41% @edwardext Please heed this warning. You can add an SP to participate in this project.

I did some retrieval and it worked. I can support this round.https://filecoin.tools/f02052252 9d7983f695b248586253550ae7fcc14

liyunzhi-666 commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacecctraffnhol4jjn5hi7dkbjiga4dgodfkvwyczntwof37icxbwoe

Address

f13zrk4biqmbjdg4y2675aoqpb6d3tktjce32346y

Datacap Allocated

400.00TiB

Signer Address

f1pszcrsciyixyuxxukkvtazcokexbn54amf7gvoq

Id

63d97bf2-6367-4967-a2e0-e87c47b22170

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecctraffnhol4jjn5hi7dkbjiga4dgodfkvwyczntwof37icxbwoe

AlanGreaterheat commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

⚠️ 1 storage providers sealed more than 30% of total datacap - f02031264: 33.41%

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the full report.

AlanGreaterheat commented 1 year ago

fast retrieval is ok,willing to support.

image
AlanGreaterheat commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacecrsuep2bxfqn7hye3dkan7xc3mi6lm4fgz3tplllcfbfnok4jr42

Address

f13zrk4biqmbjdg4y2675aoqpb6d3tktjce32346y

Datacap Allocated

400.00TiB

Signer Address

f1pnmzlxj7cfeo2v6oj5nco46hkg2l46wj7o4xxui

Id

63d97bf2-6367-4967-a2e0-e87c47b22170

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecrsuep2bxfqn7hye3dkan7xc3mi6lm4fgz3tplllcfbfnok4jr42

edwardext commented 1 year ago

Please heed this warning. You can add an SP to participate in this project.

@liyunzhi-666 Thank you for the reminder. With the successive joining of SPs, storage will be more decentralized.

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

edwardext commented 1 year ago

We are communicating with new SPs

edwardext commented 1 year ago

Communicating with new SPs

edwardext commented 1 year ago

Update

edwardext commented 1 year ago

Ongoing

github-actions[bot] commented 11 months ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

edwardext commented 11 months ago

Ongoing

edwardext commented 11 months ago

Ongoing

edwardext commented 11 months ago

Ongoing

large-datacap-requests[bot] commented 10 months ago

DataCap Allocation requested

Request number 3

Multisig Notary address

f02049625

Client address

f13zrk4biqmbjdg4y2675aoqpb6d3tktjce32346y

DataCap allocation requested

800TiB

Id

baf50e52-546e-406f-9315-337880178eed