search

filecoin-project / filecoin-plus-large-datasets

Hub for client applications for DataCap at a large scale
110 stars 62 forks source link

[DataCap Application] Brazil data for Drust-Agee #1050

Closed Agee-Drust closed 7 months ago

Agee-Drust commented 1 year ago

Large Dataset Notary Application

To apply for DataCap to onboard your dataset to Filecoin, please fill out the following.

Core Information

Please respond to the questions below by replacing the text saying "Please answer here". Include as much detail as you can in your answer.

Project details

Share a brief history of your project and organization.

I'm a member in Filecoin, but I have ambitious with Filecoin and Filecoin slingshot about ensuring meaningful data is stored and retrieved from the Filecoin Network.

What is the primary source of funding for this project?

My own source.

What other projects/ecosystem stakeholders is this project associated with?

No

Use-case details

Describe the data being stored onto Filecoin

Earth Observation Data Cubes for Brazil - Sentinel 2A/2B Earth Observation Data Cubes for Brazil - CBERS 4
Notifications for new EO Data Cubes Sentinel-2 scenes
Notifications for new EO Data Cubes CBERS scenes

Where was the data in this dataset sourced from?

The data is from AWS Open dataset.

Can you share a sample of the data? A link to a file, an image, a table, etc., are good ways to do this. 

https://registry.opendata.aws/brazil-data-cubes/

Confirm that this is a public dataset that can be retrieved by anyone on the Network (i.e., no specific permissions or access rights are required to view the data).

I confirm. This is a open dataset.

What is the expected retrieval frequency for this data?

Follow LDN Application rules. 1-2 times half a year.

For how long do you plan to keep this dataset stored on Filecoin?

More than 1 year.

DataCap allocation plan

In which geographies (countries, regions) do you plan on making storage deals?

All regions.

How will you be distributing your data to storage providers? Is there an offline data transfer process?

After CAR files are ready, I will upload it to the server for SP, or I will prepare disks. Then I will propose offline deals after they get files.

How do you plan on choosing the storage providers with whom you will be making deals? This should include a plan to ensure the data is retrievable in the future both by you and others.

I plan to make deals with SPs that support data retrieval and have stable sealing rate. Also, I welcome every one who are interested with this deal.

How will you be distributing deals across storage providers?

Try to make every SP under 25% of deals.

Do you have the resources/funding to start making deals as soon as you receive DataCap? What support from the community would help you onboard onto Filecoin?

Enough.
large-datacap-requests[bot] commented 1 year ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

raghavrmadya commented 1 year ago

Who are the SPs you have reached out/plan to store? Please share IDs

Agee-Drust commented 1 year ago

@raghavrmadya Hi, I've been in touch with SPs in USA, Korea, Sinapore, Japan. f01895783, f01917257, f01917241, f01924325

simonkim0515 commented 1 year ago

Datacap Request Trigger

Total DataCap requested

5PiB

Expected weekly DataCap usage rate

100TiB

Client address

f1xskwjewhafb6db23zrhh2uok4kxitcr47acwhgi

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Multisig Notary address

f01858410

Client address

f1xskwjewhafb6db23zrhh2uok4kxitcr47acwhgi

DataCap allocation requested

50TiB

Id

4a12738c-fc7a-4535-8f1d-5b306e14966e

Sunnyiscoming commented 1 year ago

Is there any problem with using datacap?

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 2

Multisig Notary address

f02049625

Client address

f1xskwjewhafb6db23zrhh2uok4kxitcr47acwhgi

DataCap allocation requested

100TiB

Id

feb9ecba-bcd3-4ee9-8fe4-8d2e977f0592

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f1xskwjewhafb6db23zrhh2uok4kxitcr47acwhgi

Rule to calculate the allocation request amount

100% of weekly dc amount requested

DataCap allocation requested

100TiB

Total DataCap granted for client so far

50TiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

4.95PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
466 2 50TiB 96.14 14.75TiB
Casey-PG commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacebejgjatrlf6j7a6ehkszacfzq2l24be5ucyhm4n4j6wkavtxy4mg

Address

f1xskwjewhafb6db23zrhh2uok4kxitcr47acwhgi

Datacap Allocated

100.00TiB

Signer Address

f1d4yb3wags3mtddzesxoo63jv7dmlec3bq4yteni

Id

feb9ecba-bcd3-4ee9-8fe4-8d2e977f0592

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebejgjatrlf6j7a6ehkszacfzq2l24be5ucyhm4n4j6wkavtxy4mg

Suyanj commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacec4iktic2ku7ydnsabdm2j2ablw27xdwedhtlhwfmohcqitllclvo

Address

f1xskwjewhafb6db23zrhh2uok4kxitcr47acwhgi

Datacap Allocated

100.00TiB

Signer Address

f1ihv7gz3vn3xqvikpt4rwryecgisl7745lodx3yi

Id

feb9ecba-bcd3-4ee9-8fe4-8d2e977f0592

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacec4iktic2ku7ydnsabdm2j2ablw27xdwedhtlhwfmohcqitllclvo

Suyanj commented 1 year ago

Public data with clear allocation plan, we are willing to help onboard more valuable dataset.

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 3

Multisig Notary address

f02049625

Client address

f1xskwjewhafb6db23zrhh2uok4kxitcr47acwhgi

DataCap allocation requested

200TiB

Id

2a68a6b8-9c73-450c-bf1d-c578651b5132

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f02049625

Client address

f1xskwjewhafb6db23zrhh2uok4kxitcr47acwhgi

Rule to calculate the allocation request amount

200% of weekly dc amount requested

DataCap allocation requested

200TiB

Total DataCap granted for client so far

9094.9YiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

9094.9YiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
2187 3 100TiB 43.98 26.87TiB
Casey-PG commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacedjb5p65vpbto7qw5l3rowmgtdzlh62arq2eajysmvlcrqnkxlbhu

Address

f1xskwjewhafb6db23zrhh2uok4kxitcr47acwhgi

Datacap Allocated

200.00TiB

Signer Address

f1d4yb3wags3mtddzesxoo63jv7dmlec3bq4yteni

Id

2a68a6b8-9c73-450c-bf1d-c578651b5132

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedjb5p65vpbto7qw5l3rowmgtdzlh62arq2eajysmvlcrqnkxlbhu

AthSmith commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacebboeaphadvvlvms5s2tbgn7s6rzzguzy2xxak2bczomlgy2ndpog

Address

f1xskwjewhafb6db23zrhh2uok4kxitcr47acwhgi

Datacap Allocated

200.00TiB

Signer Address

f1vxbqrf7rfum3n6m5u6eb4re6xj7amvsaqnzu64y

Id

2a68a6b8-9c73-450c-bf1d-c578651b5132

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebboeaphadvvlvms5s2tbgn7s6rzzguzy2xxak2bczomlgy2ndpog

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 4

Multisig Notary address

f02049625

Client address

f1xskwjewhafb6db23zrhh2uok4kxitcr47acwhgi

DataCap allocation requested

400TiB

Id

4208a145-2fb8-4c21-bcc0-b3197edf9379

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f02049625

Client address

f1xskwjewhafb6db23zrhh2uok4kxitcr47acwhgi

Rule to calculate the allocation request amount

400% of weekly dc amount requested

DataCap allocation requested

400TiB

Total DataCap granted for client so far

18189894035458574336.0YiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

18189894035458574336.0YiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
7330 6 200TiB 32.06 46TiB
github-actions[bot] commented 12 months ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

MEIYAN666 commented 11 months ago

checker:manualTrigger

filplus-checker-app[bot] commented 11 months ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 65.82% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

MEIYAN666 commented 11 months ago

image

MEIYAN666 commented 11 months ago

LGTM, should pay attention to Deal Data Replication in the next round. willing to support! @Agee-Drust

MEIYAN666 commented 11 months ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacecdet7zyttjeqr6cb62tesvekit673enrtdujpzqh2s3gjao46z6k

Address

f1xskwjewhafb6db23zrhh2uok4kxitcr47acwhgi

Datacap Allocated

400.00TiB

Signer Address

f1bwugfihrmn3iyunzyxst5nttql3dge4khwmurtq

Id

4208a145-2fb8-4c21-bcc0-b3197edf9379

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecdet7zyttjeqr6cb62tesvekit673enrtdujpzqh2s3gjao46z6k

TakiChain commented 11 months ago

It's good to see that the data is indeed improving all the time, and hope it continues to do so!

TakiChain commented 11 months ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaced2hsh4rddih6ecjdnyecebowegfj3g2wp3b6dm76iccibmg5oi4y

Address

f1xskwjewhafb6db23zrhh2uok4kxitcr47acwhgi

Datacap Allocated

400.00TiB

Signer Address

f15impf3j2zcaex4lhyxndxswuuhv24vzstuqtxsi

Id

4208a145-2fb8-4c21-bcc0-b3197edf9379

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaced2hsh4rddih6ecjdnyecebowegfj3g2wp3b6dm76iccibmg5oi4y

github-actions[bot] commented 11 months ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

large-datacap-requests[bot] commented 11 months ago

DataCap Allocation requested

Request number 5

Multisig Notary address

f02049625

Client address

f1xskwjewhafb6db23zrhh2uok4kxitcr47acwhgi

DataCap allocation requested

400TiB

Id

8c974cbb-807a-4cc7-8bb3-9803d4cb46df

large-datacap-requests[bot] commented 11 months ago

Stats & Info for DataCap Allocation

Multisig Notary address

f02049625

Client address

f1xskwjewhafb6db23zrhh2uok4kxitcr47acwhgi

Rule to calculate the allocation request amount

400% of weekly dc amount requested

DataCap allocation requested

400TiB

Total DataCap granted for client so far

3.637978807091715e+34YiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

3.637978807091715e+34YiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
17485 10 400TiB 19.83 61.46TiB
Wengeding commented 11 months ago

checker:manualTrigger

filplus-checker-app[bot] commented 11 months ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 82.64% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

Wengeding commented 11 months ago

So far the report looks good, we'll keep tracking the datacap allocation flow.

Wengeding commented 11 months ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacecsa22apyycrpm2lrou2x6lhxrsu7bt2yelkkijkqj75typ53j4h6

Address

f1xskwjewhafb6db23zrhh2uok4kxitcr47acwhgi

Datacap Allocated

400.00TiB

Signer Address

f1txfsjmix4vlzido4dkildrnbw26owtlbslexmpa

Id

8c974cbb-807a-4cc7-8bb3-9803d4cb46df

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecsa22apyycrpm2lrou2x6lhxrsu7bt2yelkkijkqj75typ53j4h6

BobbyChoii commented 11 months ago

Based on the chat history and fellow notaries' reviews, I would like to help this application moving forward as your report is normal.

BobbyChoii commented 11 months ago

checker:manualTrigger

filplus-checker-app[bot] commented 11 months ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 84.02% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

BobbyChoii commented 11 months ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacecryiejipbnnoas5u4k5bvk7kifodv7ewmi4kcm5iveo7jt3n6w5y

Address

f1xskwjewhafb6db23zrhh2uok4kxitcr47acwhgi

Datacap Allocated

400.00TiB

Signer Address

f1irqs2gmctiv3jcdfwuch7oxvf4ixh3k4b2wc24i

Id

8c974cbb-807a-4cc7-8bb3-9803d4cb46df

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecryiejipbnnoas5u4k5bvk7kifodv7ewmi4kcm5iveo7jt3n6w5y

large-datacap-requests[bot] commented 11 months ago

DataCap Allocation requested

Request number 6

Multisig Notary address

f02049625

Client address

f1xskwjewhafb6db23zrhh2uok4kxitcr47acwhgi

DataCap allocation requested

400TiB

Id

783e1e74-3405-4ba8-8f9f-3f1118d3762d

large-datacap-requests[bot] commented 11 months ago

Stats & Info for DataCap Allocation

Multisig Notary address

f02049625

Client address

f1xskwjewhafb6db23zrhh2uok4kxitcr47acwhgi

Rule to calculate the allocation request amount

400% of weekly dc amount requested

DataCap allocation requested

400TiB

Total DataCap granted for client so far

3.6379788070917164e+49YiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

3.6379788070917164e+49YiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
23849 13 400TiB 16.23 104TiB
github-actions[bot] commented 10 months ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

Agee-Drust commented 10 months ago

Keep open!

github-actions[bot] commented 10 months ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

Agee-Drust commented 9 months ago

Keep open!

Casey-PG commented 9 months ago

checker:manualTrigger

filplus-checker-app[bot] commented 9 months ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 63.29% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

Casey-PG commented 9 months ago

Deal Data Replication should be improved. The other scores are accepted.

Casey-PG commented 9 months ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacecp7o3qm7o2snquomxjrn2bhyxmexndbe3yqzvidur4ddtyjkfcny

Address

f1xskwjewhafb6db23zrhh2uok4kxitcr47acwhgi

Datacap Allocated

400.00TiB

Signer Address

f1d4yb3wags3mtddzesxoo63jv7dmlec3bq4yteni

Id

783e1e74-3405-4ba8-8f9f-3f1118d3762d

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecp7o3qm7o2snquomxjrn2bhyxmexndbe3yqzvidur4ddtyjkfcny

github-actions[bot] commented 9 months ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

Bennyyangpu commented 9 months ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacedoegrnltxfrd2cyx2dsehsenvbzpzsknkl33ogc6m4n63wy3wmn2

Address

f1xskwjewhafb6db23zrhh2uok4kxitcr47acwhgi

Datacap Allocated

400.00TiB

Signer Address

f174fg3bqbln3zjnkxtyf6s54txqkr7yqkj6cig7y

Id

783e1e74-3405-4ba8-8f9f-3f1118d3762d

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedoegrnltxfrd2cyx2dsehsenvbzpzsknkl33ogc6m4n63wy3wmn2

PluskitOfficial commented 9 months ago

Looks good. Willing to support.

PluskitOfficial commented 9 months ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceb2tjsupwf7m2hnln4usei6ptph6cotr5jiob2wdhiy57fkksq2kq

Address

f1xskwjewhafb6db23zrhh2uok4kxitcr47acwhgi

Datacap Allocated

400.00TiB

Signer Address

f1tgnlhtcmhwipfm7thsftxhn5k52velyjlazpvka

Id

783e1e74-3405-4ba8-8f9f-3f1118d3762d

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceb2tjsupwf7m2hnln4usei6ptph6cotr5jiob2wdhiy57fkksq2kq