search

filecoin-project / filecoin-plus-large-datasets

Hub for client applications for DataCap at a large scale
110 stars 62 forks source link

[DataCap Application] Teerafusion for Drust-Agee #1023

Closed Agee-Drust closed 7 months ago

Agee-Drust commented 1 year ago

Large Dataset Notary Application

To apply for DataCap to onboard your dataset to Filecoin, please fill out the following.

Core Information

Please respond to the questions below by replacing the text saying "Please answer here". Include as much detail as you can in your answer.

Project details

Share a brief history of your project and organization.

I‘m a member in Filecoin, but I have ambitious with Filecoin and Filecoin slingshot about ensuring meaningful data is stored and retrieved from the Filecoin Network.

What is the primary source of funding for this project?

My own source.

What other projects/ecosystem stakeholders is this project associated with?

Slingshot.

Use-case details

Describe the data being stored onto Filecoin

The Terra Basic Fusion dataset is a fused dataset of the original Level 1 radiances from the five Terra instruments. They have been fully validate to contain the original Terra instrument Level 1 data.

Where was the data in this dataset sourced from?

AWS S3 Public Bucket Containing Terra Basic Fusion Hierarchical Data Format 5 (HDF5) files.

Can you share a sample of the data? A link to a file, an image, a table, etc., are good ways to do this. 

aws s3 ls --no-sign-request s3://terrafusiondatasampler/

Confirm that this is a public dataset that can be retrieved by anyone on the Network (i.e., no specific permissions or access rights are required to view the data).

I confirm. This is a open dataset.

What is the expected retrieval frequency for this data?

Follow LDN Application rules. 1-2 times half a year.

For how long do you plan to keep this dataset stored on Filecoin?

More than 2 year.

DataCap allocation plan

In which geographies (countries, regions) do you plan on making storage deals?

All regions, especially SPs in Asia.

How will you be distributing your data to storage providers? Is there an offline data transfer process?

After CAR files are ready, I will upload it to the server for SP, or I will prepare disks. Then I will propose offline deals after they get files.

How do you plan on choosing the storage providers with whom you will be making deals? This should include a plan to ensure the data is retrievable in the future both by you and others.

I plan to make deals with SPs that support data retrieval and have stable sealing rate. Also, I welcome every one who are interested with this deal.

How will you be distributing deals across storage providers?

Try to make every SP under 25% of deals.

Do you have the resources/funding to start making deals as soon as you receive DataCap? What support from the community would help you onboard onto Filecoin?

Enough.
large-datacap-requests[bot] commented 1 year ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

large-datacap-requests[bot] commented 1 year ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

simonkim0515 commented 1 year ago

Datacap Request Trigger

Total DataCap requested

5PiB

Expected weekly DataCap usage rate

100TiB

Client address

f14dn4r33t7gybigxqb6g6osdn4dwrr6rb27tdo6a

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Multisig Notary address

f01858410

Client address

f14dn4r33t7gybigxqb6g6osdn4dwrr6rb27tdo6a

DataCap allocation requested

50TiB

Id

80de6a91-b05d-4cbf-b9d7-4d80f9f8a387

Sunnyiscoming commented 1 year ago

Is there any problem with using datacap?

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 2

Multisig Notary address

f02049625

Client address

f14dn4r33t7gybigxqb6g6osdn4dwrr6rb27tdo6a

DataCap allocation requested

100TiB

Id

2c4625ee-0a25-4ff4-b7a2-ac22291e3d3f

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f14dn4r33t7gybigxqb6g6osdn4dwrr6rb27tdo6a

Rule to calculate the allocation request amount

100% of weekly dc amount requested

DataCap allocation requested

100TiB

Total DataCap granted for client so far

50TiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

4.95PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
0 0 50TiB NaN 11.46TiB
Bennyyangpu commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the full report.

Bennyyangpu commented 1 year ago

The client followed the allocation plan as planned, good report is all dimensions. Keep it up!

Bennyyangpu commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacedpyaeh4pnbie5wyeypywuddnp7plqgrleypyh2inluawzunx74uu

Address

f14dn4r33t7gybigxqb6g6osdn4dwrr6rb27tdo6a

Datacap Allocated

100.00TiB

Signer Address

f174fg3bqbln3zjnkxtyf6s54txqkr7yqkj6cig7y

Id

2c4625ee-0a25-4ff4-b7a2-ac22291e3d3f

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedpyaeh4pnbie5wyeypywuddnp7plqgrleypyh2inluawzunx74uu

TakiChain commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceahatqa3wxzceevwqbdacpjrtkfywyx5eokcg24zivkejqfxvo74c

Address

f14dn4r33t7gybigxqb6g6osdn4dwrr6rb27tdo6a

Datacap Allocated

100.00TiB

Signer Address

f15impf3j2zcaex4lhyxndxswuuhv24vzstuqtxsi

Id

2c4625ee-0a25-4ff4-b7a2-ac22291e3d3f

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceahatqa3wxzceevwqbdacpjrtkfywyx5eokcg24zivkejqfxvo74c

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 3

Multisig Notary address

f02049625

Client address

f14dn4r33t7gybigxqb6g6osdn4dwrr6rb27tdo6a

DataCap allocation requested

200TiB

Id

72bd0205-b505-43ab-afda-33764f4e1359

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f02049625

Client address

f14dn4r33t7gybigxqb6g6osdn4dwrr6rb27tdo6a

Rule to calculate the allocation request amount

200% of weekly dc amount requested

DataCap allocation requested

200TiB

Total DataCap granted for client so far

9094.9YiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

9094.9YiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
1920 2 100TiB 63.33 29TiB
github-actions[bot] commented 12 months ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

Suyanj commented 11 months ago

checker:manualTrigger

filplus-checker-app[bot] commented 11 months ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 66.49% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

Suyanj commented 11 months ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceahsdgqmmll6y3l2hjzmsfc7klnoouh2nhhhqsx4cldxcufsvbkga

Address

f14dn4r33t7gybigxqb6g6osdn4dwrr6rb27tdo6a

Datacap Allocated

200.00TiB

Signer Address

f1ihv7gz3vn3xqvikpt4rwryecgisl7745lodx3yi

Id

72bd0205-b505-43ab-afda-33764f4e1359

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceahsdgqmmll6y3l2hjzmsfc7klnoouh2nhhhqsx4cldxcufsvbkga

Suyanj commented 11 months ago

LGTM, but should improve the Deal Data Replication in the next round.

github-actions[bot] commented 11 months ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

AthSmith commented 11 months ago

checker:manualTrigger

filplus-checker-app[bot] commented 11 months ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 66.49% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

AthSmith commented 11 months ago

CID checker ok, retrieval can be done. Willing to support!

AthSmith commented 11 months ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceamsdubssiofxqpfkvpbl23bpiz5vgpnifk2jxbeax43h6i4qn2ei

Address

f14dn4r33t7gybigxqb6g6osdn4dwrr6rb27tdo6a

Datacap Allocated

200.00TiB

Signer Address

f1vxbqrf7rfum3n6m5u6eb4re6xj7amvsaqnzu64y

Id

72bd0205-b505-43ab-afda-33764f4e1359

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceamsdubssiofxqpfkvpbl23bpiz5vgpnifk2jxbeax43h6i4qn2ei

Agee-Drust commented 10 months ago

Thanks for notaries' support.

github-actions[bot] commented 10 months ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

Agee-Drust commented 10 months ago

Keep open!

github-actions[bot] commented 10 months ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

Agee-Drust commented 9 months ago

Keep open!

github-actions[bot] commented 9 months ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

Agee-Drust commented 9 months ago

Keep open!

large-datacap-requests[bot] commented 9 months ago

DataCap Allocation requested

Request number 3

Multisig Notary address

f02049625

Client address

f14dn4r33t7gybigxqb6g6osdn4dwrr6rb27tdo6a

DataCap allocation requested

200TiB

Id

44e1784c-3dab-4a65-93b2-35b7143810a1

PluskitOfficial commented 9 months ago

checker:manualTrigger

filplus-checker-app[bot] commented 9 months ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 85.60% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

PluskitOfficial commented 9 months ago

Looks good. Willing to support.

PluskitOfficial commented 9 months ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacedq2cbzkxa5jbzutomms7x5k7v5cslhglrowqxk2e6zzredphhfjw

Address

f14dn4r33t7gybigxqb6g6osdn4dwrr6rb27tdo6a

Datacap Allocated

200.00TiB

Signer Address

f1tgnlhtcmhwipfm7thsftxhn5k52velyjlazpvka

Id

44e1784c-3dab-4a65-93b2-35b7143810a1

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedq2cbzkxa5jbzutomms7x5k7v5cslhglrowqxk2e6zzredphhfjw

MatrixStorage commented 9 months ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceahqjpjcyfzhf7ub6lyaxffdhisdlwlcmltmmuq7sbnq4lujh3m3a

Address

f14dn4r33t7gybigxqb6g6osdn4dwrr6rb27tdo6a

Datacap Allocated

200.00TiB

Signer Address

f1tbxqwjxfyv7swsdin4einirlsfquv3vnmlapley

Id

44e1784c-3dab-4a65-93b2-35b7143810a1

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceahqjpjcyfzhf7ub6lyaxffdhisdlwlcmltmmuq7sbnq4lujh3m3a

large-datacap-requests[bot] commented 9 months ago

DataCap Allocation requested

Request number 4

Multisig Notary address

f02049625

Client address

f14dn4r33t7gybigxqb6g6osdn4dwrr6rb27tdo6a

DataCap allocation requested

400TiB

Id

ac046d60-9d38-4f27-8b56-92f2644c05da

Bennyyangpu commented 8 months ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacecv7zrjnx7422kcn65k4bw2mjf7yvqtrcee3ezgw667kmtr6vtcxy

Address

f14dn4r33t7gybigxqb6g6osdn4dwrr6rb27tdo6a

Datacap Allocated

400.00TiB

Signer Address

f174fg3bqbln3zjnkxtyf6s54txqkr7yqkj6cig7y

Id

ac046d60-9d38-4f27-8b56-92f2644c05da

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecv7zrjnx7422kcn65k4bw2mjf7yvqtrcee3ezgw667kmtr6vtcxy

Wengeding commented 8 months ago

LGTM, willing to support!

Wengeding commented 8 months ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacec24abzgm2tn4npxqifolyssrn7xneqbgc2olzyigcdmfl4day2oi

Address

f14dn4r33t7gybigxqb6g6osdn4dwrr6rb27tdo6a

Datacap Allocated

400.00TiB

Signer Address

f1txfsjmix4vlzido4dkildrnbw26owtlbslexmpa

Id

ac046d60-9d38-4f27-8b56-92f2644c05da

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacec24abzgm2tn4npxqifolyssrn7xneqbgc2olzyigcdmfl4day2oi

kevzak commented 8 months ago

Hello @Agee-Drust per the https://github.com/filecoin-project/notary-governance/issues/922 for Open, Public Dataset applicants, please complete the following Fil+ registration form to identify yourself as the applicant and also please add the contact information of the SP entities you are working with to store copies of the data.

This information will be reviewed by Fil+ Governance team to confirm validity and then the application will be allowed to move forward for additional notary review.

github-actions[bot] commented 8 months ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

Agee-Drust commented 8 months ago

@kevzak Hi, I submitted this form just now. Please check it.

kevzak commented 8 months ago

f01879772 | Ronald | HongKong | f02368314 | Barry | Deyang, Sichuan, CN | f01084913 | Bill | HongKong | f01452388 | Sheldon | Hangzhou, Zhejiang, CN | f0148494 | Amy | Sham Shui Po |

herrehesse commented 8 months ago

Screenshot 2023-11-14 at 10 00 04

Entity is self-dealing, SP reputation is as bad as it goes, owner wallets are the same.

Close this LDN immediately @kevzak

Sunnyiscoming commented 8 months ago

checker:manualTrigger

filplus-checker-app[bot] commented 8 months ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 48.16% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard.

Sunnyiscoming commented 7 months ago

@Agee-Drust More sps participated in datacap storage. Closing until all SP ID list, entity and location is provided.

large-datacap-requests[bot] commented 6 months ago

Thanks for your request! :exclamation: We have found some problems in the information provided. We could not find Website \/ Social Media field in the information provided We could not find Total amount of DataCap being requested (between 500 TiB and 5 PiB) field in the information provided We could not find Weekly allocation of DataCap requested (usually between 1-100TiB) field in the information provided We could not find On-chain address for first allocation field in the information provided We could not find Data Type of Application field in the information provided

Please, take a look at the request and edit the body of the issue providing all the required information.