kernelogic commented 2 years ago

Large Dataset Notary Application

To apply for DataCap to onboard your dataset to Filecoin, please fill out the following.

Core Information

Organization Name: Fei Yan - Kernelogic
Website / Social Media: https://singularity-browser.kernelogic.ca/ Slack: Fei Yan
Total amount of DataCap being requested (between 500 TiB and 5 PiB): 5 PiB
Weekly allocation of DataCap requested (usually between 1-100TiB): 750 TiB
On-chain address for first allocation: f1gt3lmd64eeknyuf7pkdsyzj57bxbaq4oa3lvjla

Please respond to the questions below by replacing the text saying "Please answer here". Include as much detail as you can in your answer.

Project details

Share a brief history of your project and organization.

I have participated every Slingshot phase and is probably the best performing as a "small individual client". 

Even though Slingshot v2 has ended, there are still strong demand from SPs to onboard useful data. This application is to onboard open dataset from AWS.

I will provide a nice web UI (https://github.com/tech-greedy/singularity-browser) to index all files onboarded and provide ways to retrieve.

I have successfully completed a few LDNs on other datasets and I have record to show I have been following the rules of decentralization and have zero self dealing.

https://github.com/filecoin-project/filecoin-plus-large-datasets/issues/60
https://github.com/filecoin-project/filecoin-plus-large-datasets/issues/59
https://github.com/filecoin-project/filecoin-plus-large-datasets/issues/46
https://github.com/filecoin-project/filecoin-plus-large-datasets/issues/297
https://github.com/filecoin-project/filecoin-plus-large-datasets/issues/298
https://github.com/filecoin-project/filecoin-plus-large-datasets/issues/304

What is the primary source of funding for this project?

Self-funded, BigD exchange.

What other projects/ecosystem stakeholders is this project associated with?

enterprise-sp-wg, BigD exchange.

Use-case details

Describe the data being stored onto Filecoin

The Hubble Space Telescope (HST) is one of the most productive scientific instruments ever created. 
This dataset contains calibrated and raw data for all of the currently active instruments on HST: ACS, COS, STIS and WFC3.

Total size: 292.3 TiB

Where was the data in this dataset sourced from?

https://astroquery.readthedocs.io/en/latest/mast/mast.html
https://registry.opendata.aws/hst/

Can you share a sample of the data? A link to a file, an image, a table, etc., are good ways to do this.

https://registry.opendata.aws/hst/

Confirm that this is a public dataset that can be retrieved by anyone on the Network (i.e., no specific permissions or access rights are required to view the data).

AWS Open dataset. Cited from the website:

STScI herby grants the non-exclusive, royalty free, non-transferable, worldwide right and license to use, reproduce and publicly display in all media public data from the Hubble Space Telescope.

What is the expected retrieval frequency for this data?

Multiple times per year.

For how long do you plan to keep this dataset stored on Filecoin?

18 months.

DataCap allocation plan

In which geographies (countries, regions) do you plan on making storage deals?

All regions.

How will you be distributing your data to storage providers? Is there an offline data transfer process?

I will upload my prepared CAR files to a web server and coordinate with providers to download and propose offline deals.

Maximum 3 copies per SP entity and maximum of 12 copies for every pieceCID.

How do you plan on choosing the storage providers with whom you will be making deals? This should include a plan to ensure the data is retrievable in the future both by you and others.

Beside the previous SPs I have worked with, I also utilize bigD exchange to further decentralize the storage

To name a few from the community that I deal with regularly: PIKNIK, Holon, CabrinaHuang, HarryM, BigBear, j1v, XinAn Xu, WillTechMusing.

From BigD exchange: Mog Li, Devin Chen, DSS Nathanial Marsh, Rabinovitch, Vin K, arockpool Tony

How will you be distributing deals across storage providers?

Evenly across all providers I propose to, if they can handle. If a miner is a notary itself, this notary will receive no more than 20% of the total granted datacap.

Do you have the resources/funding to start making deals as soon as you receive DataCap? What support from the community would help you onboard onto Filecoin?

I have all I need to start making deals.

large-datacap-requests[bot] commented 2 years ago

Thanks for your request!

Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!

large-datacap-requests[bot] commented 2 years ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

raghavrmadya commented 2 years ago

Datacap Request Trigger

Total DataCap requested

5PiB

Expected weekly DataCap usage rate

750TiB

Client address

f1gt3lmd64eeknyuf7pkdsyzj57bxbaq4oa3lvjla

large-datacap-requests[bot] commented 2 years ago

DataCap Allocation requested

Multisig Notary address

f01858410

Client address

f1gt3lmd64eeknyuf7pkdsyzj57bxbaq4oa3lvjla

DataCap allocation requested

256TiB

newwebgroup commented 2 years ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceb6mx4c4rcwhesgtxy3bzr6bj5npnglivcgryd3j3gjhxg76wbmgo

Address

f1gt3lmd64eeknyuf7pkdsyzj57bxbaq4oa3lvjla

Datacap Allocated

256.00TiB

Signer Address

f1e77zuityhvvw6u2t6tb5qlnsegy2s67qs4lbbbq

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceb6mx4c4rcwhesgtxy3bzr6bj5npnglivcgryd3j3gjhxg76wbmgo

NDLABS-Leo commented 2 years ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceblhpabzzolt4p5bdevsywpyocdr6n66xo7n3cixufpt7mcml52fm

Address

f1gt3lmd64eeknyuf7pkdsyzj57bxbaq4oa3lvjla

Datacap Allocated

256.00TiB

Signer Address

f1yayfsv6whu3rheviucvventj3y6t542xfpb47ei

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceblhpabzzolt4p5bdevsywpyocdr6n66xo7n3cixufpt7mcml52fm

large-datacap-requests[bot] commented 2 years ago

Thanks for your request!

Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!

filplus-checker commented 1 year ago

DataCap and CID Checker Report[^1]

Organization: Fei Yan - Kernelogic
Client: f1gt3lmd64eeknyuf7pkdsyzj57bxbaq4oa3lvjla
Storage Provider Distribution

The below table shows the distribution of storage providers that have stored data for this client.

If this is the first time a provider takes verified deal, it will be marked as new.

For most of the datacap application, below restrictions should apply.

Storage provider should not exceed 25% of total datacap.
Storage provider should not be storing duplicate data for more than 20%.
Storage provider should have published its public IP address.
All storage providers should be located in different regions.

⚠️ f01928097 has sealed 100.00% of total datacap.

⚠️ All storage providers are located in the same region.

Provider	Location	Total Deals Sealed	Percentage	Unique Data	Duplicate Deals
f01928097	Hong Kong, Central and Western, HK	50.00 TiB	100.00%	50.00 TiB	0.00%

Provider Distribution

Deal Data Replication

The below table shows how each many unique data are replicated across storage providers.

No more than 25% of unique data are stored with less than 4 providers.

⚠️ 100.00% of deals are for data replicated across less than 4 storage providers.

Unique Data Size	Total Deals Made	Number of Providers	Deal Percentage
50.00 TiB	50.00 TiB	1	100.00%

Replication Distribution

Deal Data Shared with other Clients

The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 2

Multisig Notary address

f01858410

Client address

f1gt3lmd64eeknyuf7pkdsyzj57bxbaq4oa3lvjla

DataCap allocation requested

512TiB

Id

6aac4483-6a4f-457c-ad24-4cda20961fb1

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f1gt3lmd64eeknyuf7pkdsyzj57bxbaq4oa3lvjla

Last two approvers

not found & newwebgroup

Rule to calculate the allocation request amount

10% of total dc amount requested

DataCap allocation requested

512TiB

Total DataCap granted for client so far

256TiB

Datacap to be granted to reach the total amount requested by the client (5 PiB)

4.75PiB

Stats

Number of deals	Number of storage providers	Previous DC Allocated	Top provider	Remaining DC
5760	3	256TiB	36.11	41TiB

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report[^1]

Organization: Fei Yan - Kernelogic
Client: f1gt3lmd64eeknyuf7pkdsyzj57bxbaq4oa3lvjla
Storage Provider Distribution

The below table shows the distribution of storage providers that have stored data for this client.

If this is the first time a provider takes verified deal, it will be marked as new.

For most of the datacap application, below restrictions should apply.

Since this is the 2nd allocation, the following restrictions have been relaxed:

Storage provider should not exceed 90% of total datacap.
Storage provider should not be storing duplicate data for more than 20%.
Storage provider should have published its public IP address.
All storage providers should be located in different regions.

✔️ Storage provider distribution looks healthy.

Provider	Location	Total Deals Sealed	Percentage	Unique Data	Duplicate Deals
f01992630`new`	Louisville, Kentucky, US	63.66 TiB	37.89%	63.66 TiB	0.00%
f01971600`new`	Louisville, Kentucky, US	54.34 TiB	32.35%	54.34 TiB	0.00%
f01928097	Singapore, Singapore, SG	50.00 TiB	29.76%	50.00 TiB	0.00%

Provider Distribution

Deal Data Replication

The below table shows how each many unique data are replicated across storage providers.

Since this is the 2nd allocation, the following restrictions have been relaxed:

No more than 90% of unique data are stored with less than 2 providers.

✔️ Data replication looks healthy.

Unique Data Size	Total Deals Made	Number of Providers	Deal Percentage
67.09 TiB	67.09 TiB	1	39.94%
37.94 TiB	75.88 TiB	2	45.16%
8.34 TiB	25.03 TiB	3	14.90%

Replication Distribution

Deal Data Shared with other Clients

The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

newwebgroup commented 1 year ago

CID Checker looks good

newwebgroup commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceb33fv45lr2ydveustecptxzamn3t2v3nmtloqwyi6kmnk7mtl5ke

Address

f1gt3lmd64eeknyuf7pkdsyzj57bxbaq4oa3lvjla

Datacap Allocated

512.00TiB

Signer Address

f1e77zuityhvvw6u2t6tb5qlnsegy2s67qs4lbbbq

Id

6aac4483-6a4f-457c-ad24-4cda20961fb1

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceb33fv45lr2ydveustecptxzamn3t2v3nmtloqwyi6kmnk7mtl5ke

ipfscn commented 1 year ago

The bot shows that this customer is very good

ipfscn commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacedwvlotififl4mpygdjkwxzbd4dsfqxsl52mkglkt4v6qwrtwv45c

Address

f1gt3lmd64eeknyuf7pkdsyzj57bxbaq4oa3lvjla

Datacap Allocated

512.00TiB

Signer Address

f1j4n74chme7whbz3yls4a7ixqewb6dijypqg2a3a

Id

6aac4483-6a4f-457c-ad24-4cda20961fb1

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedwvlotififl4mpygdjkwxzbd4dsfqxsl52mkglkt4v6qwrtwv45c

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 3

Multisig Notary address

f01858410

Client address

f1gt3lmd64eeknyuf7pkdsyzj57bxbaq4oa3lvjla

DataCap allocation requested

1PiB

Id

5acabd98-6fdc-49b3-aed4-94871573e912

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f1gt3lmd64eeknyuf7pkdsyzj57bxbaq4oa3lvjla

Last two approvers

ipfscn & newwebgroup

Rule to calculate the allocation request amount

20% of total dc amount requested

DataCap allocation requested

1PiB

Total DataCap granted for client so far

256TiB

Datacap to be granted to reach the total amount requested by the client (5 PiB)

4.75PiB

Stats

Number of deals	Number of storage providers	Previous DC Allocated	Top provider	Remaining DC
7984	3	512TiB	39.98	6TiB

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report[^1]

Organization: Fei Yan - Kernelogic
Client: f1gt3lmd64eeknyuf7pkdsyzj57bxbaq4oa3lvjla
Storage Provider Distribution

The below table shows the distribution of storage providers that have stored data for this client.

If this is the first time a provider takes verified deal, it will be marked as new.

For most of the datacap application, below restrictions should apply.

Since this is the 4th allocation, the following restrictions have been relaxed:

Storage provider should not exceed 50% of total datacap.
Storage provider should not be storing duplicate data for more than 20%.
Storage provider should have published its public IP address.
All storage providers should be located in different regions.

✔️ Storage provider distribution looks healthy.

Provider	Location	Total Deals Sealed	Percentage	Unique Data	Duplicate Deals
f01992630`new`	Louisville, Kentucky, US `Flexential Colorado Corp.`	99.06 TiB	40.56%	99.06 TiB	0.00%
f01971600`new`	Louisville, Kentucky, US `Flexential Colorado Corp.`	95.19 TiB	38.97%	95.19 TiB	0.00%
f01928097	Singapore, Singapore, SG `Singapore Telecommunications Ltd`	50.00 TiB	20.47%	50.00 TiB	0.00%

Provider Distribution

Deal Data Replication

The below table shows how each many unique data are replicated across storage providers.

Since this is the 4th allocation, the following restrictions have been relaxed:

No more than 50% of unique data are stored with less than 4 providers.

⚠️ 100.00% of deals are for data replicated across less than 4 storage providers.

Unique Data Size	Total Deals Made	Number of Providers	Deal Percentage
30.13 TiB	30.13 TiB	1	12.33%
73.50 TiB	147.00 TiB	2	60.18%
22.38 TiB	67.13 TiB	3	27.48%

Replication Distribution

Deal Data Shared with other Clients

The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

cryptowhizzard commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceaq67dzk2sakohv7rl743zeswgawseqbmn34swra7ghvjopzswcuk

Address

f1gt3lmd64eeknyuf7pkdsyzj57bxbaq4oa3lvjla

Datacap Allocated

1.00PiB

Signer Address

f1krmypm4uoxxf3g7okrwtrahlmpcph3y7rbqqgfa

Id

5acabd98-6fdc-49b3-aed4-94871573e912

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceaq67dzk2sakohv7rl743zeswgawseqbmn34swra7ghvjopzswcuk

xiaoyuaiheshui commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacecjhohwachifzl3udafizae65aekhumrfsfm6336klfd2yqwpesly

Address

f1gt3lmd64eeknyuf7pkdsyzj57bxbaq4oa3lvjla

Datacap Allocated

1.00PiB

Signer Address

f122qmy25wdtt5mxd77kndiq7z5x2n3iwiuz2wdsa

Id

5acabd98-6fdc-49b3-aed4-94871573e912

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecjhohwachifzl3udafizae65aekhumrfsfm6336klfd2yqwpesly

kernelogic commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report[^1]

Organization: Fei Yan - Kernelogic
Client: f1gt3lmd64eeknyuf7pkdsyzj57bxbaq4oa3lvjla
Approvers

1cryptowhizzard
1ipfscn
1NDLABS-OFFICE
2newwebgroup
1xiaoyuaiheshui

Storage Provider Distribution

The below table shows the distribution of storage providers that have stored data for this client.

If this is the first time a provider takes verified deal, it will be marked as new.

For most of the datacap application, below restrictions should apply.

Since this is the 4th allocation, the following restrictions have been relaxed:

Storage provider should not exceed 50% of total datacap.
Storage provider should not be storing duplicate data for more than 20%.
Storage provider should have published its public IP address.
All storage providers should be located in different regions.

✔️ Storage provider distribution looks healthy.

Provider	Location	Total Deals Sealed	Percentage	Unique Data	Duplicate Deals
f01964074	Tokyo, Tokyo, JP `Amazon.com, Inc.`	149.94 TiB	8.37%	149.94 TiB	0.00%
f01963842	Tokyo, Tokyo, JP `Amazon.com, Inc.`	149.91 TiB	8.37%	149.91 TiB	0.00%
f01946689	Singapore, Singapore, SG `Amazon.com, Inc.`	149.91 TiB	8.37%	149.91 TiB	0.00%
f01947708	Tokyo, Tokyo, JP `Amazon.com, Inc.`	142.75 TiB	7.97%	142.75 TiB	0.00%
f01946713	Singapore, Singapore, SG `Amazon.com, Inc.`	134.34 TiB	7.50%	134.34 TiB	0.00%
f01945216	Singapore, Singapore, SG `Amazon.com, Inc.`	108.44 TiB	6.06%	108.44 TiB	0.00%
f01992630`new`	Louisville, Kentucky, US `Flexential Colorado Corp.`	384.44 TiB	21.47%	384.44 TiB	0.00%
f01971600`new`	Louisville, Kentucky, US `Flexential Colorado Corp.`	383.38 TiB	21.41%	383.38 TiB	0.00%
f01944744	Hong Kong, Central and Western, HK `Singapore Telecommunications Ltd`	137.59 TiB	7.68%	137.59 TiB	0.00%
f01928097	Singapore, Singapore, SG `Singapore Telecommunications Ltd`	50.00 TiB	2.79%	50.00 TiB	0.00%

Provider Distribution

Deal Data Replication

The below table shows how each many unique data are replicated across storage providers.

Since this is the 4th allocation, the following restrictions have been relaxed:

No more than 50% of unique data are stored with less than 4 providers.

✔️ Data replication looks healthy.

Unique Data Size	Total Deals Made	Number of Providers	Deal Percentage
1.06 TiB	1.06 TiB	1	0.06%
218.88 TiB	437.75 TiB	2	24.45%
14.50 TiB	43.50 TiB	3	2.43%
7.28 TiB	36.41 TiB	5	2.03%
5.13 TiB	30.75 TiB	6	1.72%
3.28 TiB	22.97 TiB	7	1.28%
26.03 TiB	208.25 TiB	8	11.63%
72.81 TiB	655.31 TiB	9	36.60%
35.47 TiB	354.69 TiB	10	19.81%

Replication Distribution

Deal Data Shared with other Clients

The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.

However, this could be possible if all below clients use same software to prepare for the exact same dataset or they belong to a series of LDN applications for the same dataset.

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

NiwanDao commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaced2gt4fdctamlbko7hllyxusb5odqt6ca7uv6rqsvwepyyuz2ddhm

Address

f1gt3lmd64eeknyuf7pkdsyzj57bxbaq4oa3lvjla

Datacap Allocated

1.00PiB

Signer Address

f1a2lia2cwwekeubwo4nppt4v4vebxs2frozarz3q

Id

5acabd98-6fdc-49b3-aed4-94871573e912

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaced2gt4fdctamlbko7hllyxusb5odqt6ca7uv6rqsvwepyyuz2ddhm

stcloudlisa commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceabtu5cakyae7xmyp4zxgf6lm5ijlocjlnhb7y4fywnhkveda76dw

Address

f1gt3lmd64eeknyuf7pkdsyzj57bxbaq4oa3lvjla

Datacap Allocated

1.00PiB

Signer Address

f1jvvltduw35u6inn5tr4nfualyd42bh3vjtylgci

Id

5acabd98-6fdc-49b3-aed4-94871573e912

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceabtu5cakyae7xmyp4zxgf6lm5ijlocjlnhb7y4fywnhkveda76dw

stcloudlisa commented 1 year ago

looks good

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 4

Multisig Notary address

f01858410

Client address

f1gt3lmd64eeknyuf7pkdsyzj57bxbaq4oa3lvjla

DataCap allocation requested

2PiB

Id

0e5e8c63-5659-403d-8499-24e4a5c99fe0

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f1gt3lmd64eeknyuf7pkdsyzj57bxbaq4oa3lvjla

Last two approvers

1LISA2 & xingjitansuo

Rule to calculate the allocation request amount

40% of total dc amount requested

DataCap allocation requested

2PiB

Total DataCap granted for client so far

1.75PiB

Datacap to be granted to reach the total amount requested by the client (5 PiB)

3.25PiB

Stats

Number of deals	Number of storage providers	Previous DC Allocated	Top provider	Remaining DC
57344	10	1PiB	21.45	0B

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report[^1]

Organization: Fei Yan - Kernelogic
Client: f1gt3lmd64eeknyuf7pkdsyzj57bxbaq4oa3lvjla
Approvers

1cryptowhizzard
1ipfscn
1NDLABS-OFFICE
2newwebgroup
1stcouldlisa
1xiaoyuaiheshui
1xingjitansuo

Storage Provider Distribution

The below table shows the distribution of storage providers that have stored data for this client.

If this is the first time a provider takes verified deal, it will be marked as new.

For most of the datacap application, below restrictions should apply.

Storage provider should not exceed 30% of total datacap.
Storage provider should not be storing duplicate data for more than 20%.
Storage provider should have published its public IP address.
All storage providers should be located in different regions.

✔️ Storage provider distribution looks healthy.

Provider	Location	Total Deals Sealed	Percentage	Unique Data	Duplicate Deals
f01964074	Tokyo, Tokyo, JP `Amazon.com, Inc.`	149.94 TiB	8.37%	149.94 TiB	0.00%
f01963842	Tokyo, Tokyo, JP `Amazon.com, Inc.`	149.91 TiB	8.37%	149.91 TiB	0.00%
f01946689	Singapore, Singapore, SG `Amazon.com, Inc.`	149.91 TiB	8.37%	149.91 TiB	0.00%
f01947708	Tokyo, Tokyo, JP `Amazon.com, Inc.`	142.75 TiB	7.97%	142.75 TiB	0.00%
f01946713	Singapore, Singapore, SG `Amazon.com, Inc.`	134.34 TiB	7.50%	134.34 TiB	0.00%
f01945216	Singapore, Singapore, SG `Amazon.com, Inc.`	108.44 TiB	6.06%	108.44 TiB	0.00%
f01992630`new`	Louisville, Kentucky, US `Flexential Colorado Corp.`	384.44 TiB	21.47%	384.44 TiB	0.00%
f01971600`new`	Louisville, Kentucky, US `Flexential Colorado Corp.`	383.38 TiB	21.41%	383.38 TiB	0.00%
f01944744	Hong Kong, Central and Western, HK `Singapore Telecommunications Ltd`	137.59 TiB	7.68%	137.59 TiB	0.00%
f01928097	Singapore, Singapore, SG `Singapore Telecommunications Ltd`	50.00 TiB	2.79%	50.00 TiB	0.00%

Provider Distribution

Deal Data Replication

The below table shows how each many unique data are replicated across storage providers.

No more than 30% of unique data are stored with less than 4 providers.

✔️ Data replication looks healthy.

Unique Data Size	Total Deals Made	Number of Providers	Deal Percentage
1.06 TiB	1.06 TiB	1	0.06%
218.88 TiB	437.75 TiB	2	24.45%
14.50 TiB	43.50 TiB	3	2.43%
7.28 TiB	36.41 TiB	5	2.03%
5.13 TiB	30.75 TiB	6	1.72%
3.28 TiB	22.97 TiB	7	1.28%
26.03 TiB	208.25 TiB	8	11.63%
72.81 TiB	655.31 TiB	9	36.60%
35.47 TiB	354.69 TiB	10	19.81%

Replication Distribution

Deal Data Shared with other Clients

The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.

However, this could be possible if all below clients use same software to prepare for the exact same dataset or they belong to a series of LDN applications for the same dataset.

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

cryptowhizzard commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceagoebegcad2smmszejudmv4yvcc6tnzckq3p4zzzdmmgdgbob7zg

Address

f1gt3lmd64eeknyuf7pkdsyzj57bxbaq4oa3lvjla

Datacap Allocated

2.00PiB

Signer Address

f1krmypm4uoxxf3g7okrwtrahlmpcph3y7rbqqgfa

Id

0e5e8c63-5659-403d-8499-24e4a5c99fe0

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceagoebegcad2smmszejudmv4yvcc6tnzckq3p4zzzdmmgdgbob7zg

xinaxu commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacedelnooxxpkcqnlkr6l7473z6ievzyhhgsshnczegtllakxxku6xa

Address

f1gt3lmd64eeknyuf7pkdsyzj57bxbaq4oa3lvjla

Datacap Allocated

2.00PiB

Signer Address

f1k3ysofkrrmqcot6fkx4wnezpczlltpirmrpsgui

Id

0e5e8c63-5659-403d-8499-24e4a5c99fe0

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedelnooxxpkcqnlkr6l7473z6ievzyhhgsshnczegtllakxxku6xa

BDEio commented 1 year ago

@kernelogic Hi! Great to see that you have gotten approval for DataCap! BDE is a verified deals auction house helping you to get paid storing your data with reliable storage providers. If you need any help, please get in touch.

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 5

Multisig Notary address

f01858410

Client address

f1gt3lmd64eeknyuf7pkdsyzj57bxbaq4oa3lvjla

DataCap allocation requested

1.25PiB

Id

19b182f6-a519-41ac-aa0d-0b6681dd6426

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f1gt3lmd64eeknyuf7pkdsyzj57bxbaq4oa3lvjla

Last two approvers

xinaxu & cryptowhizzard

Rule to calculate the allocation request amount

80% of total dc amount requested

DataCap allocation requested

1.25PiB

Total DataCap granted for client so far

4.75PiB

Datacap to be granted to reach the total amount requested by the client (5 PiB)

256TiB

Stats

Number of deals	Number of storage providers	Previous DC Allocated	Top provider	Remaining DC
136520	21	2PiB	9.01	499.5TiB

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report[^1]

Organization: Fei Yan - Kernelogic
Client: f1gt3lmd64eeknyuf7pkdsyzj57bxbaq4oa3lvjla
Approvers

2cryptowhizzard
1ipfscn
1NDLABS-OFFICE
2newwebgroup
1stcouldlisa
1xiaoyuaiheshui
1xinaxu
1xingjitansuo

Storage Provider Distribution

The below table shows the distribution of storage providers that have stored data for this client.

If this is the first time a provider takes verified deal, it will be marked as new.

For most of the datacap application, below restrictions should apply.

Storage provider should not exceed 30% of total datacap.
Storage provider should not be storing duplicate data for more than 20%.
Storage provider should have published its public IP address.
All storage providers should be located in different regions.

✔️ Storage provider distribution looks healthy.

Provider	Location	Total Deals Sealed	Percentage	Unique Data	Duplicate Deals
f01964074	Tokyo, Tokyo, JP `Amazon.com, Inc.`	299.97 TiB	7.00%	299.97 TiB	0.00%
f01963842	Tokyo, Tokyo, JP `Amazon.com, Inc.`	299.56 TiB	6.99%	299.56 TiB	0.00%
f01947708	Tokyo, Tokyo, JP `Amazon.com, Inc.`	294.09 TiB	6.86%	294.09 TiB	0.00%
f01946713	Singapore, Singapore, SG `Amazon.com, Inc.`	294.03 TiB	6.86%	294.03 TiB	0.00%
f01945216	Singapore, Singapore, SG `Amazon.com, Inc.`	293.72 TiB	6.85%	293.72 TiB	0.00%
f01946689	Singapore, Singapore, SG `Amazon.com, Inc.`	279.81 TiB	6.53%	279.81 TiB	0.00%
f02008841`new`	Singapore, Singapore, SG `Amazon.com, Inc.`	68.25 TiB	1.59%	68.25 TiB	0.00%
f02008876`new`	Singapore, Singapore, SG `Amazon.com, Inc.`	68.03 TiB	1.59%	68.03 TiB	0.00%
f02008883`new`	Tokyo, Tokyo, JP `Amazon.com, Inc.`	67.50 TiB	1.57%	67.50 TiB	0.00%
f02012674`new`	Seoul, Seoul, KR `Amazon.com, Inc.`	67.44 TiB	1.57%	67.44 TiB	0.00%
f02013352`new`	Seoul, Seoul, KR `Amazon.com, Inc.`	66.56 TiB	1.55%	66.56 TiB	0.00%
f01988794	Dallas, Texas, US `Flexential Colorado Corp.`	384.44 TiB	8.97%	384.44 TiB	0.00%
f01992630`new`	Dallas, Texas, US `Flexential Colorado Corp.`	384.44 TiB	8.97%	384.44 TiB	0.00%
f01985775	Dallas, Texas, US `Flexential Colorado Corp.`	384.44 TiB	8.97%	384.44 TiB	0.00%
f01971600`new`	Dallas, Texas, US `Flexential Colorado Corp.`	383.38 TiB	8.94%	383.38 TiB	0.00%
f01944744	Singapore, Singapore, SG `Singapore Telecommunications Ltd`	300.00 TiB	7.00%	300.00 TiB	0.00%
f01943663	Hong Kong, Central and Western, HK `Singapore Telecommunications Ltd`	98.78 TiB	2.30%	98.78 TiB	0.00%
f02009671`new`	Singapore, Singapore, SG `Singapore Telecommunications Ltd`	68.19 TiB	1.59%	68.19 TiB	0.00%
f02009668`new`	Singapore, Singapore, SG `Singapore Telecommunications Ltd`	67.56 TiB	1.58%	67.56 TiB	0.00%
f02009673`new`	Singapore, Singapore, SG `Singapore Telecommunications Ltd`	66.75 TiB	1.56%	66.75 TiB	0.00%
f01928097	Hong Kong, Central and Western, HK `Singapore Telecommunications Ltd`	50.00 TiB	1.17%	50.00 TiB	0.00%

Provider Distribution

Deal Data Replication

The below table shows how each many unique data are replicated across storage providers.

No more than 30% of unique data are stored with less than 4 providers.

✔️ Data replication looks healthy.

Unique Data Size	Total Deals Made	Number of Providers	Deal Percentage
544.00 GiB	3.72 TiB	7	0.09%
5.81 TiB	46.50 TiB	8	1.08%
13.22 TiB	118.97 TiB	9	2.78%
39.06 TiB	390.63 TiB	10	9.11%
199.00 TiB	2.14 PiB	11	51.06%
110.44 TiB	1.29 PiB	12	30.91%
16.38 TiB	212.88 TiB	13	4.97%

Replication Distribution

Deal Data Shared with other Clients

The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.

However, this could be possible if all below clients use same software to prepare for the exact same dataset or they belong to a series of LDN applications for the same dataset.

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

flyworker commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacecicjyqarawzipn5oo44swjdgzrgusmwdiufdu6qe5txlfo3runhg

Address

f1gt3lmd64eeknyuf7pkdsyzj57bxbaq4oa3lvjla

Datacap Allocated

1.25PiB

Signer Address

f1hlubjsdkv4wmsdadihloxgwrz3j3ernf6i3cbpy

Id

19b182f6-a519-41ac-aa0d-0b6681dd6426

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecicjyqarawzipn5oo44swjdgzrgusmwdiufdu6qe5txlfo3runhg

Tom-OriginStorage commented 1 year ago

The package looks all compliant, and there is no cid sharing, I checked and it is retrievable, willing to support

Tom-OriginStorage commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacedsqeaj6j3hby3f7qwyoatoibcikzkxlpzhvmhelfz5s4ndcs3d6q

Address

f1gt3lmd64eeknyuf7pkdsyzj57bxbaq4oa3lvjla

Datacap Allocated

1.25PiB

Signer Address

f1q6bpjlqia6iemqbrdaxr2uehrhpvoju3qh4lpga

Id

19b182f6-a519-41ac-aa0d-0b6681dd6426

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedsqeaj6j3hby3f7qwyoatoibcikzkxlpzhvmhelfz5s4ndcs3d6q

large-datacap-requests[bot] commented 7 months ago

RootKeyHolders have approved multisig account. You can now request first datacap release

filecoin-project / filecoin-plus-large-datasets

[DataCap Application] Kernelogic - Hubble Space Telescope Public Data #1105

Large Dataset Notary Application

Core Information

Project details

Use-case details

DataCap allocation plan

Datacap Request Trigger

DataCap Allocation requested

Multisig Notary address

Client address

DataCap allocation requested

Request Proposed

Message sent to Filecoin Network

Address

Datacap Allocated

Signer Address

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceb6mx4c4rcwhesgtxy3bzr6bj5npnglivcgryd3j3gjhxg76wbmgo

Request Approved

Message sent to Filecoin Network

Address

Datacap Allocated

Signer Address

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceblhpabzzolt4p5bdevsywpyocdr6n66xo7n3cixufpt7mcml52fm

DataCap and CID Checker Report[^1]

Storage Provider Distribution

Deal Data Replication

Deal Data Shared with other Clients

DataCap Allocation requested

Request number 2

Multisig Notary address

Client address

DataCap allocation requested

Id

Stats & Info for DataCap Allocation

Multisig Notary address

Client address

Last two approvers

Rule to calculate the allocation request amount

DataCap allocation requested

Total DataCap granted for client so far

Datacap to be granted to reach the total amount requested by the client (5 PiB)

Stats

DataCap and CID Checker Report[^1]

Storage Provider Distribution

Deal Data Replication

Deal Data Shared with other Clients

Request Proposed

Message sent to Filecoin Network

Address

Datacap Allocated

Signer Address

Id

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceb33fv45lr2ydveustecptxzamn3t2v3nmtloqwyi6kmnk7mtl5ke

Request Approved

Message sent to Filecoin Network

Address

Datacap Allocated

Signer Address

Id

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedwvlotififl4mpygdjkwxzbd4dsfqxsl52mkglkt4v6qwrtwv45c

DataCap Allocation requested

Request number 3

Multisig Notary address

Client address

DataCap allocation requested

Id

Stats & Info for DataCap Allocation

Multisig Notary address

Client address

Last two approvers

Rule to calculate the allocation request amount

DataCap allocation requested

Total DataCap granted for client so far

Datacap to be granted to reach the total amount requested by the client (5 PiB)

Stats

DataCap and CID Checker Report[^1]

Storage Provider Distribution

Deal Data Replication

Deal Data Shared with other Clients