search

filecoin-project / filecoin-plus-large-datasets

Hub for client applications for DataCap at a large scale
110 stars 62 forks source link

Terrafusion data Sampler / (Speedium) #339

Closed cryptowhizzard closed 1 year ago

cryptowhizzard commented 2 years ago

Large Dataset Notary Application

To apply for DataCap to onboard your dataset to Filecoin, please fill out the following.

Core Information

Please respond to the questions below by replacing the text saying "Please answer here". Include as much detail as you can in your answer.

Project details

Share a brief history of your project and organization.

Speedium / Dcent has engaged in Slingshot starting 2.6. We have successfully stored more than 15 differerent datasets with 20+ different miners.

What is the primary source of funding for this project?

Company account

What other projects/ecosystem stakeholders is this project associated with?

Slingshot competition hosted by Protocol Labs

Use-case details

Describe the data being stored onto Filecoin

The Terra Basic Fusion dataset is a fused dataset of the original Level 1 radiances from the five Terra instruments. They have been fully validate to contain the original Terra instrument Level 1 data.

Where was the data in this dataset sourced from?

AWS

Can you share a sample of the data? A link to a file, an image, a table, etc., are good ways to do this. 

https://terrafusion.web.illinois.edu/.

Confirm that this is a public dataset that can be retrieved by anyone on the Network (i.e., no specific permissions or access rights are required to view the data).

Yes

What is the expected retrieval frequency for this data?

Multiple times p/y

For how long do you plan to keep this dataset stored on Filecoin?

18 months or longer

DataCap allocation plan

In which geographies (countries, regions) do you plan on making storage deals?

EU / US / Australia

How will you be distributing your data to storage providers? Is there an offline data transfer process?

The data will be transferred both offline and online.

How do you plan on choosing the storage providers with whom you will be making deals? This should include a plan to ensure the data is retrievable in the future both by you and others.

We have a few providers who have been working with us during Slingshot Restore program and we'd like to continue working with them for ongoing Slingshot competition.

How will you be distributing deals across storage providers?

Max 2 copy's per storage provider if stored on different miners / locations.

Do you have the resources/funding to start making deals as soon as you receive DataCap? What support from the community would help you onboard onto Filecoin?

Yes, we have the resources.
large-datacap-requests[bot] commented 2 years ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

large-datacap-requests[bot] commented 2 years ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

large-datacap-requests[bot] commented 2 years ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

large-datacap-requests[bot] commented 2 years ago

Thanks for your request!

Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!
large-datacap-requests[bot] commented 2 years ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

galen-mcandrew commented 2 years ago

Multisig Notary requested

Total DataCap requested

3PiB

Expected weekly DataCap usage rate

300TiB

large-datacap-requests[bot] commented 2 years ago

**Multisig created and sent to RKH f01837490

large-datacap-requests[bot] commented 2 years ago

Thanks for your request!

Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!
large-datacap-requests[bot] commented 2 years ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

dkkapur commented 2 years ago

@cryptowhizzard see https://github.com/filecoin-project/filecoin-plus-large-datasets/issues/348#issuecomment-1123004278 when you get a chance. Using separate address here would help with Slingshot tracking too. Please update if this is possible! Thank you!

large-datacap-requests[bot] commented 2 years ago

Thanks for your request!

Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!
large-datacap-requests[bot] commented 2 years ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

cryptowhizzard commented 2 years ago

@dkkapur - > Done.

large-datacap-requests[bot] commented 2 years ago

DataCap Allocation requested

Multisig Notary address

f01837490

Client address

f1z7jogzx4x42wtilzb4lu6iotlad5rptt2acbzpi

DataCap allocation requested

150TiB

Reiers commented 2 years ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacebamluoib4co62sauzopee5bftzym6ju4kzceu5xbnf27mmdd6d5w

Address

f1z7jogzx4x42wtilzb4lu6iotlad5rptt2acbzpi

Datacap Allocated

150.00TiB

Signer Address

f1oz43ckvmtxmmsfzqm6bpnemqlavz4ifyl524chq

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebamluoib4co62sauzopee5bftzym6ju4kzceu5xbnf27mmdd6d5w

MegTei commented 2 years ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacecmnbqi4xmzqpj4fo32fgcyrcgatibfdzvyqa6ned3lxh76fr6aak

Address

f1z7jogzx4x42wtilzb4lu6iotlad5rptt2acbzpi

Datacap Allocated

150.00TiB

Signer Address

f1ystxl2ootvpirpa7ebgwl7vlhwkbx2r4zjxwe5i

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecmnbqi4xmzqpj4fo32fgcyrcgatibfdzvyqa6ned3lxh76fr6aak

large-datacap-requests[bot] commented 2 years ago

DataCap Allocation requested

Request number 2

Multisig Notary address

f01837490

Client address

f1z7jogzx4x42wtilzb4lu6iotlad5rptt2acbzpi

DataCap allocation requested

300TiB

large-datacap-requests[bot] commented 2 years ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01837490

Client address

f1z7jogzx4x42wtilzb4lu6iotlad5rptt2acbzpi

Last two approvers

not found & not found

Rule to calculate the allocation request amount

100% of weekly dc amount requested

DataCap allocation requested

300TiB

Total DataCap granted for client so far

150TiB

Datacap to be granted to reach the total amount requested by the client (3 PiB)

2.85PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
5250 13 150TiB 21.28 0B
s0nik42 commented 2 years ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacecx4lol2kf4x7qd52pwtclrcnolsstmoi756albyggqapsq4znmte

Address

f1z7jogzx4x42wtilzb4lu6iotlad5rptt2acbzpi

Datacap Allocated

300.00TiB

Signer Address

f1wxhnytjmklj2czezaqcfl7eb4nkgmaxysnegwii

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecx4lol2kf4x7qd52pwtclrcnolsstmoi756albyggqapsq4znmte

MegTei commented 2 years ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceb5aynzgv7ubvhgrk2pla7dgfqu2id75gvapxoxq3qzwk4mu3tn3w

Address

f1z7jogzx4x42wtilzb4lu6iotlad5rptt2acbzpi

Datacap Allocated

300.00TiB

Signer Address

f1ystxl2ootvpirpa7ebgwl7vlhwkbx2r4zjxwe5i

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceb5aynzgv7ubvhgrk2pla7dgfqu2id75gvapxoxq3qzwk4mu3tn3w

large-datacap-requests[bot] commented 2 years ago

DataCap Allocation requested

Request number 3

Multisig Notary address

f01837490

Client address

f1z7jogzx4x42wtilzb4lu6iotlad5rptt2acbzpi

DataCap allocation requested

600TiB

large-datacap-requests[bot] commented 2 years ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01837490

Client address

f1z7jogzx4x42wtilzb4lu6iotlad5rptt2acbzpi

Last two approvers

MegTei & s0nik42

Rule to calculate the allocation request amount

200% of weekly dc amount requested

DataCap allocation requested

600TiB

Total DataCap granted for client so far

450TiB

Datacap to be granted to reach the total amount requested by the client (3 PiB)

2.56PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
14528 15 300TiB 21.94 60.31TiB
flyworker commented 2 years ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacecg5hpytjy46qjcf6motrgawijvr5xa7ero7qh6oi3ehz6toqcbra

Address

f1z7jogzx4x42wtilzb4lu6iotlad5rptt2acbzpi

Datacap Allocated

600.00TiB

Signer Address

f1hlubjsdkv4wmsdadihloxgwrz3j3ernf6i3cbpy

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecg5hpytjy46qjcf6motrgawijvr5xa7ero7qh6oi3ehz6toqcbra

s0nik42 commented 2 years ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacebpazfpkr5m6zv6uylfghxeawikfirducvztjotwk6oacufzhn3ym

Address

f1z7jogzx4x42wtilzb4lu6iotlad5rptt2acbzpi

Datacap Allocated

600.00TiB

Signer Address

f1wxhnytjmklj2czezaqcfl7eb4nkgmaxysnegwii

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebpazfpkr5m6zv6uylfghxeawikfirducvztjotwk6oacufzhn3ym

large-datacap-requests[bot] commented 2 years ago

DataCap Allocation requested

Request number 4

Multisig Notary address

f01858410

Client address

f1z7jogzx4x42wtilzb4lu6iotlad5rptt2acbzpi

DataCap allocation requested

1.17PiB

large-datacap-requests[bot] commented 2 years ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f1z7jogzx4x42wtilzb4lu6iotlad5rptt2acbzpi

Last two approvers

s0nik42 & flyworker

Rule to calculate the allocation request amount

400% of weekly dc amount requested

DataCap allocation requested

1.17PiB

Total DataCap granted for client so far

1.02PiB

Datacap to be granted to reach the total amount requested by the client (3 PiB)

1.97PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
40482 20 600TiB 17.92 144.93TiB
psh0691 commented 2 years ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacedkckfmmkjhuuakwcze2jxhy2urlrgqewos5vjvnhpuhq5rxhbu7s

Address

f1z7jogzx4x42wtilzb4lu6iotlad5rptt2acbzpi

Datacap Allocated

1.17PiB

Signer Address

f1qdko4jg25vo35qmyvcrw4ak4fmuu3f5rif2kc7i

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedkckfmmkjhuuakwcze2jxhy2urlrgqewos5vjvnhpuhq5rxhbu7s

Reiers commented 2 years ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacecy65r7j6mit73r3luiif2hk57jkknnblik7niiq3iabe25ksayi2

Address

f1z7jogzx4x42wtilzb4lu6iotlad5rptt2acbzpi

Datacap Allocated

1.17PiB

Signer Address

f1oz43ckvmtxmmsfzqm6bpnemqlavz4ifyl524chq

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecy65r7j6mit73r3luiif2hk57jkknnblik7niiq3iabe25ksayi2

large-datacap-requests[bot] commented 2 years ago

DataCap Allocation requested

Request number 5

Multisig Notary address

f01858410

Client address

f1z7jogzx4x42wtilzb4lu6iotlad5rptt2acbzpi

DataCap allocation requested

1.83PiB

large-datacap-requests[bot] commented 2 years ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f1z7jogzx4x42wtilzb4lu6iotlad5rptt2acbzpi

Last two approvers

Reiers & psh0691

Rule to calculate the allocation request amount

800% of weekly dc amount requested

DataCap allocation requested

1.83PiB

Total DataCap granted for client so far

1.17PiB

Datacap to be granted to reach the total amount requested by the client (3 PiB)

1.83PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
40406 21 1.17PiB 14.30 233.63TiB
kernelogic commented 2 years ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacebti424xfplp4d7zdqkqs3muxyrwx5tpzt7u4fnoybjgdcvuhgul6

Address

f1z7jogzx4x42wtilzb4lu6iotlad5rptt2acbzpi

Datacap Allocated

1.83PiB

Signer Address

f1yjhnsoga2ccnepb7t3p3ov5fzom3syhsuinxexa

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebti424xfplp4d7zdqkqs3muxyrwx5tpzt7u4fnoybjgdcvuhgul6

MegTei commented 2 years ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacedxpbqgqrtsge54cqzuituss6tzli2n4z5tfak4vrp7xzajsm2vqc

Address

f1z7jogzx4x42wtilzb4lu6iotlad5rptt2acbzpi

Datacap Allocated

1.83PiB

Signer Address

f1ystxl2ootvpirpa7ebgwl7vlhwkbx2r4zjxwe5i

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedxpbqgqrtsge54cqzuituss6tzli2n4z5tfak4vrp7xzajsm2vqc

psh0691 commented 2 years ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacec6cmwo2qcw6xmhnw5ui3qtct2ttlv4gcsunfvcivgrxqs6ys222g

Address

f1z7jogzx4x42wtilzb4lu6iotlad5rptt2acbzpi

Datacap Allocated

1.83PiB

Signer Address

f1qdko4jg25vo35qmyvcrw4ak4fmuu3f5rif2kc7i

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacec6cmwo2qcw6xmhnw5ui3qtct2ttlv4gcsunfvcivgrxqs6ys222g

Reiers commented 2 years ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacebx2ykj5kjb2prj7zrw2fg4yoqcqlkpynauigfoe7ndsi4wnasyo2

Address

f1z7jogzx4x42wtilzb4lu6iotlad5rptt2acbzpi

Datacap Allocated

1.83PiB

Signer Address

f1oz43ckvmtxmmsfzqm6bpnemqlavz4ifyl524chq

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebx2ykj5kjb2prj7zrw2fg4yoqcqlkpynauigfoe7ndsi4wnasyo2

large-datacap-requests[bot] commented 2 years ago

DataCap Allocation requested

Request number 6

Multisig Notary address

f01858410

Client address

f1z7jogzx4x42wtilzb4lu6iotlad5rptt2acbzpi

DataCap allocation requested

1.83PiB

large-datacap-requests[bot] commented 2 years ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f1z7jogzx4x42wtilzb4lu6iotlad5rptt2acbzpi

Last two approvers

Reiers & psh0691

Rule to calculate the allocation request amount

800% of weekly dc amount requested

DataCap allocation requested

1.83PiB

Total DataCap granted for client so far

1.17PiB

Datacap to be granted to reach the total amount requested by the client (3 PiB)

1.83PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
41512 21 1.83PiB 13.88 211.06TiB
large-datacap-requests[bot] commented 2 years ago

Deleting comment

@raghavrmadya hasn't the permissions to post this comment.

Please, contact the assignee of this issue.

raghavrmadya commented 2 years ago

DataCap Allocation requested

Request number 6

Multisig Notary address

f01858410

Client address

f1z7jogzx4x42wtilzb4lu6iotlad5rptt2acbzpi

DataCap allocation requested

1.83PiB

raghavrmadya commented 2 years ago

@psh0691 @Reiers , please propose and approve again

MegTei commented 2 years ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceai5eynwu3vxptkcm6pelvvrjcnq6y7527trbnsxase53frvya3ny

Address

f1z7jogzx4x42wtilzb4lu6iotlad5rptt2acbzpi

Datacap Allocated

1.83PiB

Signer Address

f1ystxl2ootvpirpa7ebgwl7vlhwkbx2r4zjxwe5i

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceai5eynwu3vxptkcm6pelvvrjcnq6y7527trbnsxase53frvya3ny

s0nik42 commented 2 years ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacebne3x552kq7fjfgrrzeqdydexnajat3h6dwkywyvticm735kbhso

Address

f1z7jogzx4x42wtilzb4lu6iotlad5rptt2acbzpi

Datacap Allocated

1.83PiB

Signer Address

f1wxhnytjmklj2czezaqcfl7eb4nkgmaxysnegwii

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebne3x552kq7fjfgrrzeqdydexnajat3h6dwkywyvticm735kbhso

large-datacap-requests[bot] commented 2 years ago

The issue reached the total datacap requested. This should be closed

filplus-checker commented 1 year ago

DataCap and CID Checker Report[^1]

If this is the first time a provider takes verified deal, it will be marked as new.

For most of the datacap application, below restrictions should apply.

⚠️ 31.23% of total deal sealed by f01901765 are duplicate data.

Provider Location Total Deals Sealed Percentage Unique Data Duplicate Deals
f01786387 Heerhugowaard, North Holland, NL 281.19 TiB 7.58% 266.31 TiB 5.29%
f01864434 Sydney, New South Wales, AU 257.96 TiB 6.96% 244.71 TiB 5.14%
f022352 Oslo, Oslo, NO 249.11 TiB 6.72% 248.73 TiB 0.15%
f01720359 Heerhugowaard, North Holland, NL 196.93 TiB 5.31% 182.20 TiB 7.48%
f01771403 Heerhugowaard, North Holland, NL 180.69 TiB 4.87% 171.24 TiB 5.23%
f01878201 Hangzhou, Zhejiang, CN 153.93 TiB 4.15% 136.13 TiB 11.56%
f01880047 Singapore, Singapore, SG 129.41 TiB 3.49% 129.41 TiB 0.00%
f01119939 Dallas, Texas, US 129.38 TiB 3.49% 129.38 TiB 0.00%
f01896422new Fremont, California, US 129.09 TiB 3.48% 128.97 TiB 0.10%
f01962819new Xi’an, Shaanxi, CN 127.63 TiB 3.44% 127.54 TiB 0.07%
f01746964 Sydney, New South Wales, AU 127.42 TiB 3.44% 127.42 TiB 0.00%
f01911083 Tuusula, Uusimaa, FI 125.61 TiB 3.39% 125.52 TiB 0.07%
f01885088 Hong Kong, Central and Western, HK 125.44 TiB 3.38% 125.44 TiB 0.00%
f01926635 Hong Kong, Central and Western, HK 125.00 TiB 3.37% 125.00 TiB 0.00%
f01926686 Hangzhou, Zhejiang, CN 123.49 TiB 3.33% 123.49 TiB 0.00%
f01858429 Boston, Massachusetts, US 122.99 TiB 3.32% 122.99 TiB 0.00%
f01907545 Xi’an, Shaanxi, CN 120.71 TiB 3.26% 120.71 TiB 0.00%
f01928520 Maywood Park, Oregon, US 114.45 TiB 3.09% 114.45 TiB 0.00%
f099608 Riga, Riga, LV 109.72 TiB 2.96% 109.63 TiB 0.09%
f097777 Kivertsi, Volyn, UA 103.56 TiB 2.79% 98.60 TiB 4.79%
f01929565new Sydney, New South Wales, AU 86.69 TiB 2.34% 86.69 TiB 0.00%
f01199442 Heerhugowaard, North Holland, NL 61.85 TiB 1.67% 61.82 TiB 0.05%
f01207045 Heerhugowaard, North Holland, NL 59.05 TiB 1.59% 59.05 TiB 0.00%
f01199430 Heerhugowaard, North Holland, NL 50.18 TiB 1.35% 50.12 TiB 0.13%
f01208862 Heerhugowaard, North Holland, NL 49.05 TiB 1.32% 49.05 TiB 0.00%
f09848 Rancho Santa Margarita, California, US 45.49 TiB 1.23% 45.49 TiB 0.00%
f01824635 Antwerpen, Flanders, BE 43.03 TiB 1.16% 43.03 TiB 0.00%
f01201327 Heerhugowaard, North Holland, NL 37.45 TiB 1.01% 37.45 TiB 0.00%
f010479 Paris, Île-de-France, FR 36.88 TiB 0.99% 32.58 TiB 11.67%
f01902461 Zhengzhou, Henan, CN 35.31 TiB 0.95% 35.31 TiB 0.00%
f01851482 Busan, Busan, KR 26.16 TiB 0.71% 26.16 TiB 0.00%
f01732189 San Diego, California, US 22.30 TiB 0.60% 22.30 TiB 0.00%
f01852664 Singapore, Singapore, SG 19.25 TiB 0.52% 19.25 TiB 0.00%
f01208803 Sydney, New South Wales, AU 19.05 TiB 0.51% 16.13 TiB 15.33%
f01385207 Lincoln, Nebraska, US 18.31 TiB 0.49% 18.31 TiB 0.00%
f01208154 Sydney, New South Wales, AU 18.13 TiB 0.49% 18.13 TiB 0.00%
f01208189 Sydney, New South Wales, AU 17.43 TiB 0.47% 17.40 TiB 0.18%
f01901765 Jiaxing, Zhejiang, CN 12.41 TiB 0.33% 8.53 TiB 31.23%
f01652333 Sunnyvale, California, US 7.40 TiB 0.20% 6.10 TiB 17.63%
f01882184 Singapore, Singapore, SG 4.03 TiB 0.11% 4.03 TiB 0.00%
f010202 Hong Kong, Central and Western, HK 3.13 TiB 0.08% 3.13 TiB 0.00%
f01901739 Sydney, New South Wales, AU 1.91 TiB 0.05% 1.91 TiB 0.00%
f0773157 Fremont, California, US 176.00 GiB 0.00% 176.00 GiB 0.00%
f01208632 Sydney, New South Wales, AU 32.00 GiB 0.00% 32.00 GiB 0.00%

Provider Distribution

Deal Data Replication

The below table shows how each many unique data are replicated across storage providers.

⚠️ 27.81% of deals are for data replicated across less than 4 storage providers.

Unique Data Size Total Deals Made Number of Providers Deal Percentage
255.70 TiB 263.55 TiB 1 7.11%
152.89 TiB 315.37 TiB 2 8.50%
148.51 TiB 452.56 TiB 3 12.20%
14.73 TiB 61.14 TiB 4 1.65%
364.00 GiB 1.87 TiB 5 0.05%
32.00 GiB 384.00 GiB 12 0.01%
101.00 GiB 1.41 TiB 14 0.04%
776.00 GiB 11.62 TiB 15 0.31%
2.34 TiB 38.35 TiB 16 1.03%
7.67 TiB 134.24 TiB 17 3.62%
17.72 TiB 327.92 TiB 18 8.84%
30.34 TiB 591.46 TiB 19 15.95%
30.21 TiB 618.11 TiB 20 16.67%
22.42 TiB 481.55 TiB 21 12.99%
12.23 TiB 275.00 TiB 22 7.42%
4.64 TiB 108.51 TiB 23 2.93%
1.01 TiB 24.39 TiB 24 0.66%
32.00 GiB 800.00 GiB 25 0.02%
8.00 GiB 208.00 GiB 26 0.01%

Replication Distribution

Deal Data Shared with other Clients

The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.

⚠️ CID sharing has been observed.

Other Client Application Total Deals Affected Unique CIDs Verifier
f15cps7yo2x4fosvp45opfihk3a4wg2qukmwyet7a Dcent network 3.08 PiB 18,148 LDN v3 multisig
f1pc5usvsbfgxxbq7c7quhhg6k7l6y5reiwqr3noy Speedium network 1.43 PiB 3,203 LDN v3 multisig
f1c4tsscftr3a6ljujjn7zmfpd6q5vab62ylqxrmi Speedium network 709.94 TiB 1,913 LDN v3 multisig
f17ia7m5mvizrdug3sqtevqw3tifiqvxqr3kdaeuq Speedium NetworkSpeedium Network 395.64 TiB 4,354 LDN # 77
f1mgnwoczfj25foxn4555wvwyak6rsynzy7z73azy Speedium network 50.53 TiB 909 LDN v3 multisig
f1xafi3wsh7q553efnumhgeomathrehwwd2mye7oy Speedium network 288.00 GiB 9 LDN v3 multisig

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

Tom-zhang987 commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report[^1]

Storage Provider Distribution

The below table shows the distribution of storage providers that have stored data for this client.

If this is the first time a provider takes verified deal, it will be marked as new.

For most of the datacap application, below restrictions should apply.

⚠️ 31.23% of total deal sealed by f01901765 are duplicate data.

Provider Location Total Deals Sealed Percentage Unique Data Duplicate Deals
f01864434 Sydney, New South Wales, AU
Andrew Sjoquist Enterprises Pty Ltd		 257.96 TiB 6.66% 244.71 TiB 5.14%
f01746964 Sydney, New South Wales, AU
Andrew Sjoquist Enterprises Pty Ltd		 127.42 TiB 3.29% 127.42 TiB 0.00%
f01208803 Melbourne, Victoria, AU
Anycast Global Backbone		 19.05 TiB 0.49% 16.13 TiB 15.33%
f01208154 Melbourne, Victoria, AU
Anycast Global Backbone		 18.13 TiB 0.47% 18.13 TiB 0.00%
f01208189 Melbourne, Victoria, AU
Anycast Global Backbone		 17.43 TiB 0.45% 17.40 TiB 0.18%
f01208632 Melbourne, Victoria, AU
Anycast Global Backbone		 32.00 GiB 0.00% 32.00 GiB 0.00%
f022352 Oslo, Oslo, NO
Blix Solutions AS		 249.11 TiB 6.43% 248.73 TiB 0.15%
f010479 Paris, Île-de-France, FR
CELESTE SAS		 36.88 TiB 0.95% 32.58 TiB 11.67%
f01962819new Xi’an, Shaanxi, CN
China Telecom (Group)		 127.63 TiB 3.29% 127.54 TiB 0.07%
f01907545 Xi’an, Shaanxi, CN
China Telecom (Group)		 120.71 TiB 3.11% 120.71 TiB 0.00%
f01900823 Jinan, Shandong, CN
CHINA UNICOM China169 Backbone		 39.44 TiB 1.02% 39.41 TiB 0.08%
f01902461 Zhengzhou, Henan, CN
CHINANET-BACKBONE		 35.31 TiB 0.91% 35.31 TiB 0.00%
f01901765 Jiaxing, Zhejiang, CN
CHINANET-BACKBONE		 12.41 TiB 0.32% 8.53 TiB 31.23%
f01824635 Antwerpen, Flanders, BE
Cogent Communications		 43.03 TiB 1.11% 43.03 TiB 0.00%
f01858429 Boston, Massachusetts, US
Comcast Cable Communications, LLC		 122.99 TiB 3.17% 122.99 TiB 0.00%
f09848 Rancho Santa Margarita, California, US
Cox Communications Inc.		 45.49 TiB 1.17% 45.49 TiB 0.00%
f01992630 Dallas, Texas, US
Flexential Colorado Corp.		 127.51 TiB 3.29% 127.42 TiB 0.07%
f01928520 Maywood Park, Oregon, US
Flexential Colorado Corp.		 114.45 TiB 2.95% 114.45 TiB 0.00%
f01880047 Singapore, Singapore, SG
Gateway Communications		 129.41 TiB 3.34% 129.41 TiB 0.00%
f01882184 Singapore, Singapore, SG
Gateway Communications		 4.03 TiB 0.10% 4.03 TiB 0.00%
f01878201 Hangzhou, Zhejiang, CN
Hangzhou Alibaba Advertising Co.,Ltd.		 153.93 TiB 3.97% 136.13 TiB 11.56%
f01911083 Tuusula, Uusimaa, FI
Hetzner Online GmbH		 125.61 TiB 3.24% 125.52 TiB 0.07%
f010202 Hong Kong, Central and Western, HK
HK Broadband Network Ltd.		 3.13 TiB 0.08% 3.13 TiB 0.00%
f01896422new Fremont, California, US
Hurricane Electric LLC		 129.09 TiB 3.33% 128.97 TiB 0.10%
f0773157 Fremont, California, US
Hurricane Electric LLC		 176.00 GiB 0.00% 176.00 GiB 0.00%
f01926686 Hangzhou, Zhejiang, CN
Jiangxi Jiujiang IDC		 123.49 TiB 3.19% 123.49 TiB 0.00%
f099608 Riga, Riga, LV
JSC BALTICOM		 109.72 TiB 2.83% 109.63 TiB 0.09%
f01851482 Busan, Busan, KR
Korea Telecom		 26.16 TiB 0.67% 26.16 TiB 0.00%
f01385207 Lincoln, Nebraska, US
LightEdge Solutions		 18.31 TiB 0.47% 18.31 TiB 0.00%
f097777 Kivertsi, Volyn, UA
Link Telecom Service Ltd		 103.56 TiB 2.67% 98.60 TiB 4.79%
f01885088 Hong Kong, Central and Western, HK
OneAsia Network Limited		 125.44 TiB 3.24% 125.44 TiB 0.00%
f01926635 Hong Kong, Central and Western, HK
OneAsia Network Limited		 125.00 TiB 3.23% 125.00 TiB 0.00%
f01652333 Sunnyvale, California, US
Packet Host, Inc.		 7.40 TiB 0.19% 6.10 TiB 17.63%
f01732189 San Diego, California, US
ScaleMatrix		 22.30 TiB 0.58% 22.30 TiB 0.00%
f01852664 Singapore, Singapore, SG
StarHub Ltd		 19.25 TiB 0.50% 19.25 TiB 0.00%
f01119939 Atlanta, Georgia, US
Unitas Global LLC		 129.38 TiB 3.34% 129.38 TiB 0.00%
f01929565new Sydney, New South Wales, AU
Vocus Connect International Backbone		 86.69 TiB 2.24% 86.69 TiB 0.00%
f01901739 Sydney, New South Wales, AU
Vocus Connect International Backbone		 1.91 TiB 0.05% 1.91 TiB 0.00%
f01786387 Heerhugowaard, North Holland, NL
Wijnand Schouten trading as Speedium		 281.19 TiB 7.26% 266.31 TiB 5.29%
f01720359 Heerhugowaard, North Holland, NL
Wijnand Schouten trading as Speedium		 196.93 TiB 5.08% 182.20 TiB 7.48%
f01771403 Heerhugowaard, North Holland, NL
Wijnand Schouten trading as Speedium		 180.69 TiB 4.66% 171.24 TiB 5.23%
f01199442 Heerhugowaard, North Holland, NL
Wijnand Schouten trading as Speedium		 61.85 TiB 1.60% 61.82 TiB 0.05%
f01207045 Heerhugowaard, North Holland, NL
Wijnand Schouten trading as Speedium		 59.05 TiB 1.52% 59.05 TiB 0.00%
f01199430 Heerhugowaard, North Holland, NL
Wijnand Schouten trading as Speedium		 50.18 TiB 1.29% 50.12 TiB 0.13%
f01208862 Heerhugowaard, North Holland, NL
Wijnand Schouten trading as Speedium		 49.05 TiB 1.27% 49.05 TiB 0.00%
f01201327 Heerhugowaard, North Holland, NL
Wijnand Schouten trading as Speedium		 37.45 TiB 0.97% 37.45 TiB 0.00%

Provider Distribution

Deal Data Replication

The below table shows how each many unique data are replicated across storage providers.

✔️ Data replication looks healthy.

Unique Data Size Total Deals Made Number of Providers Deal Percentage
255.70 TiB 263.55 TiB 1 6.80%
152.89 TiB 315.37 TiB 2 8.14%
148.51 TiB 452.56 TiB 3 11.68%
14.73 TiB 61.14 TiB 4 1.58%
364.00 GiB 1.87 TiB 5 0.05%
32.00 GiB 416.00 GiB 13 0.01%
1.00 GiB 14.00 GiB 14 0.00%
100.00 GiB 1.50 TiB 15 0.04%
616.00 GiB 9.81 TiB 16 0.25%
1.73 TiB 30.12 TiB 17 0.78%
5.73 TiB 105.94 TiB 18 2.73%
14.81 TiB 288.58 TiB 19 7.45%
25.65 TiB 525.07 TiB 20 13.55%
31.80 TiB 684.47 TiB 21 17.66%
24.72 TiB 556.64 TiB 22 14.36%
16.20 TiB 379.13 TiB 23 9.78%
6.82 TiB 166.48 TiB 24 4.30%
1.26 TiB 31.68 TiB 25 0.82%
32.00 GiB 832.00 GiB 26 0.02%
8.00 GiB 216.00 GiB 27 0.01%

Replication Distribution

Deal Data Shared with other Clients

The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.

However, this could be possible if all below clients use same software to prepare for the exact same dataset or they belong to a series of LDN applications for the same dataset.

⚠️ CID sharing has been observed.

Other Client Application Total Deals Affected Unique CIDs Approvers
f15cps7yo2x4fosvp45opfihk3a4wg2qukmwyet7a Dcent network 3.71 PiB 18,148 3kernelogic
1liyunzhi-666
3mjroddy
1psh0691
1Reiers
1s0nik42
2xinaxu
f1pc5usvsbfgxxbq7c7quhhg6k7l6y5reiwqr3noy Speedium network 1.54 PiB 3,203 3kernelogic
1liyunzhi-666
1MegTei
1neogeweb3
2Reiers
3s0nik42
1xingjitansuo
f1c4tsscftr3a6ljujjn7zmfpd6q5vab62ylqxrmi Speedium network 987.44 TiB 1,913 2kernelogic
2MegTei
2Reiers
3s0nik42
1xingjitansuo
f17ia7m5mvizrdug3sqtevqw3tifiqvxqr3kdaeuq Speedium NetworkSpeedium Network 395.64 TiB 4,354 2dannyob
3flyworker
4MegTei
3Reiers
6s0nik42
f1mgnwoczfj25foxn4555wvwyak6rsynzy7z73azy 164.73 TiB 1,341 1xingjitansuo
f1xafi3wsh7q553efnumhgeomathrehwwd2mye7oy Speedium network 288.00 GiB 9 1flyworker
4kernelogic
1mjroddy
1Reiers
1s0nik42
1xinaxu
1xingjitansuo

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

Tom-OriginStorage commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

⚠️ 1 storage providers sealed too much duplicate data - f01901765: 31.23%

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

⚠️ CID sharing has been observed. (Top 3)

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the full report.

data-programs commented 1 year ago
KYC

This user’s identity has been verified through filplus.storage

Sunnyiscoming commented 11 months ago

Hello, @cryptowhizzard per the https://github.com/filecoin-project/notary-governance/issues/922 for Open, Public Dataset applicants, please complete the following Fil+ registration form to identify yourself as the applicant and also please add the contact information of the SP entities you are working with to store copies of the data.

This information will be reviewed by Fil+ Governance team to confirm validity and then the application will be allowed to move forward for additional notary review.

Tom-OriginStorage commented 8 months ago

checker:manualTrigger