filecoin-project / filecoin-plus-large-datasets

Hub for client applications for DataCap at a large scale
110 stars 62 forks source link

[DataCap Application] Kernelogic - Post Slingshot 2.8 continuation on NEXRAD dataset (3/3) #1006

Closed kernelogic closed 1 year ago

kernelogic commented 1 year ago

Large Dataset Notary Application

To apply for DataCap to onboard your dataset to Filecoin, please fill out the following.

Core Information

Please respond to the questions below by replacing the text saying "Please answer here". Include as much detail as you can in your answer.

Project details

Share a brief history of your project and organization.

Similarly to this LDN comment https://github.com/filecoin-project/filecoin-plus-large-datasets/issues/432#issuecomment-1204902669 from @dkkapur , as Slingshot 2.8 has ended, I'd like to continue storing the whole dataset to its completion under a new LDN, following the same rules as before.

This dataset is 2PB+, I have got one 5PB so this one I am requesting 15PB so that I can have approximately 10 replicas in total.

I have participated every Slingshot phase and is probably the best performing as a "small individual client". 

I have successfully completed a few LDNs on other datasets and I have record to show I have been following the rules of decentralization and have zero self dealing.

https://github.com/filecoin-project/filecoin-plus-large-datasets/issues/60
https://github.com/filecoin-project/filecoin-plus-large-datasets/issues/59
https://github.com/filecoin-project/filecoin-plus-large-datasets/issues/46
https://github.com/filecoin-project/filecoin-plus-large-datasets/issues/297
https://github.com/filecoin-project/filecoin-plus-large-datasets/issues/298
https://github.com/filecoin-project/filecoin-plus-large-datasets/issues/304

What is the primary source of funding for this project?

Self-funded, BigD exchange.

What other projects/ecosystem stakeholders is this project associated with?

enterprise-sp-wg, BigD exchange.

Use-case details

Describe the data being stored onto Filecoin

Real-time and archival data from the Next Generation Weather Radar (NEXRAD) network.

Where was the data in this dataset sourced from?

https://registry.opendata.aws/noaa-nexrad/

Can you share a sample of the data? A link to a file, an image, a table, etc., are good ways to do this.

The data is primarily compressed binary data. Below site demonstrate how to consume and render the data
https://nbviewer.org/gist/dopplershift/356f2e14832e9b676207

s3://noaa-nexrad-level2/2021/01/01/TSDF/TSDF20210101_235417_V08

Confirm that this is a public dataset that can be retrieved by anyone on the Network (i.e., no specific permissions or access rights are required to view the data).

AWS open dataset

What is the expected retrieval frequency for this data?

Infrequent. However all details are available at my browser https://slingshot.kernelogic.ca/nexrad.html?v=2.8

For how long do you plan to keep this dataset stored on Filecoin?

Between 365 - 520 days.

DataCap allocation plan

In which geographies (countries, regions) do you plan on making storage deals?

All regions.

How will you be distributing your data to storage providers? Is there an offline data transfer process?

I will upload my prepared CAR files to a web server and coordinate with providers to download and propose offline deals.

How do you plan on choosing the storage providers with whom you will be making deals? This should include a plan to ensure the data is retrievable in the future both by you and others.

Beside the previous SPs I have worked with, I also utilize bigD exchange to further decentralize the storage

To name a few from the community that I deal with regularly: PIKNIK, Holon, CabrinaHuang, HarryM, BigBear, j1v, XinAn Xu, WillTechMusing.

From BigD exchange: Mog Li, Devin Chen, DSS Nathanial Marsh, Rabinovitch, Vin K, arockpool Tony

How will you be distributing deals across storage providers?

Evenly across all providers I propose to, if they can handle. If a miner is a notary itself, this notary will receive no more than 20% of the total granted datacap.

Do you have the resources/funding to start making deals as soon as you receive DataCap? What support from the community would help you onboard onto Filecoin?

I have all I need to start making deals.
large-datacap-requests[bot] commented 1 year ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

large-datacap-requests[bot] commented 1 year ago

Thanks for your request!

Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!
large-datacap-requests[bot] commented 1 year ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

raghavrmadya commented 1 year ago

Datacap Request Trigger

Total DataCap requested

5PiB

Expected weekly DataCap usage rate

750TiB

Client address

f1yy7riqoc3vm7jv6nawupnytj4m6sajfuq7kqn6q

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Multisig Notary address

f01858410

Client address

f1tszopsyo4fs75f4ia5h25btfob7t6upmj2w27qq

DataCap allocation requested

256TiB

xiaoyuaiheshui commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceckie7s426h6ceylria5655lg2x7fsih6wlpqtv6sbnqqqyaojjdk

Address

f1tszopsyo4fs75f4ia5h25btfob7t6upmj2w27qq

Datacap Allocated

256.00TiB

Signer Address

f122qmy25wdtt5mxd77kndiq7z5x2n3iwiuz2wdsa

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceckie7s426h6ceylria5655lg2x7fsih6wlpqtv6sbnqqqyaojjdk

cryptowhizzard commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacebrteyusp3woexya6c2dyytsc6n6jkjawgvsp7vbgx7dwvg75duly

Address

f1tszopsyo4fs75f4ia5h25btfob7t6upmj2w27qq

Datacap Allocated

256.00TiB

Signer Address

f1krmypm4uoxxf3g7okrwtrahlmpcph3y7rbqqgfa

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebrteyusp3woexya6c2dyytsc6n6jkjawgvsp7vbgx7dwvg75duly

large-datacap-requests[bot] commented 1 year ago

Thanks for your request!

Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!
large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 2

Multisig Notary address

f01858410

Client address

f1tszopsyo4fs75f4ia5h25btfob7t6upmj2w27qq

DataCap allocation requested

512TiB

Id

08c6170b-4a83-494f-b02a-f4cafc8d6a83

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f1tszopsyo4fs75f4ia5h25btfob7t6upmj2w27qq

Last two approvers

cryptowhizzard & jggapp

Rule to calculate the allocation request amount

10% of total dc amount requested

DataCap allocation requested

512TiB

Total DataCap granted for client so far

256TiB

Datacap to be granted to reach the total amount requested by the client (5 PiB)

4.75PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
5547 11 256TiB 21.18 44.84TiB
xinaxu commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceccmmcnta6gdgzmy575pjksnu5xvib2i6clb5qzai5bpxls73qpzu

Address

f1tszopsyo4fs75f4ia5h25btfob7t6upmj2w27qq

Datacap Allocated

512.00TiB

Signer Address

f1k3ysofkrrmqcot6fkx4wnezpczlltpirmrpsgui

Id

08c6170b-4a83-494f-b02a-f4cafc8d6a83

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceccmmcnta6gdgzmy575pjksnu5xvib2i6clb5qzai5bpxls73qpzu

liyunzhi-666 commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacec3ktol7qhajbloxrp27ssjiu6otcvxgbsf4rzj6wgme7fx26elns

Address

f1tszopsyo4fs75f4ia5h25btfob7t6upmj2w27qq

Datacap Allocated

512.00TiB

Signer Address

f1pszcrsciyixyuxxukkvtazcokexbn54amf7gvoq

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacec3ktol7qhajbloxrp27ssjiu6otcvxgbsf4rzj6wgme7fx26elns

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 3

Multisig Notary address

f01858410

Client address

f1tszopsyo4fs75f4ia5h25btfob7t6upmj2w27qq

DataCap allocation requested

1PiB

Id

c852adeb-586d-4925-bdcd-964603867b3c

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f1tszopsyo4fs75f4ia5h25btfob7t6upmj2w27qq

Last two approvers

liyunzhi-666 & xinaxu

Rule to calculate the allocation request amount

20% of total dc amount requested

DataCap allocation requested

1PiB

Total DataCap granted for client so far

768TiB

Datacap to be granted to reach the total amount requested by the client (5 PiB)

4.25PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
18381 12 512TiB 17.47 118.28TiB
flyworker commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceat5274j3st43amsuuxe2lix6dfikz33hbt2c3wp72gxvde4ss6ei

Address

f1tszopsyo4fs75f4ia5h25btfob7t6upmj2w27qq

Datacap Allocated

1.00PiB

Signer Address

f1hlubjsdkv4wmsdadihloxgwrz3j3ernf6i3cbpy

Id

c852adeb-586d-4925-bdcd-964603867b3c

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceat5274j3st43amsuuxe2lix6dfikz33hbt2c3wp72gxvde4ss6ei

liyunzhi-666 commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacebolnq4ngptyaiikxosb2wl64m42wdbpu2oej5oidyl45umry4zxy

Address

f1tszopsyo4fs75f4ia5h25btfob7t6upmj2w27qq

Datacap Allocated

1.00PiB

Signer Address

f1pszcrsciyixyuxxukkvtazcokexbn54amf7gvoq

Id

c852adeb-586d-4925-bdcd-964603867b3c

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebolnq4ngptyaiikxosb2wl64m42wdbpu2oej5oidyl45umry4zxy

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 4

Multisig Notary address

f01858410

Client address

f1tszopsyo4fs75f4ia5h25btfob7t6upmj2w27qq

DataCap allocation requested

2PiB

Id

deb4a768-cb38-46db-ad1d-351945caa055

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f1tszopsyo4fs75f4ia5h25btfob7t6upmj2w27qq

Last two approvers

liyunzhi-666 & flyworker

Rule to calculate the allocation request amount

40% of total dc amount requested

DataCap allocation requested

2PiB

Total DataCap granted for client so far

1.75PiB

Datacap to be granted to reach the total amount requested by the client (5 PiB)

3.25PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
49506 26 1PiB 6.68 247.37TiB
newwebgroup commented 1 year ago

The distribution of Sps is very scattered, very good

newwebgroup commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceabycn7b5khpyaoy5drbxh4a652qnyxm6sldqls5lddlcw2mojd3s

Address

f1tszopsyo4fs75f4ia5h25btfob7t6upmj2w27qq

Datacap Allocated

2.00PiB

Signer Address

f1e77zuityhvvw6u2t6tb5qlnsegy2s67qs4lbbbq

Id

deb4a768-cb38-46db-ad1d-351945caa055

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceabycn7b5khpyaoy5drbxh4a652qnyxm6sldqls5lddlcw2mojd3s

cryptowhizzard commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceahanac4glrfyrji2rgicwxlfswmgd5tcutkxrzfumnuhixfq2e6k

Address

f1tszopsyo4fs75f4ia5h25btfob7t6upmj2w27qq

Datacap Allocated

2.00PiB

Signer Address

f1krmypm4uoxxf3g7okrwtrahlmpcph3y7rbqqgfa

Id

deb4a768-cb38-46db-ad1d-351945caa055

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceahanac4glrfyrji2rgicwxlfswmgd5tcutkxrzfumnuhixfq2e6k

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 5

Multisig Notary address

f01858410

Client address

f1tszopsyo4fs75f4ia5h25btfob7t6upmj2w27qq

DataCap allocation requested

1.25PiB

Id

2b7886b7-35fd-4ff4-b225-34f704e2b654

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f1tszopsyo4fs75f4ia5h25btfob7t6upmj2w27qq

Last two approvers

cryptowhizzard & newwebgroup

Rule to calculate the allocation request amount

80% of total dc amount requested

DataCap allocation requested

1.25PiB

Total DataCap granted for client so far

1.75PiB

Datacap to be granted to reach the total amount requested by the client (5 PiB)

3.25PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
49956 27 2PiB 6.62 247.37TiB
flyworker commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacec36hpcwcm3huj6cy5hums2vwezgzc5fv3byjmjzgfcwjugin42r2

Address

f1tszopsyo4fs75f4ia5h25btfob7t6upmj2w27qq

Datacap Allocated

1.25PiB

Signer Address

f1hlubjsdkv4wmsdadihloxgwrz3j3ernf6i3cbpy

Id

2b7886b7-35fd-4ff4-b225-34f704e2b654

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacec36hpcwcm3huj6cy5hums2vwezgzc5fv3byjmjzgfcwjugin42r2

liyunzhi-666 commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceblsuw4pdvyp663vdygx7dxrd3tyu3ulw3dkhnrirg6l465u2coza

Address

f1tszopsyo4fs75f4ia5h25btfob7t6upmj2w27qq

Datacap Allocated

1.25PiB

Signer Address

f1pszcrsciyixyuxxukkvtazcokexbn54amf7gvoq

Id

2b7886b7-35fd-4ff4-b225-34f704e2b654

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceblsuw4pdvyp663vdygx7dxrd3tyu3ulw3dkhnrirg6l465u2coza

filplus-checker commented 1 year ago

DataCap and CID Checker Report[^1]

If this is the first time a provider takes verified deal, it will be marked as new.

For most of the datacap application, below restrictions should apply.

✔️ Storage provider distribution looks healthy.

Provider Location Total Deals Sealed Percentage Unique Data Duplicate Deals
f01918045 Kuala Lumpur, Kuala Lumpur, MY 103.22 TiB 6.64% 103.22 TiB 0.00%
f01918046 Kuala Lumpur, Kuala Lumpur, MY 103.16 TiB 6.64% 103.16 TiB 0.00%
f01909705 Kuala Lumpur, Kuala Lumpur, MY 103.13 TiB 6.63% 103.13 TiB 0.00%
f01938674 Shenzhen, Guangdong, CN 101.63 TiB 6.54% 101.38 TiB 0.25%
f01938671 Hong Kong, Central and Western, HK 87.66 TiB 5.64% 87.50 TiB 0.18%
f01660795 Shenzhen, Guangdong, CN 79.81 TiB 5.13% 79.56 TiB 0.31%
f01923787 Shenzhen, Guangdong, CN 77.47 TiB 4.98% 77.22 TiB 0.32%
f01949267new Shanghai, Shanghai, CN 76.75 TiB 4.94% 76.75 TiB 0.00%
f01949260new Shanghai, Shanghai, CN 76.75 TiB 4.94% 76.75 TiB 0.00%
f01923786 Hong Kong, Central and Western, HK 65.81 TiB 4.23% 65.59 TiB 0.33%
f01859603 Shenzhen, Guangdong, CN 61.56 TiB 3.96% 61.34 TiB 0.36%
f0143858 Clifton, New Jersey, US 60.75 TiB 3.91% 60.75 TiB 0.00%
f03223 San Jose, California, US 56.13 TiB 3.61% 56.13 TiB 0.00%
f0240185 Clifton, New Jersey, US 55.19 TiB 3.55% 55.19 TiB 0.00%
f02301 San Jose, California, US 54.69 TiB 3.52% 54.69 TiB 0.00%
f01889668 San Jose, California, US 48.50 TiB 3.12% 48.50 TiB 0.00%
f01518369 San Jose, California, US 48.50 TiB 3.12% 48.50 TiB 0.00%
f01873432 Las Vegas, Nevada, US 46.97 TiB 3.02% 46.97 TiB 0.00%
f01927554 Shenzhen, Guangdong, CN 43.00 TiB 2.77% 43.00 TiB 0.00%
f01904630 Las Vegas, Nevada, US 41.34 TiB 2.66% 41.34 TiB 0.00%
f0397083 Tokyo, Tokyo, JP 37.50 TiB 2.41% 37.50 TiB 0.00%
f0142637 Chengdu, Sichuan, CN 25.00 TiB 1.61% 25.00 TiB 0.00%
f01946104 Chengdu, Sichuan, CN 18.75 TiB 1.21% 18.75 TiB 0.00%
f0392458 Shanghai, Shanghai, CN 18.38 TiB 1.18% 18.38 TiB 0.00%
f01985775 Dallas, Texas, US 14.06 TiB 0.90% 14.06 TiB 0.00%
f01985745 Dallas, Texas, US 14.06 TiB 0.90% 14.06 TiB 0.00%
f033462 Dallas, Texas, US 14.06 TiB 0.90% 14.06 TiB 0.00%
f01943663 Hong Kong, Central and Western, HK 14.03 TiB 0.90% 14.03 TiB 0.00%
f01989888new Hong Kong, Central and Western, HK 6.69 TiB 0.43% 6.69 TiB 0.00%

Provider Distribution

Deal Data Replication

The below table shows how each many unique data are replicated across storage providers.

⚠️ 39.21% of deals are for data replicated across less than 4 storage providers.

Unique Data Size Total Deals Made Number of Providers Deal Percentage
17.66 TiB 17.66 TiB 1 1.14%
114.38 TiB 228.75 TiB 2 14.72%
121.03 TiB 363.09 TiB 3 23.36%
42.72 TiB 170.88 TiB 4 10.99%
39.47 TiB 197.34 TiB 5 12.69%
25.97 TiB 155.88 TiB 6 10.03%
37.34 TiB 262.59 TiB 7 16.89%
19.78 TiB 158.34 TiB 8 10.19%

Replication Distribution

Deal Data Shared with other Clients

The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.

⚠️ CID sharing has been observed.

Other Client Application Total Deals Affected Unique CIDs Verifier
f154a4iq5mxq76avoooc5a3unchfbrjg7itkjfl6y Fei Yan - Kernelogic 1.28 PiB 11,128 LDN v3 multisig
f1yy7riqoc3vm7jv6nawupnytj4m6sajfuq7kqn6q Fei Yan - Kernelogic 1.03 PiB 9,545 LDN v3 multisig
f3waskb5svh6ywfzhm2khvsomjlgb5rif6flf2bcy
n3ift7xswlffifn32jmvttf7o43zchku2manh7y34
w4pq
Unknown 320.00 GiB 2 Unknown

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

filplus-checker commented 1 year ago

DataCap and CID Checker Report[^1]

If this is the first time a provider takes verified deal, it will be marked as new.

For most of the datacap application, below restrictions should apply.

✔️ Storage provider distribution looks healthy.

Provider Location Total Deals Sealed Percentage Unique Data Duplicate Deals
f01918045 Kampar, Perak, MY
Extreme Broadband
103.22 TiB 6.41% 103.22 TiB 0.00%
f01918046 Kampar, Perak, MY
Extreme Broadband
103.16 TiB 6.41% 103.16 TiB 0.00%
f01909705 Kampar, Perak, MY
Extreme Broadband
103.13 TiB 6.40% 103.13 TiB 0.00%
f01938674 Shenzhen, Guangdong, CN
Unknown
101.63 TiB 6.31% 101.38 TiB 0.25%
f01938671 Hong Kong, Central and Western, HK
PSINet, Inc.
87.66 TiB 5.44% 87.50 TiB 0.18%
f01660795 Shenzhen, Guangdong, CN
Unknown
79.81 TiB 4.96% 79.56 TiB 0.31%
f01923787 Shenzhen, Guangdong, CN
Unknown
77.47 TiB 4.81% 77.22 TiB 0.32%
f01949267new Shanghai, Shanghai, CN
Unknown
76.75 TiB 4.77% 76.75 TiB 0.00%
f01949260new Shanghai, Shanghai, CN
Unknown
76.75 TiB 4.77% 76.75 TiB 0.00%
f01923786 Hong Kong, Central and Western, HK
PSINet, Inc.
65.81 TiB 4.09% 65.59 TiB 0.33%
f01859603 Shenzhen, Guangdong, CN
Unknown
61.56 TiB 3.82% 61.34 TiB 0.36%
f0143858 Clifton, New Jersey, US
DigitalOcean, LLC
60.75 TiB 3.77% 60.75 TiB 0.00%
f03223 San Jose, California, US
Evocative, Inc.
56.13 TiB 3.49% 56.13 TiB 0.00%
f0240185 Clifton, New Jersey, US
DigitalOcean, LLC
55.19 TiB 3.43% 55.19 TiB 0.00%
f01873432 Las Vegas, Nevada, US
PSINet, Inc.
55.16 TiB 3.43% 55.16 TiB 0.00%
f01904630 Las Vegas, Nevada, US
PSINet, Inc.
55.06 TiB 3.42% 55.06 TiB 0.00%
f02301 San Jose, California, US
Evocative, Inc.
54.69 TiB 3.40% 54.69 TiB 0.00%
f01518369 San Jose, California, US
PSINet, Inc.
48.50 TiB 3.01% 48.50 TiB 0.00%
f01889668 San Jose, California, US
PSINet, Inc.
48.50 TiB 3.01% 48.50 TiB 0.00%
f01927554 Shenzhen, Guangdong, CN
Unknown
43.00 TiB 2.67% 43.00 TiB 0.00%
f0397083 Tokyo, Tokyo, JP
Alibaba.com Singapore E-Commerce Private Limited
37.50 TiB 2.33% 37.50 TiB 0.00%
f01989888new Hong Kong, Central and Western, HK
Unknown
26.56 TiB 1.65% 26.56 TiB 0.00%
f0142637 Chengdu, Sichuan, CN
Unknown
25.00 TiB 1.55% 25.00 TiB 0.00%
f01946104 Chengdu, Sichuan, CN
Unknown
18.75 TiB 1.16% 18.75 TiB 0.00%
f0392458 Shanghai, Shanghai, CN
Unknown
18.38 TiB 1.14% 18.38 TiB 0.00%
f01985745 Louisville, Kentucky, US
Flexential Corp.
14.06 TiB 0.87% 14.06 TiB 0.00%
f033462 Louisville, Kentucky, US
Flexential Corp.
14.06 TiB 0.87% 14.06 TiB 0.00%
f01985775 Louisville, Kentucky, US
Flexential Corp.
14.06 TiB 0.87% 14.06 TiB 0.00%
f01943663 Singapore, Singapore, SG
Singapore Telecommunications (SINGTEL Internet Exchange)
14.03 TiB 0.87% 14.03 TiB 0.00%
f01964132 Bangkok, Bangkok, TH
Unknown
13.97 TiB 0.87% 13.97 TiB 0.00%

Provider Distribution

Deal Data Replication

The below table shows how each many unique data are replicated across storage providers.

⚠️ 36.73% of deals are for data replicated across less than 4 storage providers.

Unique Data Size Total Deals Made Number of Providers Deal Percentage
37.53 TiB 37.53 TiB 1 2.33%
107.41 TiB 214.81 TiB 2 13.34%
113.06 TiB 339.19 TiB 3 21.06%
43.69 TiB 174.75 TiB 4 10.85%
53.44 TiB 267.19 TiB 5 16.59%
25.97 TiB 155.88 TiB 6 9.68%
37.34 TiB 262.59 TiB 7 16.31%
19.78 TiB 158.34 TiB 8 9.83%

Replication Distribution

Deal Data Shared with other Clients

The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.

⚠️ CID sharing has been observed.

Other Client Application Total Deals Affected Unique CIDs Verifier
f154a4iq5mxq76avoooc5a3unchfbrjg7itkjfl6y Fei Yan - Kernelogic 1.29 PiB 11,596 LDN v3 multisig
f1yy7riqoc3vm7jv6nawupnytj4m6sajfuq7kqn6q Fei Yan - Kernelogic 1.03 PiB 9,545 LDN v3 multisig
f3waskb5svh6ywfzhm2khvsomjlgb5rif6flf2bcy
n3ift7xswlffifn32jmvttf7o43zchku2manh7y34
w4pq
Unknown 320.00 GiB 2 Unknown

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

filplus-checker commented 1 year ago

DataCap and CID Checker Report[^1]

If this is the first time a provider takes verified deal, it will be marked as new.

For most of the datacap application, below restrictions should apply.

✔️ Storage provider distribution looks healthy.

Provider Location Total Deals Sealed Percentage Unique Data Duplicate Deals
f01918045 Kampar, Perak, MY
Extreme Broadband
103.22 TiB 6.41% 103.22 TiB 0.00%
f01918046 Kampar, Perak, MY
Extreme Broadband
103.16 TiB 6.41% 103.16 TiB 0.00%
f01909705 Kampar, Perak, MY
Extreme Broadband
103.13 TiB 6.40% 103.13 TiB 0.00%
f01938674 Shenzhen, Guangdong, CN
``
101.63 TiB 6.31% 101.38 TiB 0.25%
f01938671 Hong Kong, Central and Western, HK
``
87.66 TiB 5.44% 87.50 TiB 0.18%
f01660795 Shenzhen, Guangdong, CN
``
79.81 TiB 4.96% 79.56 TiB 0.31%
f01923787 Shenzhen, Guangdong, CN
``
77.47 TiB 4.81% 77.22 TiB 0.32%
f01949267new Shanghai, Shanghai, CN
``
76.75 TiB 4.77% 76.75 TiB 0.00%
f01949260new Shanghai, Shanghai, CN
``
76.75 TiB 4.77% 76.75 TiB 0.00%
f01923786 Hong Kong, Central and Western, HK
``
65.81 TiB 4.09% 65.59 TiB 0.33%
f01859603 Shenzhen, Guangdong, CN
``
61.56 TiB 3.82% 61.34 TiB 0.36%
f0143858 Clifton, New Jersey, US
DigitalOcean, LLC
60.75 TiB 3.77% 60.75 TiB 0.00%
f03223 San Jose, California, US
Evocative, Inc.
56.13 TiB 3.49% 56.13 TiB 0.00%
f0240185 Clifton, New Jersey, US
DigitalOcean, LLC
55.19 TiB 3.43% 55.19 TiB 0.00%
f01873432 Las Vegas, Nevada, US
Org-Name
55.16 TiB 3.43% 55.16 TiB 0.00%
f01904630 Las Vegas, Nevada, US
Org-Name
55.06 TiB 3.42% 55.06 TiB 0.00%
f02301 San Jose, California, US
Evocative, Inc.
54.69 TiB 3.40% 54.69 TiB 0.00%
f01518369 San Jose, California, US
Org-Name
48.50 TiB 3.01% 48.50 TiB 0.00%
f01889668 San Jose, California, US
Org-Name
48.50 TiB 3.01% 48.50 TiB 0.00%
f01927554 Shenzhen, Guangdong, CN
``
43.00 TiB 2.67% 43.00 TiB 0.00%
f0397083 Tokyo, Tokyo, JP
Alibaba.com Singapore E-Commerce Private Limited
37.50 TiB 2.33% 37.50 TiB 0.00%
f01989888new Hong Kong, Central and Western, HK
``
26.56 TiB 1.65% 26.56 TiB 0.00%
f0142637 Chengdu, Sichuan, CN
``
25.00 TiB 1.55% 25.00 TiB 0.00%
f01946104 Chengdu, Sichuan, CN
``
18.75 TiB 1.16% 18.75 TiB 0.00%
f0392458 Shanghai, Shanghai, CN
``
18.38 TiB 1.14% 18.38 TiB 0.00%
f01985745 Louisville, Kentucky, US
Flexential Corp.
14.06 TiB 0.87% 14.06 TiB 0.00%
f033462 Louisville, Kentucky, US
Flexential Corp.
14.06 TiB 0.87% 14.06 TiB 0.00%
f01985775 Louisville, Kentucky, US
Flexential Corp.
14.06 TiB 0.87% 14.06 TiB 0.00%
f01943663 Singapore, Singapore, SG
Singapore Telecommunications (SINGTEL Internet Exchange)
14.03 TiB 0.87% 14.03 TiB 0.00%
f01964132 Bangkok, Bangkok, TH
``
13.97 TiB 0.87% 13.97 TiB 0.00%

Provider Distribution

Deal Data Replication

The below table shows how each many unique data are replicated across storage providers.

⚠️ 36.73% of deals are for data replicated across less than 4 storage providers.

Unique Data Size Total Deals Made Number of Providers Deal Percentage
37.53 TiB 37.53 TiB 1 2.33%
107.41 TiB 214.81 TiB 2 13.34%
113.06 TiB 339.19 TiB 3 21.06%
43.69 TiB 174.75 TiB 4 10.85%
53.44 TiB 267.19 TiB 5 16.59%
25.97 TiB 155.88 TiB 6 9.68%
37.34 TiB 262.59 TiB 7 16.31%
19.78 TiB 158.34 TiB 8 9.83%

Replication Distribution

Deal Data Shared with other Clients

The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.

⚠️ CID sharing has been observed.

Other Client Application Total Deals Affected Unique CIDs Verifier
f154a4iq5mxq76avoooc5a3unchfbrjg7itkjfl6y Fei Yan - Kernelogic 1.29 PiB 11,596 LDN v3 multisig
f1yy7riqoc3vm7jv6nawupnytj4m6sajfuq7kqn6q Fei Yan - Kernelogic 1.03 PiB 9,545 LDN v3 multisig
f3waskb5svh6ywfzhm2khvsomjlgb5rif6flf2bcy
n3ift7xswlffifn32jmvttf7o43zchku2manh7y34
w4pq
Unknown 320.00 GiB 2 Unknown

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

filplus-checker commented 1 year ago

DataCap and CID Checker Report[^1]

If this is the first time a provider takes verified deal, it will be marked as new.

For most of the datacap application, below restrictions should apply.

✔️ Storage provider distribution looks healthy.

Provider Location Total Deals Sealed Percentage Unique Data Duplicate Deals
f01918045 Kampar, Perak, MY
Extreme Broadband - Total Broadband Experience
103.22 TiB 6.41% 103.22 TiB 0.00%
f01918046 Kampar, Perak, MY
Extreme Broadband - Total Broadband Experience
103.16 TiB 6.41% 103.16 TiB 0.00%
f01909705 Kampar, Perak, MY
Extreme Broadband - Total Broadband Experience
103.13 TiB 6.40% 103.13 TiB 0.00%
f01938674 Shenzhen, Guangdong, CN
CHINANET-BACKBONE
101.63 TiB 6.31% 101.38 TiB 0.25%
f01938671 Hong Kong, Central and Western, HK
HONG KONG BRIDGE INFO-TECH LIMITED
87.66 TiB 5.44% 87.50 TiB 0.18%
f01660795 Shenzhen, Guangdong, CN
CHINANET-BACKBONE
79.81 TiB 4.96% 79.56 TiB 0.31%
f01923787 Shenzhen, Guangdong, CN
China Telecom (Group)
77.47 TiB 4.81% 77.22 TiB 0.32%
f01949267new Shanghai, Shanghai, CN
Fuzhou
76.75 TiB 4.77% 76.75 TiB 0.00%
f01949260new Shanghai, Shanghai, CN
Fuzhou
76.75 TiB 4.77% 76.75 TiB 0.00%
f01923786 Hong Kong, Central and Western, HK
HONG KONG BRIDGE INFO-TECH LIMITED
65.81 TiB 4.09% 65.59 TiB 0.33%
f01859603 Shenzhen, Guangdong, CN
China Telecom (Group)
61.56 TiB 3.82% 61.34 TiB 0.36%
f0143858 Clifton, New Jersey, US
DigitalOcean, LLC
60.75 TiB 3.77% 60.75 TiB 0.00%
f03223 San Jose, California, US
Krypt Technologies
56.13 TiB 3.49% 56.13 TiB 0.00%
f0240185 Clifton, New Jersey, US
DigitalOcean, LLC
55.19 TiB 3.43% 55.19 TiB 0.00%
f01873432 Las Vegas, Nevada, US
PiKNiK & Company Inc.
55.16 TiB 3.43% 55.16 TiB 0.00%
f01904630 Las Vegas, Nevada, US
PiKNiK & Company Inc.
55.06 TiB 3.42% 55.06 TiB 0.00%
f02301 San Jose, California, US
Krypt Technologies
54.69 TiB 3.40% 54.69 TiB 0.00%
f01518369 San Jose, California, US
HONG KONG Megalayer Technology Co.,Limited
48.50 TiB 3.01% 48.50 TiB 0.00%
f01889668 San Jose, California, US
HONG KONG Megalayer Technology Co.,Limited
48.50 TiB 3.01% 48.50 TiB 0.00%
f01927554 Shenzhen, Guangdong, CN
CHINANET-BACKBONE
43.00 TiB 2.67% 43.00 TiB 0.00%
f0397083 Tokyo, Tokyo, JP
Alibaba (US) Technology Co., Ltd.
37.50 TiB 2.33% 37.50 TiB 0.00%
f01989888new Hong Kong, Central and Western, HK
OneAsia Network Limited
26.56 TiB 1.65% 26.56 TiB 0.00%
f0142637 Chengdu, Sichuan, CN
CHINANET-BACKBONE
25.00 TiB 1.55% 25.00 TiB 0.00%
f01946104 Chengdu, Sichuan, CN
CHINANET-BACKBONE
18.75 TiB 1.16% 18.75 TiB 0.00%
f0392458 Shanghai, Shanghai, CN
Fuzhou
18.38 TiB 1.14% 18.38 TiB 0.00%
f01985745 Louisville, Kentucky, US
Flexential Colorado Corp.
14.06 TiB 0.87% 14.06 TiB 0.00%
f033462 Louisville, Kentucky, US
Flexential Colorado Corp.
14.06 TiB 0.87% 14.06 TiB 0.00%
f01985775 Louisville, Kentucky, US
Flexential Colorado Corp.
14.06 TiB 0.87% 14.06 TiB 0.00%
f01943663 Singapore, Singapore, SG
Singapore Telecommunications Ltd
14.03 TiB 0.87% 14.03 TiB 0.00%
f01964132 Bangkok, Bangkok, TH
HUAWEI CLOUDS
13.97 TiB 0.87% 13.97 TiB 0.00%

Provider Distribution

Deal Data Replication

The below table shows how each many unique data are replicated across storage providers.

⚠️ 36.73% of deals are for data replicated across less than 4 storage providers.

Unique Data Size Total Deals Made Number of Providers Deal Percentage
37.53 TiB 37.53 TiB 1 2.33%
107.41 TiB 214.81 TiB 2 13.34%
113.06 TiB 339.19 TiB 3 21.06%
43.69 TiB 174.75 TiB 4 10.85%
53.44 TiB 267.19 TiB 5 16.59%
25.97 TiB 155.88 TiB 6 9.68%
37.34 TiB 262.59 TiB 7 16.31%
19.78 TiB 158.34 TiB 8 9.83%

Replication Distribution

Deal Data Shared with other Clients

The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.

⚠️ CID sharing has been observed.

Other Client Application Total Deals Affected Unique CIDs Verifier
f154a4iq5mxq76avoooc5a3unchfbrjg7itkjfl6y Fei Yan - Kernelogic 1.29 PiB 11,596 LDN v3 multisig
f1yy7riqoc3vm7jv6nawupnytj4m6sajfuq7kqn6q Fei Yan - Kernelogic 1.03 PiB 9,545 LDN v3 multisig
f3waskb5svh6ywfzhm2khvsomjlgb5rif6flf2bcy
n3ift7xswlffifn32jmvttf7o43zchku2manh7y34
w4pq
Unknown 320.00 GiB 2 Unknown

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

filplus-checker commented 1 year ago

DataCap and CID Checker Report[^1]

If this is the first time a provider takes verified deal, it will be marked as new.

For most of the datacap application, below restrictions should apply.

✔️ Storage provider distribution looks healthy.

Provider Location Total Deals Sealed Percentage Unique Data Duplicate Deals
f0397083 Tokyo, Tokyo, JP
Alibaba (US) Technology Co., Ltd.
37.50 TiB 2.33% 37.50 TiB 0.00%
f01923787 Shenzhen, Guangdong, CN
China Telecom (Group)
77.47 TiB 4.81% 77.22 TiB 0.32%
f01859603 Shenzhen, Guangdong, CN
China Telecom (Group)
61.56 TiB 3.82% 61.34 TiB 0.36%
f01938674 Shenzhen, Guangdong, CN
CHINANET-BACKBONE
101.63 TiB 6.31% 101.38 TiB 0.25%
f01660795 Shenzhen, Guangdong, CN
CHINANET-BACKBONE
79.81 TiB 4.96% 79.56 TiB 0.31%
f01927554 Shenzhen, Guangdong, CN
CHINANET-BACKBONE
43.00 TiB 2.67% 43.00 TiB 0.00%
f0142637 Chengdu, Sichuan, CN
CHINANET-BACKBONE
25.00 TiB 1.55% 25.00 TiB 0.00%
f01946104 Chengdu, Sichuan, CN
CHINANET-BACKBONE
18.75 TiB 1.16% 18.75 TiB 0.00%
f0143858 Clifton, New Jersey, US
DigitalOcean, LLC
60.75 TiB 3.77% 60.75 TiB 0.00%
f0240185 Clifton, New Jersey, US
DigitalOcean, LLC
55.19 TiB 3.43% 55.19 TiB 0.00%
f01918045 Kampar, Perak, MY
Extreme Broadband - Total Broadband Experience
103.22 TiB 6.41% 103.22 TiB 0.00%
f01918046 Kampar, Perak, MY
Extreme Broadband - Total Broadband Experience
103.16 TiB 6.41% 103.16 TiB 0.00%
f01909705 Kampar, Perak, MY
Extreme Broadband - Total Broadband Experience
103.13 TiB 6.40% 103.13 TiB 0.00%
f01985745 Louisville, Kentucky, US
Flexential Colorado Corp.
14.06 TiB 0.87% 14.06 TiB 0.00%
f033462 Louisville, Kentucky, US
Flexential Colorado Corp.
14.06 TiB 0.87% 14.06 TiB 0.00%
f01985775 Louisville, Kentucky, US
Flexential Colorado Corp.
14.06 TiB 0.87% 14.06 TiB 0.00%
f01949267new Shanghai, Shanghai, CN
Fuzhou
76.75 TiB 4.77% 76.75 TiB 0.00%
f01949260new Shanghai, Shanghai, CN
Fuzhou
76.75 TiB 4.77% 76.75 TiB 0.00%
f0392458 Shanghai, Shanghai, CN
Fuzhou
18.38 TiB 1.14% 18.38 TiB 0.00%
f01938671 Hong Kong, Central and Western, HK
HONG KONG BRIDGE INFO-TECH LIMITED
87.66 TiB 5.44% 87.50 TiB 0.18%
f01923786 Hong Kong, Central and Western, HK
HONG KONG BRIDGE INFO-TECH LIMITED
65.81 TiB 4.09% 65.59 TiB 0.33%
f01518369 San Jose, California, US
HONG KONG Megalayer Technology Co.,Limited
48.50 TiB 3.01% 48.50 TiB 0.00%
f01889668 San Jose, California, US
HONG KONG Megalayer Technology Co.,Limited
48.50 TiB 3.01% 48.50 TiB 0.00%
f01964132 Bangkok, Bangkok, TH
HUAWEI CLOUDS
13.97 TiB 0.87% 13.97 TiB 0.00%
f03223 San Jose, California, US
Krypt Technologies
56.13 TiB 3.49% 56.13 TiB 0.00%
f02301 San Jose, California, US
Krypt Technologies
54.69 TiB 3.40% 54.69 TiB 0.00%
f01989888new Hong Kong, Central and Western, HK
OneAsia Network Limited
26.56 TiB 1.65% 26.56 TiB 0.00%
f01873432 Las Vegas, Nevada, US
PiKNiK & Company Inc.
55.16 TiB 3.43% 55.16 TiB 0.00%
f01904630 Las Vegas, Nevada, US
PiKNiK & Company Inc.
55.06 TiB 3.42% 55.06 TiB 0.00%
f01943663 Singapore, Singapore, SG
Singapore Telecommunications Ltd
14.03 TiB 0.87% 14.03 TiB 0.00%

Provider Distribution

Deal Data Replication

The below table shows how each many unique data are replicated across storage providers.

⚠️ 36.73% of deals are for data replicated across less than 4 storage providers.

Unique Data Size Total Deals Made Number of Providers Deal Percentage
37.53 TiB 37.53 TiB 1 2.33%
107.41 TiB 214.81 TiB 2 13.34%
113.06 TiB 339.19 TiB 3 21.06%
43.69 TiB 174.75 TiB 4 10.85%
53.44 TiB 267.19 TiB 5 16.59%
25.97 TiB 155.88 TiB 6 9.68%
37.34 TiB 262.59 TiB 7 16.31%
19.78 TiB 158.34 TiB 8 9.83%

Replication Distribution

Deal Data Shared with other Clients

The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.

⚠️ CID sharing has been observed.

Other Client Application Total Deals Affected Unique CIDs Verifier
f154a4iq5mxq76avoooc5a3unchfbrjg7itkjfl6y Fei Yan - Kernelogic 1.29 PiB 11,596 LDN v3 multisig
f1yy7riqoc3vm7jv6nawupnytj4m6sajfuq7kqn6q Fei Yan - Kernelogic 1.03 PiB 9,545 LDN v3 multisig
f3waskb5svh6ywfzhm2khvsomjlgb5rif6flf2bcy
n3ift7xswlffifn32jmvttf7o43zchku2manh7y34
w4pq
Unknown 320.00 GiB 2 Unknown

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

kernelogic commented 1 year ago

Fully allocated. Closing issue. Thanks everyone!

C00kies77 commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 35.85% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

⚠️ CID sharing has been observed. (Top 3)

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the full report.

large-datacap-requests[bot] commented 8 months ago

Thanks for your request! :exclamation: We have found some problems in the information provided. We could not find Website \/ Social Media field in the information provided We could not find Total amount of DataCap being requested (between 500 TiB and 5 PiB) field in the information provided We could not find Weekly allocation of DataCap requested (usually between 1-100TiB) field in the information provided We could not find On-chain address for first allocation field in the information provided We could not find Data Type of Application field in the information provided

Please, take a look at the request and edit the body of the issue providing all the required information.
large-datacap-requests[bot] commented 6 months ago

RootKeyHolders have approved multisig account. You can now request first datacap release