filecoin-project / filecoin-plus-large-datasets

Hub for client applications for DataCap at a large scale
109 stars 62 forks source link

[DataCap Application] Filecoin Deal Auctions #61

Closed andrewxhill closed 1 year ago

andrewxhill commented 3 years ago

Large Dataset Notary Application

To apply for DataCap to onboard your dataset to Filecoin, please fill out the following.

Core Information

Please respond to the questions below by replacing the text saying "Please answer here". Include as much detail as you can in your answer.

Project details

Share a brief history of your project and organization.

Our project began with our initial ambition to build [Powergate](https://github.com/textileio/powergate) and integrate it into our hosted platform, [the Hub](https://blog.textile.io/the-textile-hub-joins-filecoin-mainnet/), plus help other users integrate it for using Filecoin. We found that it was difficult to make a high number of deals on the network at competitive rates with minimal error rates. To solve those challenges and enable higher throughput deal-making on the network, we [announced our work on a deal auction layer for Filecoin](https://blog.textile.io/introducing-storage-auctions-filecoin/).

Auctions are an exciting primitive for the network because they inverse much of the deal-making flow. First, clients submit deal proposals as auctions. Next, storage providers bid in real-time for the right to store that deal. Finally, winners are selected according to a simple and open algorithm, and the deals are made. This simple three-step flow dramatically reduces the complexity of deal-making, reduces errors, and increases throughput on the network. Additionally, it's done with minimal impact on storage providers, making it easy to tune their bidding to match their infrastructure capabilities. 

Since launch, our deal auction system has stored 120TiB on the network across 32 storage providers. We've [opened the system metrics](https://textileio.retool.com/embedded/public/fbf59411-760a-4a1a-b5b8-43f42061685d) for all to review in real-time. 

We've made our deals using datacap from a series of smaller applications you can find in [GitHub history](https://github.com/filecoin-project/filecoin-plus-client-onboarding/issues?q=is%3Aissue+is%3Aclosed+author%3Aandrewxhill).

Our vision is to continue pushing our ability to add throughput and stability to the network through deal auctioning. While they are currently in prototype, we believe we can turn them into a decentralized building block on the Filecoin network.   

What is the primary source of funding for this project?

Textile has received both VC investment and foundation grants in the past to help build this and other projects. 

What other projects/ecosystem stakeholders is this project associated with?

Auctions can be used all or in part by other projects. Right now, three clients are at varying stages of onboarding, including a collaborations with web3.storage, Opscientia, and the eth.storage bridge. We've recently released an [auction client](https://github.com/textileio/go-auctions-client) that allows clients to sign their own deals and use their own datacap. Most if not all of the deals made by the listed clients will migrate to using their own datacap over time. In the interim, and whenever we onboard new auctions users, we aim to have datacap available for rapid onboarding while they learn how to use the system. 

Use-case details

Describe the data being stored onto Filecoin

There is varying data being stored through auctions including primarily NFT assets, public and research datasets.

Where was the data in this dataset sourced from?

We don't do the sourcing directly, so the auction clients are doing sourcing through their collaborations and APIs. So far, the largest user of auctions has been the web3.storage team. Others are in the early phases of onboarding to the system.

Can you share a sample of the data? A link to a file, an image, a table, etc., are good ways to do this.

You can use our public metrics dashboard to explore all data being stored. 

* https://textileio.retool.com/embedded/public/fbf59411-760a-4a1a-b5b8-43f42061685d
* Use the provider search at the bottom to view all storage records with any provider. e.g. https://textileio.retool.com/embedded/public/46e74cd2-c47c-42ac-b542-189925795c41#provider=f020378

Confirm that this is a public dataset that can be retrieved by anyone on the Network (i.e., no specific permissions or access rights are required to view the data).

We will only onboard clients to the auctioneer (using our datacap) that have public datasets. In cases where private data are being stored, we will require them to use their own wallet and therefor apply for their own datacap.

What is the expected retrieval frequency for this data?

Varying. Some projects such as Opscientia are actively working to understand the data architecture requirements on Filecoin and begin experimentation with retrieval. 

For how long do you plan to keep this dataset stored on Filecoin?

Varying. Again, this is something that each client of the auctions system will address in their own plans. We will work with them to enable future storage renewals and deal monitoring.

DataCap allocation plan

In which geographies (countries, regions) do you plan on making storage deals?

We don't favor one geography over another. 

https://textileio.retool.com/embedded/public/fbf59411-760a-4a1a-b5b8-43f42061685d

How will you be distributing your data to storage providers? Is there an offline data transfer process?

There is an offline data transfer, but only because it allows data transfer to be "pull" based from the storage provider's perspective. This means, that when they win an auction they can fetch data on demand. As the online deal flow becomes more flexible, we'll migrate to that API.

How do you plan on choosing the storage providers with whom you will be making deals? This should include a plan to ensure the data is retrievable in the future both by you and others.

Provider selection:

Providers are selected by a simple algorithm per replica. For example, if you store a file with replication = 3:

1. Select all cheapest bids that match deal requirements (e.g. fast-retrieval).
2. For the first replica, choose the provider from the pool (step 1) with the highest reputation. Reputation is a time-decay function over a week of failures. So the provider that has the least recent deal failures will win.
3. For the second replica, choose the provider that has won an auction the least in a rolling window of one week. This ensures newly active or unlucky providers make it into the winning pool.
4. For the third replica, choose a provider at random.

Any provider can join the bidding pool by running [bidbot](https://github.com/textileio/bidbot).

Data security and retrieval:
* All data is stored in replica (we recommend 5 to clients).
* By default, all deals include fast-retrieval.
* We will explore adding retrieval reputation to future selection algorithms.

How will you be distributing deals across storage providers?

See above. Bidbot plus winner algorithm. 
I believe we are among the most decentralized (in terms of provider choice) clients on the network today. See the first pie-chart here https://textileio.retool.com/embedded/public/fbf59411-760a-4a1a-b5b8-43f42061685d for a sense of our distribution across connected providers.

Do you have the resources/funding to start making deals as soon as you receive DataCap? What support from the community would help you onboard onto Filecoin?

Yes.
andrewxhill commented 2 years ago

DataCap Allocation requested

Multisig Notary address

f01381730

Client address

f144zep4gitj73rrujd3jw6iprljicx6vl4wbeavi

DataCap allocation requested

90TiB

andrewxhill commented 2 years ago

that bot message looks promising. do i show up now?

s0nik42 commented 2 years ago

let me see

s0nik42 commented 2 years ago

Nothing

s0nik42 commented 2 years ago

image image

cryptowhizzard commented 2 years ago

Same here.

andrewxhill commented 2 years ago

Bump here. @galen-mcandrew let me know if it's something I can fix.

andrewxhill commented 2 years ago

captured an improvement idea here: https://github.com/filecoin-project/notary-governance/discussions/321

large-datacap-requests[bot] commented 2 years ago

DataCap Allocation requested

Multisig Notary address

f01381730

Client address

f144zep4gitj73rrujd3jw6iprljicx6vl4wbeavi

DataCap allocation requested

45TiB

cryptowhizzard commented 2 years ago

Still not visible.

large-datacap-requests[bot] commented 2 years ago

DataCap Allocation requested

Multisig Notary address

f01381730

Client address

f144zep4gitj73rrujd3jw6iprljicx6vl4wbeavi

DataCap allocation requested

45TiB

Reiers commented 2 years ago

This is very unfortunate for Textiles Competition Event. 3 days without any response to this issue!? We need faster response times. cc: @dkkapur @galen-mcandrew

flyworker commented 2 years ago

If it is for competition Can texile use other datacap e.g. we can provide our dataset datacap to help them. 50 tb

galen-mcandrew commented 2 years ago

@fabriziogianni7 looks like the bot is adding and removing the label at the same time?

Reiers commented 2 years ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacedykrkbzb2mwlc3flnuzkhgboib6nra5l3dy5blxsskvkgpi23fu4

Address

f144zep4gitj73rrujd3jw6iprljicx6vl4wbeavi

Datacap Allocated

45TiB

Signer Address

f1oz43ckvmtxmmsfzqm6bpnemqlavz4ifyl524chq

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedykrkbzb2mwlc3flnuzkhgboib6nra5l3dy5blxsskvkgpi23fu4

cryptowhizzard commented 2 years ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceafoov5fqddhpiksngmgmnke5bzz2p3waddxx7bbclfk522bjayte

Address

f144zep4gitj73rrujd3jw6iprljicx6vl4wbeavi

Datacap Allocated

45TiB

Signer Address

f1krmypm4uoxxf3g7okrwtrahlmpcph3y7rbqqgfa

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceafoov5fqddhpiksngmgmnke5bzz2p3waddxx7bbclfk522bjayte

Reiers commented 2 years ago

Now this is more like it - problem solved. Thanks @galen-mcandrew and @fabriziogianni7 for resolving the problem with the bot. and thanks @cryptowhizzard for stepping up with a signature 10:30pm on a Saturday (EU time)

@andrewxhill DataCap sent and you are good to go again. Have a great weekend everybody !

andrewxhill commented 2 years ago

Thank you all!!!

On Sat, Nov 20, 2021 at 4:36 PM Nicklas @.***> wrote:

Now this is more like it - problem solved. Thanks @galen-mcandrew https://github.com/galen-mcandrew and @fabriziogianni7 https://github.com/fabriziogianni7 for resolving the problem with the bot. and thanks @cryptowhizzard https://github.com/cryptowhizzard for stepping up with a signature 10:30pm on a Saturday (EU time)

@andrewxhill https://github.com/andrewxhill DataCap sent and you are good to go again. Have a great weekend everybody !

— You are receiving this because you were mentioned.

Reply to this email directly, view it on GitHub https://github.com/filecoin-project/filecoin-plus-large-datasets/issues/61#issuecomment-974714751, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAC2MU5JMAFO3NAJD4VJSFDUNAIEVANCNFSM5FZJ5LIQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

--

Andrew Hill, CEO

Textile https://www.textile.io/ | Mission https://textile.notion.site/Our-mission-is-to-accelerate-the-exchange-of-information-across-society-f49e389e12e14473a3475e755a8d9cd6 | Careers https://boards.greenhouse.io/textileio

s0nik42 commented 2 years ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceapq6b3hc7zdbbmb4rxfznxcd34pvc2zxeef7m6wqygecazeksx5w

Address

f144zep4gitj73rrujd3jw6iprljicx6vl4wbeavi

Datacap Allocated

45TiB

Signer Address

f1wxhnytjmklj2czezaqcfl7eb4nkgmaxysnegwii

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceapq6b3hc7zdbbmb4rxfznxcd34pvc2zxeef7m6wqygecazeksx5w

s0nik42 commented 2 years ago

Any reason, once I signed on app.fil.org we only see 1 Approval ? even if Both @Reiers @cryptowhizzard signed it as well ?

image

galen-mcandrew commented 2 years ago

@s0nik42 you see 1 approval because that is your approval message. Reiers and Crypto sent 2 messages (proposal and approval) and your message started the next transaction. So at this time, there is a pending transaction from you waiting for the second approval, which will clear the threshold of 2.

flyworker commented 2 years ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacec4wmi5meskypxr2jrmfqf66miqoib2odanyommduyvci3ymwkbxc

Address

f144zep4gitj73rrujd3jw6iprljicx6vl4wbeavi

Datacap Allocated

45TiB

Signer Address

f1hlubjsdkv4wmsdadihloxgwrz3j3ernf6i3cbpy

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacec4wmi5meskypxr2jrmfqf66miqoib2odanyommduyvci3ymwkbxc

large-datacap-requests[bot] commented 2 years ago

Deleting comment

You haven't got the permission to post this request.

Who commented: andrewxhill

Datacap requested: 90TiB

Please, contact the assignee of this issue.

large-datacap-requests[bot] commented 2 years ago

DataCap Allocation requested

Multisig Notary address

f01381730

Client address

f144zep4gitj73rrujd3jw6iprljicx6vl4wbeavi

DataCap allocation requested

90TiB

large-datacap-requests[bot] commented 2 years ago

Stats for DataCap Allocation

Multisig Notary address

f01381730

Client address

f144zep4gitj73rrujd3jw6iprljicx6vl4wbeavi

Last two approvers

flyworker & s0nik42

DataCap allocation requested

90TiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
5306 52 90TiB 13.94 1.9TiB
Reiers commented 2 years ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacednd3qxew2x36dy4ew6lpkomeiifflaa7meuvtferbqeqb2nc2i6o

Address

f144zep4gitj73rrujd3jw6iprljicx6vl4wbeavi

Datacap Allocated

90TiB

Signer Address

f1oz43ckvmtxmmsfzqm6bpnemqlavz4ifyl524chq

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacednd3qxew2x36dy4ew6lpkomeiifflaa7meuvtferbqeqb2nc2i6o

cryptowhizzard commented 2 years ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceala3bw4l5fatkzzdwbzqhsepiswgcvnnxfipeskyrtoy3474jfis

Address

f144zep4gitj73rrujd3jw6iprljicx6vl4wbeavi

Datacap Allocated

90TiB

Signer Address

f1krmypm4uoxxf3g7okrwtrahlmpcph3y7rbqqgfa

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceala3bw4l5fatkzzdwbzqhsepiswgcvnnxfipeskyrtoy3474jfis

large-datacap-requests[bot] commented 2 years ago

DataCap Allocation requested

Multisig Notary address

f01381730

Client address

f144zep4gitj73rrujd3jw6iprljicx6vl4wbeavi

DataCap allocation requested

360TiB

large-datacap-requests[bot] commented 2 years ago

Stats for DataCap Allocation

Multisig Notary address

f01381730

Client address

f144zep4gitj73rrujd3jw6iprljicx6vl4wbeavi

Last two approvers

cryptowhizzard & Reiers

DataCap allocation requested

360TiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
2262 55 360TiB 14.20 7.6TiB
Reiers commented 2 years ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacedqytfhbokmyaean5k4is53vnqrr34cgv362ya7mehldjlm3kgwpa

Address

f144zep4gitj73rrujd3jw6iprljicx6vl4wbeavi

Datacap Allocated

360TiB

Signer Address

f1oz43ckvmtxmmsfzqm6bpnemqlavz4ifyl524chq

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedqytfhbokmyaean5k4is53vnqrr34cgv362ya7mehldjlm3kgwpa

flyworker commented 2 years ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacecyyouslr7rzpl2ch3nitjmrwss5bnk7vhc4xispx4b4dthndarue

Address

f144zep4gitj73rrujd3jw6iprljicx6vl4wbeavi

Datacap Allocated

360TiB

Signer Address

f1hlubjsdkv4wmsdadihloxgwrz3j3ernf6i3cbpy

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecyyouslr7rzpl2ch3nitjmrwss5bnk7vhc4xispx4b4dthndarue

large-datacap-requests[bot] commented 2 years ago

DataCap Allocation requested

Request number 9

Multisig Notary address

f01381730

Client address

f144zep4gitj73rrujd3jw6iprljicx6vl4wbeavi

DataCap allocation requested

360TiB

large-datacap-requests[bot] commented 2 years ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01381730

Client address

f144zep4gitj73rrujd3jw6iprljicx6vl4wbeavi

Last two approvers

not found & not found

Rule to calculate the allocation request amount

800% of weekly dc amount requested

DataCap allocation requested

360TiB

Total DataCap granted for client so far

832.5TiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

4.18701171875PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
18576 49 360TiB 10.72 88.9482421875TiB
large-datacap-requests[bot] commented 2 years ago

DataCap Allocation requested

Request number 10

Multisig Notary address

f01381730

Client address

f144zep4gitj73rrujd3jw6iprljicx6vl4wbeavi

DataCap allocation requested

360TiB

large-datacap-requests[bot] commented 2 years ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01381730

Client address

f144zep4gitj73rrujd3jw6iprljicx6vl4wbeavi

Last two approvers

not found & not found

Rule to calculate the allocation request amount

800% of weekly dc amount requested

DataCap allocation requested

360TiB

Total DataCap granted for client so far

832.5TiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

4.18701171875PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
18576 49 360TiB 10.72 73.7294921875TiB
large-datacap-requests[bot] commented 2 years ago

DataCap Allocation requested

Request number 11

Multisig Notary address

f01381730

Client address

f144zep4gitj73rrujd3jw6iprljicx6vl4wbeavi

DataCap allocation requested

360TiB

large-datacap-requests[bot] commented 2 years ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01381730

Client address

f144zep4gitj73rrujd3jw6iprljicx6vl4wbeavi

Last two approvers

not found & not found

Rule to calculate the allocation request amount

800% of weekly dc amount requested

DataCap allocation requested

360TiB

Total DataCap granted for client so far

832.5TiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

4.18PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
18576 49 360TiB 10.72 57.10TiB
XnMatrixSV commented 2 years ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceb44bapgmpeceh4k4dvi3lk5a45j73snkw7asbdqtqarfg4k4urvc

Address

f144zep4gitj73rrujd3jw6iprljicx6vl4wbeavi

Datacap Allocated

360.00TiB

Signer Address

f1yuz2twsllparyfqwslfiuxrc5wj4mfiflvnsw6a

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceb44bapgmpeceh4k4dvi3lk5a45j73snkw7asbdqtqarfg4k4urvc

s0nik42 commented 2 years ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceazqqxttszhc5lzuu3fv7wbzl42mlpurfiyvorvqcozfthksqknsq

Address

f144zep4gitj73rrujd3jw6iprljicx6vl4wbeavi

Datacap Allocated

360.00TiB

Signer Address

f1wxhnytjmklj2czezaqcfl7eb4nkgmaxysnegwii

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceazqqxttszhc5lzuu3fv7wbzl42mlpurfiyvorvqcozfthksqknsq

large-datacap-requests[bot] commented 2 years ago

DataCap Allocation requested

Request number 12

Multisig Notary address

f01381730

Client address

f144zep4gitj73rrujd3jw6iprljicx6vl4wbeavi

DataCap allocation requested

360TiB

large-datacap-requests[bot] commented 2 years ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01381730

Client address

f144zep4gitj73rrujd3jw6iprljicx6vl4wbeavi

Last two approvers

s0nik42 & XnMatrixSV

Rule to calculate the allocation request amount

800% of weekly dc amount requested

DataCap allocation requested

360TiB

Total DataCap granted for client so far

1.16PiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

3.83PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
37711 77 360TiB 7.56 88.79TiB
IreneYoung commented 2 years ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacebzvxyzs5czdv7mdeimvzlsxxt5djxf5cpwwsdeqiylkn5q2c2x2c

Address

f144zep4gitj73rrujd3jw6iprljicx6vl4wbeavi

Datacap Allocated

360.00TiB

Signer Address

f1d4gmpqz3execjj2wvrxuuhvbms5mzh7t7yqrviq

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebzvxyzs5czdv7mdeimvzlsxxt5djxf5cpwwsdeqiylkn5q2c2x2c

cryptowhizzard commented 2 years ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacecuy6efg5neyojpawur63futmczvtwxy5yj3ui423a6oslldqj5vc

Address

f144zep4gitj73rrujd3jw6iprljicx6vl4wbeavi

Datacap Allocated

360.00TiB

Signer Address

f1krmypm4uoxxf3g7okrwtrahlmpcph3y7rbqqgfa

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecuy6efg5neyojpawur63futmczvtwxy5yj3ui423a6oslldqj5vc

large-datacap-requests[bot] commented 2 years ago

DataCap Allocation requested

Request number 13

Multisig Notary address

f01858410

Client address

f144zep4gitj73rrujd3jw6iprljicx6vl4wbeavi

DataCap allocation requested

360TiB

large-datacap-requests[bot] commented 2 years ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f144zep4gitj73rrujd3jw6iprljicx6vl4wbeavi

Last two approvers

cryptowhizzard & IreneYoung

Rule to calculate the allocation request amount

800% of weekly dc amount requested

DataCap allocation requested

360TiB

Total DataCap granted for client so far

1.51PiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

3.48PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
52800 96 360TiB 9.50 89.95TiB
liyunzhi-666 commented 2 years ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacectmkmrfmfzmy45bgrztg3nuhs77rdrnwcajis7xjwofjmutd3cxa

Address

f144zep4gitj73rrujd3jw6iprljicx6vl4wbeavi

Datacap Allocated

360.00TiB

Signer Address

f1pszcrsciyixyuxxukkvtazcokexbn54amf7gvoq

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacectmkmrfmfzmy45bgrztg3nuhs77rdrnwcajis7xjwofjmutd3cxa

Alex11801 commented 2 years ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacebhb2foxjtctb5zjz6zbilbczdx6lko3aazqwpzmt7gl4e2bo3zwu

Address

f144zep4gitj73rrujd3jw6iprljicx6vl4wbeavi

Datacap Allocated

360.00TiB

Signer Address

f1hhippi64yiyhpjdtbidfyzma6irc2nuav7mrwmi

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebhb2foxjtctb5zjz6zbilbczdx6lko3aazqwpzmt7gl4e2bo3zwu

filplus-checker commented 1 year ago

DataCap and CID Checker Report[^1]

If this is the first time a provider takes verified deal, it will be marked as new.

For most of the datacap application, below restrictions should apply.

⚠️ f020378 has unknown IP location.

⚠️ f01428149 has unknown IP location.

⚠️ f0520660 has unknown IP location.

⚠️ f01801932 has unknown IP location.

⚠️ 22.22% of total deal sealed by f0142637 are duplicate data.

Provider Location Total Deals Sealed Percentage Unique Data Duplicate Deals
f01345523 Antwerpen, Flanders, BE 161.63 TiB 8.94% 161.63 TiB 0.00%
f022352 Oslo, Oslo, NO 113.56 TiB 6.28% 106.25 TiB 6.44%
f020378 Unknown 80.99 TiB 4.48% 80.77 TiB 0.27%
f01278 Grand Rapids, Michigan, US 67.24 TiB 3.72% 67.11 TiB 0.19%
f022142 New York City, New York, US 61.35 TiB 3.39% 61.29 TiB 0.10%
f01392893 Amsterdam, North Holland, NL 56.60 TiB 3.13% 56.60 TiB 0.00%
f010088 Everett, Washington, US 54.96 TiB 3.04% 54.18 TiB 1.42%
f0840770new University Park, Texas, US 49.29 TiB 2.73% 49.22 TiB 0.13%
f02620 Warsaw, Mazovia, PL 42.23 TiB 2.34% 42.23 TiB 0.00%
f01225882 Burnaby, British Columbia, CA 41.01 TiB 2.27% 40.98 TiB 0.08%
f01240 Heerhugowaard, North Holland, NL 39.20 TiB 2.17% 39.17 TiB 0.09%
f0717969 Los Angeles, California, US 37.41 TiB 2.07% 37.38 TiB 0.09%
f0773157 Fremont, California, US 37.14 TiB 2.06% 36.58 TiB 1.51%
f01208862 Heerhugowaard, North Holland, NL 35.82 TiB 1.98% 35.75 TiB 0.17%
f0707721 Heerhugowaard, North Holland, NL 35.24 TiB 1.95% 35.08 TiB 0.44%
f010446 Zaventem, Flanders, BE 34.41 TiB 1.90% 33.79 TiB 1.82%
f01652333 Sunnyvale, California, US 33.80 TiB 1.87% 33.80 TiB 0.00%
f01199442 Heerhugowaard, North Holland, NL 33.27 TiB 1.84% 33.21 TiB 0.19%
f01691327new Elche, Valencia, ES 31.65 TiB 1.75% 31.65 TiB 0.00%
f01702940 Dallas, Texas, US 31.03 TiB 1.72% 31.03 TiB 0.00%
f0461791 Gwangju, Gwangju, KR 30.68 TiB 1.70% 30.68 TiB 0.00%
f01886797 Vancouver, British Columbia, CA 28.86 TiB 1.60% 28.67 TiB 0.65%
f01201327 Heerhugowaard, North Holland, NL 24.97 TiB 1.38% 24.65 TiB 1.25%
f01840390new Seoul, Seoul, KR 24.14 TiB 1.34% 24.14 TiB 0.00%
f01163272new Perm, Perm Krai, RU 22.88 TiB 1.27% 22.84 TiB 0.14%
f0466405new Übach-Palenberg, North Rhine-Westphalia, DE 22.78 TiB 1.26% 22.69 TiB 0.41%
f01611097 San Clemente, California, US 22.75 TiB 1.26% 22.75 TiB 0.00%
f066596 San Diego, California, US 22.69 TiB 1.26% 22.38 TiB 1.38%
f032824new Austin, Texas, US 21.85 TiB 1.21% 21.72 TiB 0.57%
f01199430 Heerhugowaard, North Holland, NL 21.09 TiB 1.17% 21.03 TiB 0.30%
f01207045 Heerhugowaard, North Holland, NL 20.66 TiB 1.14% 20.63 TiB 0.15%
f047419 North Prairie, Wisconsin, US 20.64 TiB 1.14% 20.61 TiB 0.15%
f019551 Birmingham, England, GB 20.51 TiB 1.13% 20.51 TiB 0.00%
f01732188 Chicago, Illinois, US 19.72 TiB 1.09% 19.72 TiB 0.00%
f01889910new Phoenix, Arizona, US 18.58 TiB 1.03% 18.57 TiB 0.02%
f010479 Paris, Île-de-France, FR 18.38 TiB 1.02% 17.31 TiB 5.78%
f01858429 Boston, Massachusetts, US 18.16 TiB 1.00% 18.13 TiB 0.17%
f01901765 Jiaxing, Zhejiang, CN 17.63 TiB 0.98% 17.51 TiB 0.71%
f01784458 Oslo, Oslo, NO 17.34 TiB 0.96% 17.34 TiB 0.00%
f01310564new Oslo, Oslo, NO 16.88 TiB 0.93% 16.88 TiB 0.00%
f01872811 Dallas, Texas, US 16.62 TiB 0.92% 16.62 TiB 0.00%
f01873432new Las Vegas, Nevada, US 15.28 TiB 0.85% 15.22 TiB 0.41%
f08403 Bourton on the Water, England, GB 15.23 TiB 0.84% 15.23 TiB 0.00%
f0706693new Brest, Brest, BY 14.69 TiB 0.81% 14.69 TiB 0.00%
f0694396 Birmingham, England, GB 14.55 TiB 0.81% 14.55 TiB 0.00%
f01790264new Seoul, Seoul, KR 14.12 TiB 0.78% 14.12 TiB 0.00%
f01764587new Seoul, Seoul, KR 12.95 TiB 0.72% 12.95 TiB 0.00%
f01871352 Seoul, Seoul, KR 12.58 TiB 0.70% 12.58 TiB 0.00%
f097777new Kivertsi, Volyn, UA 12.20 TiB 0.68% 12.14 TiB 0.51%
f01732189 San Diego, California, US 11.60 TiB 0.64% 11.60 TiB 0.00%
f09848 Rancho Santa Margarita, California, US 11.31 TiB 0.63% 11.31 TiB 0.00%
f01927134new Las Vegas, Nevada, US 10.94 TiB 0.61% 10.91 TiB 0.29%
f08399 Seattle, Washington, US 10.46 TiB 0.58% 10.02 TiB 4.18%
f0678914 San Diego, California, US 10.03 TiB 0.56% 9.81 TiB 2.18%
f01619524 Frankfurt am Main, Hesse, DE 8.41 TiB 0.47% 8.41 TiB 0.00%
f01776738 Montréal, Quebec, CA 8.00 TiB 0.44% 8.00 TiB 0.00%
f01395673 Fuzhou, Fujian, CN 6.13 TiB 0.34% 6.13 TiB 0.00%
f01133080 Gwangju, Gwangju, KR 6.00 TiB 0.33% 6.00 TiB 0.00%
f01419959 San Diego, California, US 5.27 TiB 0.29% 5.27 TiB 0.00%
f01915033new Chengdu, Sichuan, CN 5.19 TiB 0.29% 5.19 TiB 0.00%
f010202 Hong Kong, Central and Western, HK 5.13 TiB 0.28% 5.13 TiB 0.00%
f010617 Surrey, British Columbia, CA 4.59 TiB 0.25% 4.59 TiB 0.00%
f01466075new Seoul, Seoul, KR 4.31 TiB 0.24% 4.31 TiB 0.00%
f0836160new Seoul, Seoul, KR 4.20 TiB 0.23% 4.20 TiB 0.00%
f01882569new Atlanta, Georgia, US 3.73 TiB 0.21% 3.73 TiB 0.00%
f01428149new Unknown 3.63 TiB 0.20% 3.63 TiB 0.00%
f01826669new Philadelphia, Pennsylvania, US 3.45 TiB 0.19% 3.45 TiB 0.00%
f01746964 Sydney, New South Wales, AU 3.42 TiB 0.19% 3.42 TiB 0.00%
f0164291new Hong Kong, Central and Western, HK 3.19 TiB 0.18% 3.19 TiB 0.00%
f01896422 Fremont, California, US 2.84 TiB 0.16% 2.84 TiB 0.00%
f01558688 Toronto, Ontario, CA 2.72 TiB 0.15% 2.72 TiB 0.00%
f058369 Boston, Massachusetts, US 2.60 TiB 0.14% 2.60 TiB 0.00%
f0104671 Kawasaki, Kanagawa, JP 2.56 TiB 0.14% 2.56 TiB 0.00%
f01861875new Antwerpen, Flanders, BE 2.41 TiB 0.13% 2.41 TiB 0.00%
f01051301 Daejeon, Daejeon, KR 2.40 TiB 0.13% 2.40 TiB 0.00%
f01443744 Leipzig, Saxony, DE 2.38 TiB 0.13% 2.38 TiB 0.00%
f0520660new Unknown 2.33 TiB 0.13% 2.33 TiB 0.00%
f0214334 Gwangju, Gwangju, KR 2.13 TiB 0.12% 2.13 TiB 0.00%
f0763337new San Diego, California, US 1.75 TiB 0.10% 1.75 TiB 0.00%
f01870135new Gwangju, Gwangju, KR 1.64 TiB 0.09% 1.64 TiB 0.00%
f0828066new San Diego, California, US 1.44 TiB 0.08% 1.44 TiB 0.00%
f01699939 Gwangju, Gwangju, KR 1.41 TiB 0.08% 1.41 TiB 0.00%
f01883179 Philadelphia, Pennsylvania, US 1.25 TiB 0.07% 1.25 TiB 0.00%
f01176700new Gwangju, Gwangju, KR 1.22 TiB 0.07% 1.22 TiB 0.00%
f01396100 Gwangju, Gwangju, KR 1.13 TiB 0.06% 1.13 TiB 0.00%
f01801932new Unknown 1.00 TiB 0.06% 1.00 TiB 0.00%
f01127678 Łódź, Łódź Voivodeship, PL 1.00 TiB 0.06% 1.00 TiB 0.00%
f01206283 Sydney, New South Wales, AU 1004.25 GiB 0.05% 1004.25 GiB 0.00%
f01832393 Seattle, Washington, US 776.00 GiB 0.04% 776.00 GiB 0.00%
f01752548 Seattle, Washington, US 720.00 GiB 0.04% 720.00 GiB 0.00%
f01367109 Moscow, Moscow, RU 640.00 GiB 0.03% 640.00 GiB 0.00%
f01683871new Gwangju, Gwangju, KR 544.00 GiB 0.03% 544.00 GiB 0.00%
f01847751 Denver, Colorado, US 528.00 GiB 0.03% 528.00 GiB 0.00%
f01044351 Gwangju, Gwangju, KR 512.00 GiB 0.03% 512.00 GiB 0.00%
f01910202 Philadelphia, Pennsylvania, US 512.00 GiB 0.03% 512.00 GiB 0.00%
f01775922 Ashburn, Virginia, US 400.00 GiB 0.02% 400.00 GiB 0.00%
f01806491 Seoul, Seoul, KR 328.00 GiB 0.02% 328.00 GiB 0.00%
f0142637 Chengdu, Sichuan, CN 288.00 GiB 0.02% 224.00 GiB 22.22%
f01175097new San Diego, California, US 224.00 GiB 0.01% 224.00 GiB 0.00%
f0408717 Ansan-si, Gyeonggi-do, KR 160.00 GiB 0.01% 160.00 GiB 0.00%
f023467 Oslo, Oslo, NO 160.00 GiB 0.01% 128.00 GiB 20.00%
f01045784new Fresh Meadows, New York, US 96.00 GiB 0.01% 96.00 GiB 0.00%
f023971 Orlando, Florida, US 96.00 GiB 0.01% 96.00 GiB 0.00%
f01840436 Lincoln, Nebraska, US 32.00 GiB 0.00% 32.00 GiB 0.00%
f01864434 Sydney, New South Wales, AU 32.00 GiB 0.00% 32.00 GiB 0.00%

Provider Distribution

Deal Data Replication

The below table shows how each many unique data are replicated across storage providers.

⚠️ 79.09% of deals are for data replicated across less than 4 storage providers.

Unique Data Size Total Deals Made Number of Providers Deal Percentage
4.21 TiB 6.49 TiB 1 0.36%
196.98 TiB 398.62 TiB 2 22.06%
340.28 TiB 1.00 PiB 3 56.67%
57.35 TiB 229.76 TiB 4 12.71%
22.15 TiB 111.04 TiB 5 6.14%
4.64 TiB 28.08 TiB 6 1.55%
612.00 GiB 5.90 TiB 7 0.33%
4.00 GiB 32.00 GiB 8 0.00%
8.00 GiB 72.00 GiB 9 0.00%
32.00 GiB 320.00 GiB 10 0.02%
36.00 GiB 428.00 GiB 11 0.02%
64.00 GiB 1.50 TiB 16 0.08%
32.00 GiB 864.00 GiB 27 0.05%

Replication Distribution

Deal Data Shared with other Clients

The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.

⚠️ CID sharing has been observed.

Other Client Application Total Deals Affected Unique CIDs Verifier
f3vnq2cmwig3qjisnx5hobxvsd4drn4f54xfxnv4t
ciw6vnjdsf5xipgafreprh5riwmgtcirpcdmi3urb
g36a
WhyrusleepingEstuary - Applications Research Group 148.81 TiB 644 LDN # 44
f1pkrmygbvweykpjcut36lf7ewgqdfhjklbhvepda Protocol Labs ( project: Slingshot Evergreen ) 30.16 TiB 437 LDN # 293
f3w5fx6wta4ewl2iyf7xcogmzffz2fmrngpzdpduj
3xmk3dwjxc6dyq36gdf3rflkkrblh5nci5xymc5ha
l3qq
USC Shoah Foundation[DEPRECATED] USC Shoah Foundation 2.81 TiB 68 LDN 27
f17g7h52bsi53rb263xwne573dusskit4mieqkgry USC Shoah Foundation 1.13 TiB 36 LDN v3 multisig
f3qh7m6ul2n6pbko6bovtthogzv4qdu4bh6hlmbjw
55khic6wegintl5ma55fwbxjzh5g4hweyj3n5j3lb
d3ra
Unknown 544.00 GiB 12 Unknown

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report[^1]

If this is the first time a provider takes verified deal, it will be marked as new.

For most of the datacap application, below restrictions should apply.

⚠️ f020378 has unknown IP location.

⚠️ f01428149 has unknown IP location.

⚠️ f0520660 has unknown IP location.

⚠️ f01801932 has unknown IP location.

⚠️ 22.22% of total deal sealed by f0142637 are duplicate data.

Provider Location Total Deals Sealed Percentage Unique Data Duplicate Deals
f01345523 Antwerpen, Flanders, BE 161.63 TiB 8.94% 161.63 TiB 0.00%
f022352 Oslo, Oslo, NO 113.56 TiB 6.28% 106.25 TiB 6.44%
f020378 Unknown 80.99 TiB 4.48% 80.77 TiB 0.27%
f01278 Grand Rapids, Michigan, US 67.24 TiB 3.72% 67.11 TiB 0.19%
f022142 New York City, New York, US 61.35 TiB 3.39% 61.29 TiB 0.10%
f01392893 Amsterdam, North Holland, NL 56.60 TiB 3.13% 56.60 TiB 0.00%
f010088 Everett, Washington, US 54.96 TiB 3.04% 54.18 TiB 1.42%
f0840770new University Park, Texas, US 49.29 TiB 2.73% 49.22 TiB 0.13%
f02620 Warsaw, Mazovia, PL 42.23 TiB 2.34% 42.23 TiB 0.00%
f01225882 Burnaby, British Columbia, CA 41.01 TiB 2.27% 40.98 TiB 0.08%
f01240 Heerhugowaard, North Holland, NL 39.20 TiB 2.17% 39.17 TiB 0.09%
f0717969 Los Angeles, California, US 37.41 TiB 2.07% 37.38 TiB 0.09%
f0773157 Fremont, California, US 37.14 TiB 2.06% 36.58 TiB 1.51%
f01208862 Heerhugowaard, North Holland, NL 35.82 TiB 1.98% 35.75 TiB 0.17%
f0707721 Heerhugowaard, North Holland, NL 35.24 TiB 1.95% 35.08 TiB 0.44%
f010446 Zaventem, Flanders, BE 34.41 TiB 1.90% 33.79 TiB 1.82%
f01652333 Sunnyvale, California, US 33.80 TiB 1.87% 33.80 TiB 0.00%
f01199442 Heerhugowaard, North Holland, NL 33.27 TiB 1.84% 33.21 TiB 0.19%
f01691327new Elche, Valencia, ES 31.65 TiB 1.75% 31.65 TiB 0.00%
f01702940 Dallas, Texas, US 31.03 TiB 1.72% 31.03 TiB 0.00%
f0461791 Gwangju, Gwangju, KR 30.68 TiB 1.70% 30.68 TiB 0.00%
f01886797 Vancouver, British Columbia, CA 28.86 TiB 1.60% 28.67 TiB 0.65%
f01201327 Heerhugowaard, North Holland, NL 24.97 TiB 1.38% 24.65 TiB 1.25%
f01840390new Seoul, Seoul, KR 24.14 TiB 1.34% 24.14 TiB 0.00%
f01163272new Perm, Perm Krai, RU 22.88 TiB 1.27% 22.84 TiB 0.14%
f0466405new Übach-Palenberg, North Rhine-Westphalia, DE 22.78 TiB 1.26% 22.69 TiB 0.41%
f01611097 San Clemente, California, US 22.75 TiB 1.26% 22.75 TiB 0.00%
f066596 San Diego, California, US 22.69 TiB 1.26% 22.38 TiB 1.38%
f032824new Austin, Texas, US 21.85 TiB 1.21% 21.72 TiB 0.57%
f01199430 Heerhugowaard, North Holland, NL 21.09 TiB 1.17% 21.03 TiB 0.30%
f01207045 Heerhugowaard, North Holland, NL 20.66 TiB 1.14% 20.63 TiB 0.15%
f047419 North Prairie, Wisconsin, US 20.64 TiB 1.14% 20.61 TiB 0.15%
f019551 Birmingham, England, GB 20.51 TiB 1.13% 20.51 TiB 0.00%
f01732188 Chicago, Illinois, US 19.72 TiB 1.09% 19.72 TiB 0.00%
f01889910new Phoenix, Arizona, US 18.58 TiB 1.03% 18.57 TiB 0.02%
f010479 Paris, Île-de-France, FR 18.38 TiB 1.02% 17.31 TiB 5.78%
f01858429 Boston, Massachusetts, US 18.16 TiB 1.00% 18.13 TiB 0.17%
f01901765 Jiaxing, Zhejiang, CN 17.63 TiB 0.98% 17.51 TiB 0.71%
f01784458 Oslo, Oslo, NO 17.34 TiB 0.96% 17.34 TiB 0.00%
f01310564new Oslo, Oslo, NO 16.88 TiB 0.93% 16.88 TiB 0.00%
f01872811 Dallas, Texas, US 16.62 TiB 0.92% 16.62 TiB 0.00%
f01873432new Las Vegas, Nevada, US 15.28 TiB 0.85% 15.22 TiB 0.41%
f08403 Bourton on the Water, England, GB 15.23 TiB 0.84% 15.23 TiB 0.00%
f0706693new Brest, Brest, BY 14.69 TiB 0.81% 14.69 TiB 0.00%
f0694396 Birmingham, England, GB 14.55 TiB 0.81% 14.55 TiB 0.00%
f01790264new Seoul, Seoul, KR 14.12 TiB 0.78% 14.12 TiB 0.00%
f01764587new Seoul, Seoul, KR 12.95 TiB 0.72% 12.95 TiB 0.00%
f01871352 Seoul, Seoul, KR 12.58 TiB 0.70% 12.58 TiB 0.00%
f097777new Kivertsi, Volyn, UA 12.20 TiB 0.68% 12.14 TiB 0.51%
f01732189 San Diego, California, US 11.60 TiB 0.64% 11.60 TiB 0.00%
f09848 Rancho Santa Margarita, California, US 11.31 TiB 0.63% 11.31 TiB 0.00%
f01927134new Las Vegas, Nevada, US 10.94 TiB 0.61% 10.91 TiB 0.29%
f08399 Seattle, Washington, US 10.46 TiB 0.58% 10.02 TiB 4.18%
f0678914 San Diego, California, US 10.03 TiB 0.56% 9.81 TiB 2.18%
f01619524 Frankfurt am Main, Hesse, DE 8.41 TiB 0.47% 8.41 TiB 0.00%
f01776738 Montréal, Quebec, CA 8.00 TiB 0.44% 8.00 TiB 0.00%
f01395673 Fuzhou, Fujian, CN 6.13 TiB 0.34% 6.13 TiB 0.00%
f01133080 Gwangju, Gwangju, KR 6.00 TiB 0.33% 6.00 TiB 0.00%
f01419959 San Diego, California, US 5.27 TiB 0.29% 5.27 TiB 0.00%
f01915033new Chengdu, Sichuan, CN 5.19 TiB 0.29% 5.19 TiB 0.00%
f010202 Hong Kong, Central and Western, HK 5.13 TiB 0.28% 5.13 TiB 0.00%
f010617 Surrey, British Columbia, CA 4.59 TiB 0.25% 4.59 TiB 0.00%
f01466075new Seoul, Seoul, KR 4.31 TiB 0.24% 4.31 TiB 0.00%
f0836160new Seoul, Seoul, KR 4.20 TiB 0.23% 4.20 TiB 0.00%
f01882569new Atlanta, Georgia, US 3.73 TiB 0.21% 3.73 TiB 0.00%
f01428149new Unknown 3.63 TiB 0.20% 3.63 TiB 0.00%
f01826669new Philadelphia, Pennsylvania, US 3.45 TiB 0.19% 3.45 TiB 0.00%
f01746964 Sydney, New South Wales, AU 3.42 TiB 0.19% 3.42 TiB 0.00%
f0164291new Hong Kong, Central and Western, HK 3.19 TiB 0.18% 3.19 TiB 0.00%
f01896422 Fremont, California, US 2.84 TiB 0.16% 2.84 TiB 0.00%
f01558688 Toronto, Ontario, CA 2.72 TiB 0.15% 2.72 TiB 0.00%
f058369 Boston, Massachusetts, US 2.60 TiB 0.14% 2.60 TiB 0.00%
f0104671 Kawasaki, Kanagawa, JP 2.56 TiB 0.14% 2.56 TiB 0.00%
f01861875new Antwerpen, Flanders, BE 2.41 TiB 0.13% 2.41 TiB 0.00%
f01051301 Daejeon, Daejeon, KR 2.40 TiB 0.13% 2.40 TiB 0.00%
f01443744 Leipzig, Saxony, DE 2.38 TiB 0.13% 2.38 TiB 0.00%
f0520660new Unknown 2.33 TiB 0.13% 2.33 TiB 0.00%
f0214334 Gwangju, Gwangju, KR 2.13 TiB 0.12% 2.13 TiB 0.00%
f0763337new San Diego, California, US 1.75 TiB 0.10% 1.75 TiB 0.00%
f01870135new Gwangju, Gwangju, KR 1.64 TiB 0.09% 1.64 TiB 0.00%
f0828066new San Diego, California, US 1.44 TiB 0.08% 1.44 TiB 0.00%
f01699939 Gwangju, Gwangju, KR 1.41 TiB 0.08% 1.41 TiB 0.00%
f01883179 Philadelphia, Pennsylvania, US 1.25 TiB 0.07% 1.25 TiB 0.00%
f01176700new Gwangju, Gwangju, KR 1.22 TiB 0.07% 1.22 TiB 0.00%
f01396100 Gwangju, Gwangju, KR 1.13 TiB 0.06% 1.13 TiB 0.00%
f01801932new Unknown 1.00 TiB 0.06% 1.00 TiB 0.00%
f01127678 Łódź, Łódź Voivodeship, PL 1.00 TiB 0.06% 1.00 TiB 0.00%
f01206283 Sydney, New South Wales, AU 1004.25 GiB 0.05% 1004.25 GiB 0.00%
f01832393 Seattle, Washington, US 776.00 GiB 0.04% 776.00 GiB 0.00%
f01752548 Seattle, Washington, US 720.00 GiB 0.04% 720.00 GiB 0.00%
f01367109 Moscow, Moscow, RU 640.00 GiB 0.03% 640.00 GiB 0.00%
f01683871new Gwangju, Gwangju, KR 544.00 GiB 0.03% 544.00 GiB 0.00%
f01847751 Denver, Colorado, US 528.00 GiB 0.03% 528.00 GiB 0.00%
f01044351 Gwangju, Gwangju, KR 512.00 GiB 0.03% 512.00 GiB 0.00%
f01910202 Philadelphia, Pennsylvania, US 512.00 GiB 0.03% 512.00 GiB 0.00%
f01775922 Ashburn, Virginia, US 400.00 GiB 0.02% 400.00 GiB 0.00%
f01806491 Seoul, Seoul, KR 328.00 GiB 0.02% 328.00 GiB 0.00%
f0142637 Chengdu, Sichuan, CN 288.00 GiB 0.02% 224.00 GiB 22.22%
f01175097new San Diego, California, US 224.00 GiB 0.01% 224.00 GiB 0.00%
f0408717 Ansan-si, Gyeonggi-do, KR 160.00 GiB 0.01% 160.00 GiB 0.00%
f023467 Oslo, Oslo, NO 160.00 GiB 0.01% 128.00 GiB 20.00%
f01045784new Fresh Meadows, New York, US 96.00 GiB 0.01% 96.00 GiB 0.00%
f023971 Orlando, Florida, US 96.00 GiB 0.01% 96.00 GiB 0.00%
f01840436 Lincoln, Nebraska, US 32.00 GiB 0.00% 32.00 GiB 0.00%
f01864434 Sydney, New South Wales, AU 32.00 GiB 0.00% 32.00 GiB 0.00%

Provider Distribution

Deal Data Replication

The below table shows how each many unique data are replicated across storage providers.

⚠️ 79.09% of deals are for data replicated across less than 4 storage providers.

Unique Data Size Total Deals Made Number of Providers Deal Percentage
4.21 TiB 6.49 TiB 1 0.36%
196.98 TiB 398.62 TiB 2 22.06%
340.28 TiB 1.00 PiB 3 56.67%
57.35 TiB 229.76 TiB 4 12.71%
22.15 TiB 111.04 TiB 5 6.14%
4.64 TiB 28.08 TiB 6 1.55%
612.00 GiB 5.90 TiB 7 0.33%
4.00 GiB 32.00 GiB 8 0.00%
8.00 GiB 72.00 GiB 9 0.00%
32.00 GiB 320.00 GiB 10 0.02%
36.00 GiB 428.00 GiB 11 0.02%
64.00 GiB 1.50 TiB 16 0.08%
32.00 GiB 864.00 GiB 27 0.05%

Replication Distribution

Deal Data Shared with other Clients

The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.

⚠️ CID sharing has been observed.

Other Client Application Total Deals Affected Unique CIDs Verifier
f3vnq2cmwig3qjisnx5hobxvsd4drn4f54xfxnv4t
ciw6vnjdsf5xipgafreprh5riwmgtcirpcdmi3urb
g36a
WhyrusleepingEstuary - Applications Research Group 148.81 TiB 644 LDN # 44
f1pkrmygbvweykpjcut36lf7ewgqdfhjklbhvepda Protocol Labs ( project: Slingshot Evergreen ) 30.16 TiB 437 LDN # 293
f3w5fx6wta4ewl2iyf7xcogmzffz2fmrngpzdpduj
3xmk3dwjxc6dyq36gdf3rflkkrblh5nci5xymc5ha
l3qq
USC Shoah Foundation[DEPRECATED] USC Shoah Foundation 2.81 TiB 68 LDN 27
f17g7h52bsi53rb263xwne573dusskit4mieqkgry USC Shoah Foundation 1.13 TiB 36 LDN v3 multisig
f3qh7m6ul2n6pbko6bovtthogzv4qdu4bh6hlmbjw
55khic6wegintl5ma55fwbxjzh5g4hweyj3n5j3lb
d3ra
Unknown 544.00 GiB 12 Unknown

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report[^1]

If this is the first time a provider takes verified deal, it will be marked as new.

For most of the datacap application, below restrictions should apply.

⚠️ f020378 has unknown IP location.

⚠️ f01428149 has unknown IP location.

⚠️ f0520660 has unknown IP location.

⚠️ f01801932 has unknown IP location.

⚠️ 22.22% of total deal sealed by f0142637 are duplicate data.

Provider Location Total Deals Sealed Percentage Unique Data Duplicate Deals
f01345523 Antwerpen, Flanders, BE 161.63 TiB 8.94% 161.63 TiB 0.00%
f022352 Oslo, Oslo, NO 113.56 TiB 6.28% 106.25 TiB 6.44%
f020378 Unknown 80.99 TiB 4.48% 80.77 TiB 0.27%
f01278 Grand Rapids, Michigan, US 67.24 TiB 3.72% 67.11 TiB 0.19%
f022142 New York City, New York, US 61.35 TiB 3.39% 61.29 TiB 0.10%
f01392893 Amsterdam, North Holland, NL 56.60 TiB 3.13% 56.60 TiB 0.00%
f010088 Everett, Washington, US 54.96 TiB 3.04% 54.18 TiB 1.42%
f0840770new University Park, Texas, US 49.29 TiB 2.73% 49.22 TiB 0.13%
f02620 Warsaw, Mazovia, PL 42.23 TiB 2.34% 42.23 TiB 0.00%
f01225882 Burnaby, British Columbia, CA 41.01 TiB 2.27% 40.98 TiB 0.08%
f01240 Heerhugowaard, North Holland, NL 39.20 TiB 2.17% 39.17 TiB 0.09%
f0717969 Los Angeles, California, US 37.41 TiB 2.07% 37.38 TiB 0.09%
f0773157 Fremont, California, US 37.14 TiB 2.06% 36.58 TiB 1.51%
f01208862 Heerhugowaard, North Holland, NL 35.82 TiB 1.98% 35.75 TiB 0.17%
f0707721 Heerhugowaard, North Holland, NL 35.24 TiB 1.95% 35.08 TiB 0.44%
f010446 Zaventem, Flanders, BE 34.41 TiB 1.90% 33.79 TiB 1.82%
f01652333 Sunnyvale, California, US 33.80 TiB 1.87% 33.80 TiB 0.00%
f01199442 Heerhugowaard, North Holland, NL 33.27 TiB 1.84% 33.21 TiB 0.19%
f01691327new Elche, Valencia, ES 31.65 TiB 1.75% 31.65 TiB 0.00%
f01702940 Dallas, Texas, US 31.03 TiB 1.72% 31.03 TiB 0.00%
f0461791 Gwangju, Gwangju, KR 30.68 TiB 1.70% 30.68 TiB 0.00%
f01886797 Vancouver, British Columbia, CA 28.86 TiB 1.60% 28.67 TiB 0.65%
f01201327 Heerhugowaard, North Holland, NL 24.97 TiB 1.38% 24.65 TiB 1.25%
f01840390new Seoul, Seoul, KR 24.14 TiB 1.34% 24.14 TiB 0.00%
f01163272new Perm, Perm Krai, RU 22.88 TiB 1.27% 22.84 TiB 0.14%
f0466405new Übach-Palenberg, North Rhine-Westphalia, DE 22.78 TiB 1.26% 22.69 TiB 0.41%
f01611097 San Clemente, California, US 22.75 TiB 1.26% 22.75 TiB 0.00%
f066596 San Diego, California, US 22.69 TiB 1.26% 22.38 TiB 1.38%
f032824new Austin, Texas, US 21.85 TiB 1.21% 21.72 TiB 0.57%
f01199430 Heerhugowaard, North Holland, NL 21.09 TiB 1.17% 21.03 TiB 0.30%
f01207045 Heerhugowaard, North Holland, NL 20.66 TiB 1.14% 20.63 TiB 0.15%
f047419 North Prairie, Wisconsin, US 20.64 TiB 1.14% 20.61 TiB 0.15%
f019551 Birmingham, England, GB 20.51 TiB 1.13% 20.51 TiB 0.00%
f01732188 Chicago, Illinois, US 19.72 TiB 1.09% 19.72 TiB 0.00%
f01889910new Phoenix, Arizona, US 18.58 TiB 1.03% 18.57 TiB 0.02%
f010479 Paris, Île-de-France, FR 18.38 TiB 1.02% 17.31 TiB 5.78%
f01858429 Boston, Massachusetts, US 18.16 TiB 1.00% 18.13 TiB 0.17%
f01901765 Jiaxing, Zhejiang, CN 17.63 TiB 0.98% 17.51 TiB 0.71%
f01784458 Oslo, Oslo, NO 17.34 TiB 0.96% 17.34 TiB 0.00%
f01310564new Oslo, Oslo, NO 16.88 TiB 0.93% 16.88 TiB 0.00%
f01872811 Dallas, Texas, US 16.62 TiB 0.92% 16.62 TiB 0.00%
f01873432new Las Vegas, Nevada, US 15.28 TiB 0.85% 15.22 TiB 0.41%
f08403 Bourton on the Water, England, GB 15.23 TiB 0.84% 15.23 TiB 0.00%
f0706693new Brest, Brest, BY 14.69 TiB 0.81% 14.69 TiB 0.00%
f0694396 Birmingham, England, GB 14.55 TiB 0.81% 14.55 TiB 0.00%
f01790264new Seoul, Seoul, KR 14.12 TiB 0.78% 14.12 TiB 0.00%
f01764587new Seoul, Seoul, KR 12.95 TiB 0.72% 12.95 TiB 0.00%
f01871352 Seoul, Seoul, KR 12.58 TiB 0.70% 12.58 TiB 0.00%
f097777new Kivertsi, Volyn, UA 12.20 TiB 0.68% 12.14 TiB 0.51%
f01732189 San Diego, California, US 11.60 TiB 0.64% 11.60 TiB 0.00%
f09848 Rancho Santa Margarita, California, US 11.31 TiB 0.63% 11.31 TiB 0.00%
f01927134new Las Vegas, Nevada, US 10.94 TiB 0.61% 10.91 TiB 0.29%
f08399 Seattle, Washington, US 10.46 TiB 0.58% 10.02 TiB 4.18%
f0678914 San Diego, California, US 10.03 TiB 0.56% 9.81 TiB 2.18%
f01619524 Frankfurt am Main, Hesse, DE 8.41 TiB 0.47% 8.41 TiB 0.00%
f01776738 Montréal, Quebec, CA 8.00 TiB 0.44% 8.00 TiB 0.00%
f01395673 Fuzhou, Fujian, CN 6.13 TiB 0.34% 6.13 TiB 0.00%
f01133080 Gwangju, Gwangju, KR 6.00 TiB 0.33% 6.00 TiB 0.00%
f01419959 San Diego, California, US 5.27 TiB 0.29% 5.27 TiB 0.00%
f01915033new Chengdu, Sichuan, CN 5.19 TiB 0.29% 5.19 TiB 0.00%
f010202 Hong Kong, Central and Western, HK 5.13 TiB 0.28% 5.13 TiB 0.00%
f010617 Surrey, British Columbia, CA 4.59 TiB 0.25% 4.59 TiB 0.00%
f01466075new Seoul, Seoul, KR 4.31 TiB 0.24% 4.31 TiB 0.00%
f0836160new Seoul, Seoul, KR 4.20 TiB 0.23% 4.20 TiB 0.00%
f01882569new Atlanta, Georgia, US 3.73 TiB 0.21% 3.73 TiB 0.00%
f01428149new Unknown 3.63 TiB 0.20% 3.63 TiB 0.00%
f01826669new Philadelphia, Pennsylvania, US 3.45 TiB 0.19% 3.45 TiB 0.00%
f01746964 Sydney, New South Wales, AU 3.42 TiB 0.19% 3.42 TiB 0.00%
f0164291new Hong Kong, Central and Western, HK 3.19 TiB 0.18% 3.19 TiB 0.00%
f01896422 Fremont, California, US 2.84 TiB 0.16% 2.84 TiB 0.00%
f01558688 Toronto, Ontario, CA 2.72 TiB 0.15% 2.72 TiB 0.00%
f058369 Boston, Massachusetts, US 2.60 TiB 0.14% 2.60 TiB 0.00%
f0104671 Kawasaki, Kanagawa, JP 2.56 TiB 0.14% 2.56 TiB 0.00%
f01861875new Antwerpen, Flanders, BE 2.41 TiB 0.13% 2.41 TiB 0.00%
f01051301 Daejeon, Daejeon, KR 2.40 TiB 0.13% 2.40 TiB 0.00%
f01443744 Leipzig, Saxony, DE 2.38 TiB 0.13% 2.38 TiB 0.00%
f0520660new Unknown 2.33 TiB 0.13% 2.33 TiB 0.00%
f0214334 Gwangju, Gwangju, KR 2.13 TiB 0.12% 2.13 TiB 0.00%
f0763337new San Diego, California, US 1.75 TiB 0.10% 1.75 TiB 0.00%
f01870135new Gwangju, Gwangju, KR 1.64 TiB 0.09% 1.64 TiB 0.00%
f0828066new San Diego, California, US 1.44 TiB 0.08% 1.44 TiB 0.00%
f01699939 Gwangju, Gwangju, KR 1.41 TiB 0.08% 1.41 TiB 0.00%
f01883179 Philadelphia, Pennsylvania, US 1.25 TiB 0.07% 1.25 TiB 0.00%
f01176700new Gwangju, Gwangju, KR 1.22 TiB 0.07% 1.22 TiB 0.00%
f01396100 Gwangju, Gwangju, KR 1.13 TiB 0.06% 1.13 TiB 0.00%
f01801932new Unknown 1.00 TiB 0.06% 1.00 TiB 0.00%
f01127678 Łódź, Łódź Voivodeship, PL 1.00 TiB 0.06% 1.00 TiB 0.00%
f01206283 Sydney, New South Wales, AU 1004.25 GiB 0.05% 1004.25 GiB 0.00%
f01832393 Seattle, Washington, US 776.00 GiB 0.04% 776.00 GiB 0.00%
f01752548 Seattle, Washington, US 720.00 GiB 0.04% 720.00 GiB 0.00%
f01367109 Moscow, Moscow, RU 640.00 GiB 0.03% 640.00 GiB 0.00%
f01683871new Gwangju, Gwangju, KR 544.00 GiB 0.03% 544.00 GiB 0.00%
f01847751 Denver, Colorado, US 528.00 GiB 0.03% 528.00 GiB 0.00%
f01044351 Gwangju, Gwangju, KR 512.00 GiB 0.03% 512.00 GiB 0.00%
f01910202 Philadelphia, Pennsylvania, US 512.00 GiB 0.03% 512.00 GiB 0.00%
f01775922 Ashburn, Virginia, US 400.00 GiB 0.02% 400.00 GiB 0.00%
f01806491 Seoul, Seoul, KR 328.00 GiB 0.02% 328.00 GiB 0.00%
f0142637 Chengdu, Sichuan, CN 288.00 GiB 0.02% 224.00 GiB 22.22%
f01175097new San Diego, California, US 224.00 GiB 0.01% 224.00 GiB 0.00%
f0408717 Ansan-si, Gyeonggi-do, KR 160.00 GiB 0.01% 160.00 GiB 0.00%
f023467 Oslo, Oslo, NO 160.00 GiB 0.01% 128.00 GiB 20.00%
f01045784new Fresh Meadows, New York, US 96.00 GiB 0.01% 96.00 GiB 0.00%
f023971 Orlando, Florida, US 96.00 GiB 0.01% 96.00 GiB 0.00%
f01840436 Lincoln, Nebraska, US 32.00 GiB 0.00% 32.00 GiB 0.00%
f01864434 Sydney, New South Wales, AU 32.00 GiB 0.00% 32.00 GiB 0.00%

Provider Distribution

Deal Data Replication

The below table shows how each many unique data are replicated across storage providers.

⚠️ 79.09% of deals are for data replicated across less than 4 storage providers.

Unique Data Size Total Deals Made Number of Providers Deal Percentage
4.21 TiB 6.49 TiB 1 0.36%
196.98 TiB 398.62 TiB 2 22.06%
340.28 TiB 1.00 PiB 3 56.67%
57.35 TiB 229.76 TiB 4 12.71%
22.15 TiB 111.04 TiB 5 6.14%
4.64 TiB 28.08 TiB 6 1.55%
612.00 GiB 5.90 TiB 7 0.33%
4.00 GiB 32.00 GiB 8 0.00%
8.00 GiB 72.00 GiB 9 0.00%
32.00 GiB 320.00 GiB 10 0.02%
36.00 GiB 428.00 GiB 11 0.02%
64.00 GiB 1.50 TiB 16 0.08%
32.00 GiB 864.00 GiB 27 0.05%

Replication Distribution

Deal Data Shared with other Clients

The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.

⚠️ CID sharing has been observed.

Other Client Application Total Deals Affected Unique CIDs Verifier
f3vnq2cmwig3qjisnx5hobxvsd4drn4f54xfxnv4t
ciw6vnjdsf5xipgafreprh5riwmgtcirpcdmi3urb
g36a
WhyrusleepingEstuary - Applications Research Group 148.81 TiB 644 LDN # 44
f1pkrmygbvweykpjcut36lf7ewgqdfhjklbhvepda Protocol Labs ( project: Slingshot Evergreen ) 30.16 TiB 437 LDN # 293
f3w5fx6wta4ewl2iyf7xcogmzffz2fmrngpzdpduj
3xmk3dwjxc6dyq36gdf3rflkkrblh5nci5xymc5ha
l3qq
USC Shoah Foundation[DEPRECATED] USC Shoah Foundation 2.81 TiB 68 LDN 27
f17g7h52bsi53rb263xwne573dusskit4mieqkgry USC Shoah Foundation 1.13 TiB 36 LDN v3 multisig
f3qh7m6ul2n6pbko6bovtthogzv4qdu4bh6hlmbjw
55khic6wegintl5ma55fwbxjzh5g4hweyj3n5j3lb
d3ra
Unknown 544.00 GiB 12 Unknown

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger