search

filecoin-project / filecoin-plus-large-datasets

Hub for client applications for DataCap at a large scale
110 stars 62 forks source link

[DataCap Application] SDCloud #260

Closed 1ane-1 closed 9 months ago

1ane-1 commented 2 years ago

Large Dataset Notary Application

To apply for DataCap to onboard your dataset to Filecoin, please fill out the following.

Core Information

Please respond to the questions below by replacing the text saying "Please answer here". Include as much detail as you can in your answer.

Project details

Share a brief history of your project and organization.

SDCloud Based on NEAR public chain, combined with distributed storage technology IPFS and Filecoin, data is stored hot and cold.

Develop smart contracts using Rust language on NEAR, where users can select miners for data trading;

Users can pay for their own storage by paying NEAR without having to pay Fil for data storage;

Users can pay a small single fee to store their hot data on the IPFS network; In terms of cold data storage, pay NEAR to store data on Filecoin network according to storage miner quote, file size, storage cycle, etc.

NEAR contract records the order information of hot data and cold data storage on the chain, such as viewing file storage time, file hash value, storage users, file storage life cycle, storage order amount, status, data encapsulation and other information.

Applications that allow users to store encrypted data on Filecoin can only be decrypted by the user using the NEAR private key, thus maintaining ownership of their data;
You can start storing your files in minutes. Filecoin offers persistent, decentralized storage - guaranteeing the integrity of the underlying data through a robust economic model while also providing cryptographic proofs for verifiability. IPFS offers content addressing. Write smart contracts in Rust on NEAR, you only pay a small fee for NEAR as file storage. Support multiple file type preview function. The NEAR contract records the order information stored in the file, such as viewing the file storage time, file hash value, storage user, file storage life cycle, storage order amount, status, data encapsulation and other information. Applications where users store encrypted data on Filecoin can only be decrypted by the user using the NEAR private key, thus maintaining ownership of their data. SDCloud comes from ZHongchuang Power Company. All the developers have rich experience. ZHongchuang Power  is the world's leading distributed storage technology service provider, dedicated to providing low-cost, high-security, and strong privacy storage solutions for the digital economy era. The company's service projects include providing customers with one-stop solutions such as cluster architecture, micro mobile cabinets, private cloud deployment, software custom development, IDC data center construction, large cluster operation and maintenance, and edge computing.

What is the primary source of funding for this project?

It is funded by ourself.

What other projects/ecosystem stakeholders is this project associated with?

The project is associated with NEAR public chain.

Use-case details

Describe the data being stored onto Filecoin

They are mainly surveillance video,pictures,music, documents,disaster recovery data，driverless data and some data from slingshot dataset.

Where was the data in this dataset sourced from?

We build a platfrom named SDCloud that users can upload their data on it.So our dataset mainly comes from our users and some other enterprise and government.

Can you share a sample of the data? A link to a file, an image, a table, etc., are good ways to do this. 

http://122.114.37.226:6580/

Confirm that this is a public dataset that can be retrieved by anyone on the Network (i.e., no specific permissions or access rights are required to view the data).

Yes, we confirm that the dataset is public and can be retrieved by anyone.

What is the expected retrieval frequency for this data?

It won't be retrived very often because of amout of data.

For how long do you plan to keep this dataset stored on Filecoin?

3 years at least, if needed we will keep for a long time.

DataCap allocation plan

In which geographies (countries, regions) do you plan on making storage deals?

Asia

How will you be distributing your data to storage providers? Is there an offline data transfer process?

Both online and offline transfer process are OK.

How do you plan on choosing the storage providers with whom you will be making deals? This should include a plan to ensure the data is retrievable in the future both by you and others.

We pay attention to their work time and how much they cost.  We need comprehensive storage providers who can coorperate for a long time.

How will you be distributing deals across storage providers?

We will distribute different deals according to their distance.

Do you have the resources/funding to start making deals as soon as you receive DataCap? What support from the community would help you onboard onto Filecoin?

We're ready for making deals.
large-datacap-requests[bot] commented 2 years ago

Thanks for your request! :exclamation: We have found some problems in the information provided. We could not find your Filecoin address in the information provided

Please, take a look at the request and edit the body of the issue providing all the required information.
large-datacap-requests[bot] commented 2 years ago

Thanks for your request! :exclamation: We have found some problems in the information provided. We could not find your Filecoin address in the information provided

Please, take a look at the request and edit the body of the issue providing all the required information.
large-datacap-requests[bot] commented 2 years ago

Thanks for your request! :exclamation: We have found some problems in the information provided. We could not find your Filecoin address in the information provided

Please, take a look at the request and edit the body of the issue providing all the required information.
large-datacap-requests[bot] commented 2 years ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

1ane-1 commented 2 years ago

@galen-mcandrew here waiting for you!

large-datacap-requests[bot] commented 2 years ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

large-datacap-requests[bot] commented 2 years ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

large-datacap-requests[bot] commented 2 years ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

galen-mcandrew commented 2 years ago

Multisig Notary requested

Total DataCap requested

5PiB

Expected weekly DataCap usage rate

100TiB

large-datacap-requests[bot] commented 2 years ago

**Multisig created and sent to RKH f01814923

large-datacap-requests[bot] commented 2 years ago

DataCap Allocation requested

Multisig Notary address

f01814923

Client address

f3tdxw5l45xgjgfrbhfkt25kenw7elodm7gnj7bvs75trvlxgvz6ealrkxkn3eqtfpf462rpp4v36kyiml47ea

DataCap allocation requested

50TiB

dannyob commented 2 years ago

Hi -- I don't see anything on the http://122.114.37.226:6580/ address. Do you have a more recent one, or can you make it available again?

1ane-1 commented 2 years ago

Hi -- I don't see anything on the http://122.114.37.226:6580/ address. Do you have a more recent one, or can you make it available again?

sorry, my mistake, we repaired it and now you can check it. Thank you very much.

dannyob commented 2 years ago

Hi, this looks like an interesting project, but the sample data seems to mostly be just dumps of well-known public data repos. Could you point to the NEAR/Filecoin bridge or some documentation about it?

It may be worthwhile just experimenting with normal Filecoin deals (or smaller allocations of datacap) before asking for a LDN.

1ane-1 commented 2 years ago

Hi, this looks like an interesting project, but the sample data seems to mostly be just dumps of well-known public data repos. Could you point to the NEAR/Filecoin bridge or some documentation about it?

It may be worthwhile just experimenting with normal Filecoin deals (or smaller allocations of datacap) before asking for a LDN.

Thank you very much, https://github.com/filecoin-project/devgrants/issues/375 this is our project details. Our data sample, most of them are large size videos from users and our surveillance video. They are so large size that i don't know how to show you. About datacap we already get 40T done. But for SDcloud, we need more large datacap. So hope you can signature for us, sincerely!

steven004 commented 2 years ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacebo2uebgcnac6vcg3cecxzo27i3wl4veq4kppdjp6knwcywkflrse

Address

f3tdxw5l45xgjgfrbhfkt25kenw7elodm7gnj7bvs75trvlxgvz6ealrkxkn3eqtfpf462rpp4v36kyiml47ea

Datacap Allocated

50.00TiB

Signer Address

f1qoxqy3npwcvoqy7gpstm65lejcy7pkd3hqqekna

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebo2uebgcnac6vcg3cecxzo27i3wl4veq4kppdjp6knwcywkflrse

large-datacap-requests[bot] commented 2 years ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

dkkapur commented 2 years ago

@1ane-1 can you help me understand:

1ane-1 commented 2 years ago

@1ane-1 can you help me understand:

  • Website / Social Media: https://morning-fire-9060.on.fleek.co/ just goes to the NEAR website, why is that?
  • Who are the SPs you are working with to test the bridge out?
  • If you need 40 TiB, why did you apply for 5 PiB?

My pleasure to give you an explaination. 1At present, the web version is being improved, and the PC and mobile terminals have solved this situation. If you want to experience the PC version, I can send you the link. 2 We are going to work with f0101018, f0101020, f0101021, f01087243,f01164500. 3About the 40T i mentioned above, it is not the project.They are the videos from ourself.But for SDcloud, the data from our customer. It is a cloud storage app in China.

1ane-1 commented 2 years ago

@1ane-1 can you help me understand:

  • Website / Social Media: https://morning-fire-9060.on.fleek.co/ just goes to the NEAR website, why is that?
  • Who are the SPs you are working with to test the bridge out?
  • If you need 40 TiB, why did you apply for 5 PiB?

Dear Deep the latest update for a clearer explanation of our project,pls check it: 1 The English name of our product is SDCloud, and the Chinese name is shangding cloud. In this post, we submit a link to the English version, and the link URL of the Chinese version is https://www.sdcloud.top/. Therefore you may misunderstand the website we submit. We currently have PC terminals and Android terminals. 2The data types uploaded by users every day include pictures, videos, audios, etc. The current data volume is about 3-5T per day, which is why we apply for 5PIB datacap. In order to ensure that the data is healthy and compliant and protect the copyrights of users, we have established a special compliance KYC audit mechanism to ensure that our platform is green and healthy, so the data we upload to the filecoin network is also legal and reasonable. At the same time, these data can also be used to continuously grow the filecoin community and enrich the types of data storage. If you have other confused questions, pls let me know. Finally hope your reply!

1ane-1 commented 2 years ago

@1ane-1 can you help me understand:

  • Website / Social Media: https://morning-fire-9060.on.fleek.co/ just goes to the NEAR website, why is that?
  • Who are the SPs you are working with to test the bridge out?
  • If you need 40 TiB, why did you apply for 5 PiB?

Dear Deep the latest update for a clearer explanation of our project,pls check it: 1 The English name of our product is SDCloud, and the Chinese name is shangding cloud. In this post, we submit a link to the English version, and the link URL of the Chinese version is https://www.sdcloud.top/. Therefore you may misunderstand the website we submit. We currently have PC terminals and Android terminals. 2The data types uploaded by users every day include pictures, videos, audios, etc. The current data volume is about 3-5T per day, which is why we apply for 5PIB datacap. In order to ensure that the data is healthy and compliant and protect the copyrights of users, we have established a special compliance KYC audit mechanism to ensure that our platform is green and healthy, so the data we upload to the filecoin network is also legal and reasonable. At the same time, these data can also be used to continuously grow the filecoin community and enrich the types of data storage. If you have other confused questions, pls let me know. Finally hope your reply!

@dkkapur Anything else should i provide for you?

1ane-1 commented 2 years ago

@1ane-1 can you help me understand:

  • Website / Social Media: https://morning-fire-9060.on.fleek.co/ just goes to the NEAR website, why is that?
  • Who are the SPs you are working with to test the bridge out?
  • If you need 40 TiB, why did you apply for 5 PiB?

Dear Deep the latest update for a clearer explanation of our project,pls check it: 1 The English name of our product is SDCloud, and the Chinese name is shangding cloud. In this post, we submit a link to the English version, and the link URL of the Chinese version is https://www.sdcloud.top/. Therefore you may misunderstand the website we submit. We currently have PC terminals and Android terminals. 2The data types uploaded by users every day include pictures, videos, audios, etc. The current data volume is about 3-5T per day, which is why we apply for 5PIB datacap. In order to ensure that the data is healthy and compliant and protect the copyrights of users, we have established a special compliance KYC audit mechanism to ensure that our platform is green and healthy, so the data we upload to the filecoin network is also legal and reasonable. At the same time, these data can also be used to continuously grow the filecoin community and enrich the types of data storage. If you have other confused questions, pls let me know. Finally hope your reply!

@dkkapur Pls check it, and really hope your reply~

dkkapur commented 2 years ago

@1ane-1 looks like you already got 1 proposal, just need one more notary to sign for the first allocation. I fixed the labels so that this shows up correctly for notaries.

1ane-1 commented 2 years ago

@1ane-1 looks like you already got 1 proposal, just need one more notary to sign for the first allocation. I fixed the labels so that this shows up correctly for notaries.

Thank you so much, we will go to next setp for the signature.

Destore2023 commented 2 years ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaced2klxdqplcrqjfugpblkja7bh22jdoplrprimjag5ali4sjzi7f4

Address

f3tdxw5l45xgjgfrbhfkt25kenw7elodm7gnj7bvs75trvlxgvz6ealrkxkn3eqtfpf462rpp4v36kyiml47ea

Datacap Allocated

50.00TiB

Signer Address

f1yh6q3nmsg7i2sys7f7dexcuajgoweudcqj2chfi

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaced2klxdqplcrqjfugpblkja7bh22jdoplrprimjag5ali4sjzi7f4

large-datacap-requests[bot] commented 2 years ago

DataCap Allocation requested

Request number 2

Multisig Notary address

f02049625

Client address

f3tdxw5l45xgjgfrbhfkt25kenw7elodm7gnj7bvs75trvlxgvz6ealrkxkn3eqtfpf462rpp4v36kyiml47ea

DataCap allocation requested

100TiB

NiwanDao commented 2 years ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacedil4lf5xxyzx353m43kj6lucj7jfegharyidbpyxxjqmqyimyita

Address

f3tdxw5l45xgjgfrbhfkt25kenw7elodm7gnj7bvs75trvlxgvz6ealrkxkn3eqtfpf462rpp4v36kyiml47ea

Datacap Allocated

100.00TiB

Signer Address

f1a2lia2cwwekeubwo4nppt4v4vebxs2frozarz3q

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedil4lf5xxyzx353m43kj6lucj7jfegharyidbpyxxjqmqyimyita

llifezou commented 2 years ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacecptksyvafc3tb2vibifn2ue7dll4w7kc7rt6vvyd6qaqxcm4anio

Address

f3tdxw5l45xgjgfrbhfkt25kenw7elodm7gnj7bvs75trvlxgvz6ealrkxkn3eqtfpf462rpp4v36kyiml47ea

Datacap Allocated

100.00TiB

Signer Address

f1q6bpjlqia6iemqbrdaxr2uehrhpvoju3qh4lpga

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecptksyvafc3tb2vibifn2ue7dll4w7kc7rt6vvyd6qaqxcm4anio

BDE-io commented 2 years ago

@1ane-1 Hi! Great to see you have gotten approval for DataCap. If you are looking for reputable storage providers to store these data, please visit #bigdata-exchange on Filecoin Slack or reply here.

1ane-1 commented 2 years ago

what is up?

what‘s wrong with the picture?

large-datacap-requests[bot] commented 2 years ago

DataCap Allocation requested

Request number 3

Multisig Notary address

f02049625

Client address

f3tdxw5l45xgjgfrbhfkt25kenw7elodm7gnj7bvs75trvlxgvz6ealrkxkn3eqtfpf462rpp4v36kyiml47ea

DataCap allocation requested

200TiB

large-datacap-requests[bot] commented 2 years ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f3tdxw5l45xgjgfrbhfkt25kenw7elodm7gnj7bvs75trvlxgvz6ealrkxkn3eqtfpf462rpp4v36kyiml47ea

Last two approvers

llifezou & xingjitansuo

Rule to calculate the allocation request amount

200% of weekly dc amount requested

DataCap allocation requested

200TiB

Total DataCap granted for client so far

100TiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

4.90PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
23170 4 100TiB 25.65 22.85TiB
kernelogic commented 2 years ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceasjdfncxpmvy7siurbsakzjftyavwfkqotizyeth4jrb3n4amou2

Address

f3tdxw5l45xgjgfrbhfkt25kenw7elodm7gnj7bvs75trvlxgvz6ealrkxkn3eqtfpf462rpp4v36kyiml47ea

Datacap Allocated

200.00TiB

Signer Address

f1yjhnsoga2ccnepb7t3p3ov5fzom3syhsuinxexa

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceasjdfncxpmvy7siurbsakzjftyavwfkqotizyeth4jrb3n4amou2

NiwanDao commented 2 years ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacedlgj4pdfzdyaolle7c4yjjzt3wm6ocgzha2u77bolarb2v2ojos4

Address

f3tdxw5l45xgjgfrbhfkt25kenw7elodm7gnj7bvs75trvlxgvz6ealrkxkn3eqtfpf462rpp4v36kyiml47ea

Datacap Allocated

200.00TiB

Signer Address

f1a2lia2cwwekeubwo4nppt4v4vebxs2frozarz3q

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedlgj4pdfzdyaolle7c4yjjzt3wm6ocgzha2u77bolarb2v2ojos4

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 4

Multisig Notary address

f02049625

Client address

f3tdxw5l45xgjgfrbhfkt25kenw7elodm7gnj7bvs75trvlxgvz6ealrkxkn3eqtfpf462rpp4v36kyiml47ea

DataCap allocation requested

400TiB

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f3tdxw5l45xgjgfrbhfkt25kenw7elodm7gnj7bvs75trvlxgvz6ealrkxkn3eqtfpf462rpp4v36kyiml47ea

Last two approvers

xingjitansuo & kernelogic

Rule to calculate the allocation request amount

400% of weekly dc amount requested

DataCap allocation requested

400TiB

Total DataCap granted for client so far

300TiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

4.70PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
54230 5 200TiB 22.78 48.56TiB
NiwanDao commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceaoa7lr75tgjyzi6yc3uptaal4tbpownvc4j7o47n6bjjjdt4n2n2

Address

f3tdxw5l45xgjgfrbhfkt25kenw7elodm7gnj7bvs75trvlxgvz6ealrkxkn3eqtfpf462rpp4v36kyiml47ea

Datacap Allocated

400.00TiB

Signer Address

f1a2lia2cwwekeubwo4nppt4v4vebxs2frozarz3q

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceaoa7lr75tgjyzi6yc3uptaal4tbpownvc4j7o47n6bjjjdt4n2n2

ipfscn commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacebylagyj4nqwpmpoyfttaz6skdkayexmcmsr53obl4hfr6amuqt6i

Address

f3tdxw5l45xgjgfrbhfkt25kenw7elodm7gnj7bvs75trvlxgvz6ealrkxkn3eqtfpf462rpp4v36kyiml47ea

Datacap Allocated

400.00TiB

Signer Address

f1j4n74chme7whbz3yls4a7ixqewb6dijypqg2a3a

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebylagyj4nqwpmpoyfttaz6skdkayexmcmsr53obl4hfr6amuqt6i

filplus-checker commented 1 year ago

DataCap and CID Checker Report[^1]

If this is the first time a provider takes verified deal, it will be marked as new.

For most of the datacap application, below restrictions should apply.

⚠️ f0861588 has unknown IP location.

⚠️ f0861590 has unknown IP location.

⚠️ f0861589 has unknown IP location.

⚠️ f0861587 has unknown IP location.

⚠️ f0861591 has unknown IP location.

⚠️ f0101021 has unknown IP location.

⚠️ f01832584 has unknown IP location.

⚠️ f0861586 has unknown IP location.

Provider Location Total Deals Sealed Percentage Unique Data Duplicate Deals
f0861588new Unknown 117.21 TiB 20.12% 112.24 TiB 4.24%
f0861590new Unknown 114.50 TiB 19.66% 109.61 TiB 4.27%
f0861589new Unknown 114.38 TiB 19.64% 109.41 TiB 4.35%
f0861587new Unknown 106.15 TiB 18.22% 93.66 TiB 11.76%
f0861591new Unknown 91.04 TiB 15.63% 90.09 TiB 1.05%
f0101021 Unknown 13.86 TiB 2.38% 13.86 TiB 0.00%
f01832584 Unknown 11.89 TiB 2.04% 11.89 TiB 0.00%
f01164500 Qingdao, Shandong, CN 11.45 TiB 1.97% 11.45 TiB 0.00%
f0861586 Unknown 1.93 TiB 0.33% 1.93 TiB 0.00%

Provider Distribution

Deal Data Replication

The below table shows how each many unique data are replicated across storage providers.

✔️ Data replication looks healthy.

Unique Data Size Total Deals Made Number of Providers Deal Percentage
2.34 TiB 2.34 TiB 1 0.40%
856.00 GiB 1.67 TiB 2 0.29%
870.00 GiB 2.55 TiB 3 0.44%
34.08 TiB 142.48 TiB 4 24.46%
72.26 TiB 374.53 TiB 5 64.31%
1006.00 GiB 8.62 TiB 6 1.48%
6.29 TiB 50.24 TiB 7 8.63%

Replication Distribution

Deal Data Shared with other Clients

The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.

⚠️ CID sharing has been observed.

Other Client Application Total Deals Affected Unique CIDs Verifier
f3wwiudiv2vjdswtc4aab5o3qs6ygeujrrixyv6a2
z4o6aoma34rjayapsmwvqxxgn7aavmzomfquzwd2d
n3fa		 Genesis 38.78 TiB 6,890 Steven Li
f3rk3f2lcts5vi6solqy7sibtazfj7ngpriztuwse
ol36uu4dwv6wdkc7zesvlli54becpxw4ukrffdrto
3m3q		 SD Cloud 1.95 TiB 250 Eric Liu

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 5

Multisig Notary address

f02049625

Client address

f3tdxw5l45xgjgfrbhfkt25kenw7elodm7gnj7bvs75trvlxgvz6ealrkxkn3eqtfpf462rpp4v36kyiml47ea

DataCap allocation requested

800TiB

Id

7f09d403-cc01-4bc7-afa7-417e42dc0319

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f3tdxw5l45xgjgfrbhfkt25kenw7elodm7gnj7bvs75trvlxgvz6ealrkxkn3eqtfpf462rpp4v36kyiml47ea

Last two approvers

ipfscn & xingjitansuo

Rule to calculate the allocation request amount

800% of weekly dc amount requested

DataCap allocation requested

800TiB

Total DataCap granted for client so far

700TiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

4.31PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
99649 5 400TiB 22.14 96.34TiB
filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report[^1]

If this is the first time a provider takes verified deal, it will be marked as new.

For most of the datacap application, below restrictions should apply.

⚠️ f0101021 has unknown IP location.

⚠️ f01832584 has unknown IP location.

⚠️ f0861586 has unknown IP location.

Provider Location Total Deals Sealed Percentage Unique Data Duplicate Deals
f0861588new Guangzhou, Guangdong, CN
CHINANET-BACKBONE		 132.82 TiB 20.47% 117.87 TiB 11.26%
f0861590new Chongqing, Chongqing, CN
CHINANET-BACKBONE		 129.82 TiB 20.01% 118.41 TiB 8.78%
f0861589new Wuhan, Hubei, CN
CHINANET-BACKBONE		 123.74 TiB 19.07% 118.11 TiB 4.55%
f0861587new Changsha, Hunan, CN
CHINANET-BACKBONE		 118.98 TiB 18.34% 106.49 TiB 10.49%
f0861591new Shijiazhuang, Hebei, CN
CHINANET-BACKBONE		 104.28 TiB 16.07% 97.95 TiB 6.07%
f0101021 Unknown
Unknown		 13.86 TiB 2.14% 13.86 TiB 0.00%
f01832584 Unknown
Unknown		 11.89 TiB 1.83% 11.89 TiB 0.00%
f01164500 Qingdao, Shandong, CN
CHINA UNICOM China169 Backbone		 11.45 TiB 1.76% 11.45 TiB 0.00%
f0861586 Unknown
Unknown		 1.93 TiB 0.30% 1.93 TiB 0.00%

Provider Distribution

Deal Data Replication

The below table shows how each many unique data are replicated across storage providers.

✔️ Data replication looks healthy.

Unique Data Size Total Deals Made Number of Providers Deal Percentage
16.00 GiB 16.00 GiB 1 0.00%
12.00 GiB 24.00 GiB 2 0.00%
741.00 GiB 2.17 TiB 3 0.33%
29.95 TiB 126.48 TiB 4 19.50%
85.20 TiB 461.22 TiB 5 71.09%
1006.00 GiB 8.62 TiB 6 1.33%
6.29 TiB 50.24 TiB 7 7.74%

Replication Distribution

Deal Data Shared with other Clients

The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.

However, this could be possible if all below clients use same software to prepare for the exact same dataset or they belong to a series of LDN applications for the same dataset.

⚠️ CID sharing has been observed.

Other Client Application Total Deals Affected Unique CIDs Verifier
f3wwiudiv2vjdswtc4aab5o3qs6ygeujrrixyv6a2
z4o6aoma34rjayapsmwvqxxgn7aavmzomfquzwd2d
n3fa		 Genesis 38.78 TiB 6,890 Steven Li
f3rk3f2lcts5vi6solqy7sibtazfj7ngpriztuwse
ol36uu4dwv6wdkc7zesvlli54becpxw4ukrffdrto
3m3q		 SD Cloud 1.95 TiB 250 Eric Liu

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

kernelogic commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacebhoyxykfqme3inryharptlyb3m6mylmoxz2zpovxzxpbqrleffew

Address

f3tdxw5l45xgjgfrbhfkt25kenw7elodm7gnj7bvs75trvlxgvz6ealrkxkn3eqtfpf462rpp4v36kyiml47ea

Datacap Allocated

800.00TiB

Signer Address

f1yjhnsoga2ccnepb7t3p3ov5fzom3syhsuinxexa

Id

7f09d403-cc01-4bc7-afa7-417e42dc0319

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebhoyxykfqme3inryharptlyb3m6mylmoxz2zpovxzxpbqrleffew

kernelogic commented 1 year ago

CID checker distribution looks healthy. The CID sharing is only with regular DC, not other LDN, assume this is an expansion of the original smaller DC.

newwebgroup commented 1 year ago

The shared CID part is a regular DC. It seems that the regular DC is a subset of the LDN data。

Some nodes have unknown IP addresses. The client said that it would contact SPs to solve the problem

newwebgroup commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacedwqy7ugltrm5mkpohkzxdblgodemk62puqxztjewtdxb5keuqwm2

Address

f3tdxw5l45xgjgfrbhfkt25kenw7elodm7gnj7bvs75trvlxgvz6ealrkxkn3eqtfpf462rpp4v36kyiml47ea

Datacap Allocated

800.00TiB

Signer Address

f1e77zuityhvvw6u2t6tb5qlnsegy2s67qs4lbbbq

Id

7f09d403-cc01-4bc7-afa7-417e42dc0319

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedwqy7ugltrm5mkpohkzxdblgodemk62puqxztjewtdxb5keuqwm2

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 6

Multisig Notary address

f02049625

Client address

f3tdxw5l45xgjgfrbhfkt25kenw7elodm7gnj7bvs75trvlxgvz6ealrkxkn3eqtfpf462rpp4v36kyiml47ea

DataCap allocation requested

800TiB

Id

929ef48a-b174-4363-abfa-546ee8bd7353

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f3tdxw5l45xgjgfrbhfkt25kenw7elodm7gnj7bvs75trvlxgvz6ealrkxkn3eqtfpf462rpp4v36kyiml47ea

Last two approvers

newwebgroup & kernelogic

Rule to calculate the allocation request amount

800% of weekly dc amount requested

DataCap allocation requested

800TiB

Total DataCap granted for client so far

700TiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

4.31PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
100081 5 800TiB 22.14 92.24TiB
filplus-checker commented 1 year ago

DataCap and CID Checker Report[^1]

Storage Provider Distribution

The below table shows the distribution of storage providers that have stored data for this client.

If this is the first time a provider takes verified deal, it will be marked as new.

For most of the datacap application, below restrictions should apply.

✔️ Storage provider distribution looks healthy.

Provider Location Total Deals Sealed Percentage Unique Data Duplicate Deals
f01832584 Haidian, Beijing, CN
China Education and Research Network Center		 11.89 TiB 1.58% 11.89 TiB 0.00%
f01164500 Qingdao, Shandong, CN
CHINA UNICOM China169 Backbone		 11.45 TiB 1.53% 11.45 TiB 0.00%
f0861586 Tianjin, Tianjin, CN
CHINA UNICOM China169 Backbone		 1.93 TiB 0.26% 1.93 TiB 0.00%
f0861588new Guangzhou, Guangdong, CN
CHINANET-BACKBONE		 156.54 TiB 20.86% 131.98 TiB 15.69%
f0861590new Chongqing, Chongqing, CN
CHINANET-BACKBONE		 154.07 TiB 20.53% 129.56 TiB 15.91%
f0861587new Changsha, Hunan, CN
CHINANET-BACKBONE		 138.59 TiB 18.47% 126.11 TiB 9.01%
f0861589new Wuhan, Hubei, CN
CHINANET-BACKBONE		 137.53 TiB 18.32% 118.20 TiB 14.05%
f0861591new Shijiazhuang, Hebei, CN
CHINANET-BACKBONE		 124.70 TiB 16.61% 104.23 TiB 16.42%
f0101021 Hangzhou, Zhejiang, CN
CHINANET-BACKBONE		 13.86 TiB 1.85% 13.86 TiB 0.00%

Provider Distribution

Deal Data Replication

The below table shows how each many unique data are replicated across storage providers.

✔️ Data replication looks healthy.

Unique Data Size Total Deals Made Number of Providers Deal Percentage
2.98 TiB 2.98 TiB 1 0.40%
5.04 TiB 10.08 TiB 2 1.34%
1.27 TiB 3.81 TiB 3 0.51%
21.24 TiB 91.23 TiB 4 12.16%
99.49 TiB 583.61 TiB 5 77.76%
1006.00 GiB 8.62 TiB 6 1.15%
6.29 TiB 50.24 TiB 7 6.69%

Replication Distribution

Deal Data Shared with other Clients

The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.

However, this could be possible if all below clients use same software to prepare for the exact same dataset or they belong to a series of LDN applications for the same dataset.

⚠️ CID sharing has been observed.

Other Client Application Total Deals Affected Unique CIDs Approvers
f3wwiudiv2vjdswtc4aab5o3qs6ygeujrrixyv6a2
z4o6aoma34rjayapsmwvqxxgn7aavmzomfquzwd2d
n3fa		 Genesis 38.78 TiB 6,890
f3rk3f2lcts5vi6solqy7sibtazfj7ngpriztuwse
ol36uu4dwv6wdkc7zesvlli54becpxw4ukrffdrto
3m3q		 SD Cloud 1.95 TiB 250

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

Tom-OriginStorage commented 1 year ago

@1ane-1 Please explain the CID sharing problem of this LDN