search

filecoin-project / filecoin-plus-large-datasets

Hub for client applications for DataCap at a large scale
110 stars 62 forks source link

[DataCap Application]Chimay #397

Closed Chimay-Niko closed 1 year ago

Chimay-Niko commented 2 years ago

Large Dataset Notary Application

To apply for DataCap to onboard your dataset to Filecoin, please fill out the following.

Core Information

Please respond to the questions below by replacing the text saying "Please answer here". Include as much detail as you can in your answer.

Project details

Share a brief history of your project and organization.

Founded in 2011, Chimay is an enterprise founded by students studying in the United States. Based on the Internet, cloud computing, big data, visualization and other technologies, we independently developed the Chimay Smart Scenic integrated operation management system. It covers four aspects of smart operation, smart marketing, smart management, and smart services, including comprehensive access control ticketing, mobile ticketing, one-card card , membership management, intelligent queuing, comprehensive information release, intelligent broadcasting, tourist statistics and intelligent grooming, cloud data center, tourist attribute analysis, marketing decision analysis and other subsystems to provide smart tourism for the whole region, characteristic towns, scenic spots and theme parks Overall solution.With hundreds of smart tourism informatization construction projects, it is a domestic enterprise that focuses on a complete set of smart tourism informatization solutions and integrates R&D and sales.

What is the primary source of funding for this project?

Company's own funding.

What other projects/ecosystem stakeholders is this project associated with?

No.

Use-case details

Describe the data being stored onto Filecoin

Monitoring videos.

Where was the data in this dataset sourced from?

Chimay cloud monitoring platform creates a huge amount of videos from monitoring every scenic area.

Can you share a sample of the data? A link to a file, an image, a table, etc., are good ways to do this. 

https://user-images.githubusercontent.com/106143616/174017652-cde14eb9-1229-40c6-8d8a-e75c19f2492c.MP4

Confirm that this is a public dataset that can be retrieved by anyone on the Network (i.e., no specific permissions or access rights are required to view the data).

Yes.

What is the expected retrieval frequency for this data?

If there's no extra need, the data would be retrieved every two years.

For how long do you plan to keep this dataset stored on Filecoin?

1 year or more.

DataCap allocation plan

In which geographies (countries, regions) do you plan on making storage deals?

Asia, China.

How will you be distributing your data to storage providers? Is there an offline data transfer process?

Online data transfer and offline data transfer are both ways to distribute data in various states of the network.

How do you plan on choosing the storage providers with whom you will be making deals? This should include a plan to ensure the data is retrievable in the future both by you and others.

In order to complete deals as soon as possible, we do need storage providers with strong technical strength.

How will you be distributing deals across storage providers?

It depends on storage providers' capacity, and no more than 25% of whole deals to every storage provider.

Do you have the resources/funding to start making deals as soon as you receive DataCap? What support from the community would help you onboard onto Filecoin?

Yes. We have funding and data so that we can make deals at once.
large-datacap-requests[bot] commented 2 years ago

Thanks for your request!

Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!
large-datacap-requests[bot] commented 2 years ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

Destore2023 commented 2 years ago

Thanks for your application, could you mail to filplus@fil.org and CC partner@bytebase.cn with your official mailbox in order to confirm your identity? In addition, you need to provide your data samples to help us clearly understand your real requirements.

large-datacap-requests[bot] commented 2 years ago

Thanks for your request!

Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!
large-datacap-requests[bot] commented 2 years ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

Chimay-Niko commented 2 years ago

Hi @swatchliu , I've already emailed Filplus and CC Bytebase. My data sample is updated too. https://user-images.githubusercontent.com/106143616/174018373-f04d7a21-09c6-4735-a0c0-7b56e2f73ee9.MP4

Destore2023 commented 2 years ago

image

Sunnyiscoming commented 2 years ago

@Chimay-Niko Can you provide more data samples?

Chimay-Niko commented 2 years ago

@Sunnyiscoming https://user-images.githubusercontent.com/106143616/175925805-e4ae829f-7eb6-4411-a213-ee81c281f2ad.mp4

large-datacap-requests[bot] commented 2 years ago

Thanks for your request!

Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!
large-datacap-requests[bot] commented 2 years ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

galen-mcandrew commented 2 years ago

Datacap Request Trigger

Total DataCap requested

5PiB

Expected weekly DataCap usage rate

200TiB

Client address

f1vtcetpapwwyka6txwqjwymsa67npdfilbkwh64a

large-datacap-requests[bot] commented 2 years ago

DataCap Allocation requested

Multisig Notary address

f01858410

Client address

f1vtcetpapwwyka6txwqjwymsa67npdfilbkwh64a

DataCap allocation requested

100TiB

1475Notary commented 2 years ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacedtqiqumzqtx3ic24jjsn5xkjcklimefsmwxffw5i2fmgdpeds6x2

Address

f1vtcetpapwwyka6txwqjwymsa67npdfilbkwh64a

Datacap Allocated

100.00TiB

Signer Address

f1ofq4mngy7ggcp755pfquq2gphjjnlydolf6awtq

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedtqiqumzqtx3ic24jjsn5xkjcklimefsmwxffw5i2fmgdpeds6x2

fabriziogianni7 commented 2 years ago

Request Approved

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceaaantuiegr2vjzypdi3qbgyv2n7jlknidtwiskblckxshwd7en5a

Address

f1vtcetpapwwyka6txwqjwymsa67npdfilbkwh64a

Datacap Allocated

100.00TiB

Signer Address

f1tgnlhtcmhwipfm7thsftxhn5k52velyjlazpvka

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceaaantuiegr2vjzypdi3qbgyv2n7jlknidtwiskblckxshwd7en5a

BDE-io commented 2 years ago

@Chimay-Niko Hi! Great to see you have gotten approval for DataCap. If you are looking for storage providers to store these data or have any questions, please visit #bigdata-exchange on Filecoin Slack or reply here.

We have strong demand from a diverse group of SPs, who are actively looking to onboard more data.

large-datacap-requests[bot] commented 2 years ago

DataCap Allocation requested

Request number 2

Multisig Notary address

f01858410

Client address

f1vtcetpapwwyka6txwqjwymsa67npdfilbkwh64a

DataCap allocation requested

200TiB

large-datacap-requests[bot] commented 2 years ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f1vtcetpapwwyka6txwqjwymsa67npdfilbkwh64a

Last two approvers

PluskitOfficial & 1475Notary

Rule to calculate the allocation request amount

100% of weekly dc amount requested

DataCap allocation requested

200TiB

Total DataCap granted for client so far

100TiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

4.90PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
2919 4 100TiB 27.41 1.87TiB
Destore2023 commented 2 years ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacecnspsj7crljnv7et3fezpkcndkiurkdw5yjaznqpew74dslyoegc

Address

f1vtcetpapwwyka6txwqjwymsa67npdfilbkwh64a

Datacap Allocated

200.00TiB

Signer Address

f1yh6q3nmsg7i2sys7f7dexcuajgoweudcqj2chfi

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecnspsj7crljnv7et3fezpkcndkiurkdw5yjaznqpew74dslyoegc

MetaWaveInfo commented 2 years ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacear6tn3w7yzwhvqxr3zepqihvo2ac5uuvms7hu72aqj3eqjp7u6e4

Address

f1vtcetpapwwyka6txwqjwymsa67npdfilbkwh64a

Datacap Allocated

200.00TiB

Signer Address

f1ktlkcxnmzxcdaoqfsunrg3vocfbmgv4n3mrn74a

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacear6tn3w7yzwhvqxr3zepqihvo2ac5uuvms7hu72aqj3eqjp7u6e4

large-datacap-requests[bot] commented 2 years ago

DataCap Allocation requested

Request number 3

Multisig Notary address

f01858410

Client address

f1vtcetpapwwyka6txwqjwymsa67npdfilbkwh64a

DataCap allocation requested

400TiB

large-datacap-requests[bot] commented 2 years ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f1vtcetpapwwyka6txwqjwymsa67npdfilbkwh64a

Last two approvers

MetaWaveInfo & swatchliu

Rule to calculate the allocation request amount

200% of weekly dc amount requested

DataCap allocation requested

400TiB

Total DataCap granted for client so far

300TiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

4.70PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
9228 8 200TiB 17.34 608GiB
UnionLabs2020 commented 2 years ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceczwozehvyxsbc36ryb5a756e6u7eljznpd2kgeh4kcar4wba4ye4

Address

f1vtcetpapwwyka6txwqjwymsa67npdfilbkwh64a

Datacap Allocated

400.00TiB

Signer Address

f17xdri3wunqgld7dm23e4f3eqsntjakwc47xjo6i

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceczwozehvyxsbc36ryb5a756e6u7eljznpd2kgeh4kcar4wba4ye4

1475Notary commented 2 years ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacedpchpgwxc2qovnotkp2n2shv56vqgv5i5l2ardgswlf5cf6rzzh4

Address

f1vtcetpapwwyka6txwqjwymsa67npdfilbkwh64a

Datacap Allocated

400.00TiB

Signer Address

f1ofq4mngy7ggcp755pfquq2gphjjnlydolf6awtq

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedpchpgwxc2qovnotkp2n2shv56vqgv5i5l2ardgswlf5cf6rzzh4

large-datacap-requests[bot] commented 2 years ago

DataCap Allocation requested

Request number 4

Multisig Notary address

f01858410

Client address

f1vtcetpapwwyka6txwqjwymsa67npdfilbkwh64a

DataCap allocation requested

800TiB

large-datacap-requests[bot] commented 2 years ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f1vtcetpapwwyka6txwqjwymsa67npdfilbkwh64a

Last two approvers

1475Notary & UnionLabs2020

Rule to calculate the allocation request amount

400% of weekly dc amount requested

DataCap allocation requested

800TiB

Total DataCap granted for client so far

700TiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

4.31PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
18520 8 400TiB 20.22 95.18TiB
Destore2023 commented 2 years ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacebbtyy6q7z3nicbx4uaou3bn4ztnhusqouvxka7pdxnxtg3mwp3di

Address

f1vtcetpapwwyka6txwqjwymsa67npdfilbkwh64a

Datacap Allocated

800.00TiB

Signer Address

f1yh6q3nmsg7i2sys7f7dexcuajgoweudcqj2chfi

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebbtyy6q7z3nicbx4uaou3bn4ztnhusqouvxka7pdxnxtg3mwp3di

Alex11801 commented 2 years ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacebwjzxnvj2ed6vcj6rcj7usutdo7b4yr2fdqiqg466hqbzbswyup2

Address

f1vtcetpapwwyka6txwqjwymsa67npdfilbkwh64a

Datacap Allocated

800.00TiB

Signer Address

f1hhippi64yiyhpjdtbidfyzma6irc2nuav7mrwmi

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebwjzxnvj2ed6vcj6rcj7usutdo7b4yr2fdqiqg466hqbzbswyup2

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 5

Multisig Notary address

f01858410

Client address

f1vtcetpapwwyka6txwqjwymsa67npdfilbkwh64a

DataCap allocation requested

1.56PiB

Id

eac66575-623e-4d5f-b054-1b238f9e9e34

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f1vtcetpapwwyka6txwqjwymsa67npdfilbkwh64a

Last two approvers

Alex11801 & swatchliu

Rule to calculate the allocation request amount

800% of weekly dc amount requested

DataCap allocation requested

1.56PiB

Total DataCap granted for client so far

1.46PiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

3.53PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
31721 9 800TiB 29.44 165.25TiB
1475Notary commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceayrmhatt6c46cirswlodsoruczbg3ibmwrxs2cpmxs4xs24blad6

Address

f1vtcetpapwwyka6txwqjwymsa67npdfilbkwh64a

Datacap Allocated

1.56PiB

Signer Address

f1ofq4mngy7ggcp755pfquq2gphjjnlydolf6awtq

Id

eac66575-623e-4d5f-b054-1b238f9e9e34

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceayrmhatt6c46cirswlodsoruczbg3ibmwrxs2cpmxs4xs24blad6

MetaWaveInfo commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacedoygfcnbswvsbfu45v7vve72olkbtiknsoxjwe27j3mbrm2hzwn2

Address

f1vtcetpapwwyka6txwqjwymsa67npdfilbkwh64a

Datacap Allocated

1.56PiB

Signer Address

f1ktlkcxnmzxcdaoqfsunrg3vocfbmgv4n3mrn74a

Id

eac66575-623e-4d5f-b054-1b238f9e9e34

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedoygfcnbswvsbfu45v7vve72olkbtiknsoxjwe27j3mbrm2hzwn2

filplus-checker commented 1 year ago

DataCap and CID Checker Report[^1]

If this is the first time a provider takes verified deal, it will be marked as new.

For most of the datacap application, below restrictions should apply.

⚠️ f01926802 has sealed 31.54% of total datacap.

⚠️ 78.07% of total deal sealed by f01926802 are duplicate data.

⚠️ 77.93% of total deal sealed by f01926914 are duplicate data.

⚠️ 76.09% of total deal sealed by f01926585 are duplicate data.

⚠️ 27.08% of total deal sealed by f01917208 are duplicate data.

⚠️ 22.44% of total deal sealed by f01917214 are duplicate data.

⚠️ 25.24% of total deal sealed by f01917241 are duplicate data.

⚠️ 24.35% of total deal sealed by f01917236 are duplicate data.

⚠️ 29.33% of total deal sealed by f01900713 are duplicate data.

⚠️ 30.00% of total deal sealed by f01895715 are duplicate data.

⚠️ 88.63% of total deal sealed by f01895783 are duplicate data.

Provider Location Total Deals Sealed Percentage Unique Data Duplicate Deals
f01926802 Ashburn, Virginia, US 466.19 TiB 31.54% 102.25 TiB 78.07%
f01926914 Ashburn, Virginia, US 164.97 TiB 11.16% 36.41 TiB 77.93%
f01926585 Ashburn, Virginia, US 160.91 TiB 10.89% 38.47 TiB 76.09%
f01917208 Seoul, Seoul, KR 117.00 TiB 7.92% 85.31 TiB 27.08%
f01917214 Seoul, Seoul, KR 116.97 TiB 7.91% 90.72 TiB 22.44%
f01917241 Seoul, Seoul, KR 111.19 TiB 7.52% 83.13 TiB 25.24%
f01917236 Seoul, Seoul, KR 108.84 TiB 7.36% 82.34 TiB 24.35%
f01900713 Seoul, Seoul, KR 91.00 TiB 6.16% 64.31 TiB 29.33%
f01895715 Seoul, Seoul, KR 90.94 TiB 6.15% 63.66 TiB 30.00%
f01914977 Ashburn, Virginia, US 25.00 TiB 1.69% 25.00 TiB 0.00%
f01895783 Boardman, Oregon, US 25.00 TiB 1.69% 2.84 TiB 88.63%

Provider Distribution

Deal Data Replication

The below table shows how each many unique data are replicated across storage providers.

⚠️ 100.00% of deals are for data replicated across less than 4 storage providers.

Unique Data Size Total Deals Made Number of Providers Deal Percentage
504.28 TiB 974.75 TiB 1 65.95%
56.44 TiB 341.50 TiB 2 23.11%
19.09 TiB 161.75 TiB 3 10.94%

Replication Distribution

Deal Data Shared with other Clients

The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.

⚠️ CID sharing has been observed.

Other Client Application Total Deals Affected Unique CIDs Verifier
f1f5edx6ofn3lf6rk3yfpldbi2pzgq2egoyu6ubpi Samdata Trade 329.28 TiB 2,664 LDN v3 multisig
f1ki4cjk27ypzjsuzkvvqzs6xobaweuoxfdcnpqhy TimeQuant 210.41 TiB 3,081 LDN v3 multisig
f1727w2vwjctfo7hflr5trgqkl3c7texh7pl4grzq GMverse 193.16 TiB 2,074 LDN v3 multisig
f1einobkrjcjk6gfc5ov6663vrri75hwdsjfs6pmq Cansoti 183.94 TiB 1,877 LDN v3 multisig
f1zb6pgkktdbyy7zxfob6gripqxuc25ukf35cc7fq Maxpic PhotoGraphic Studio 161.94 TiB 2,049 LDN v3 multisig
f1rnwp6p5kx7pcwexpucoav6mmwz3rkxw5blrboyy MigoVideo 150.50 TiB 1,897 LDN v3 multisig
f1dx7ljly4vmk5x2bn5ng4jpbqnuvozrz2phw42qy CoinPhD 140.34 TiB 1,700 LDN v3 multisig
f1ajdk7e6ex7fvtjtydzgys47bcg7jub2baucun7y Ruikuyun Information Technology Co., Ltd 125.75 TiB 1,444 LDN v3 multisig
f1quofpadzcqlonmz7v3mv7dfqvm5hdztucdsjqsy HENAN 863 SOFTWARE CO., LTD 119.19 TiB 1,604 LDN v3 multisig
f1dwhevm3p2slu6itmkssznscmpkpltdiztprnpya Hiscene 72.53 TiB 655 LDN v3 multisig
f17qd6x3leh5pa7vh6ewdaed7qhbn2mgofrokuayy Drust 51.31 TiB 939 LDN v3 multisig
f1jdmx2cuswzjlt4pnsv3t7ipmesywzxsg6q56a2a Raysun Radar Electronic Technology Co.,Ltd 33.91 TiB 308 LDN v3 multisig
f1clwd2dooy2cflfilhzeq2ycl544b3heqsiwhjrq FiboAI 22.38 TiB 315 LDN v3 multisig
f1bb2z36lpq3pnwiiowiraagpzqnpow4bonjacx7a Hola Space 20.53 TiB 297 LDN v3 multisig
f1avhqgmeazxzvylz34l26o3nlj2ywnzaviwns3dq 87v5-CarsonVideo 16.97 TiB 295 LDN v3 multisig
f1tivtdkq34mnfzso63wrr2xh6r2zo7aebao4jfla China travel service(HongKong) limited 3.31 TiB 10 LDN v3 multisig
f1qjrlejxv5a73kxurwtxyrni6ji7orm74zeeetiy Mooc 128.00 GiB 2 LDN v3 multisig
f1ffbtksiso5za73pypuxbxznng6rdv64nbihdtba EpikProtocol 64.00 GiB 2 LDN # 281

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 14 days, so for now it is being closed. Please feel free to contact the Fil+ Gov team to re-open the application if it is still being processed. Thank you!

Sunnyiscoming commented 1 year ago

Hello, @Chimay-Niko per the https://github.com/filecoin-project/notary-governance/issues/922 for Open, Public Dataset applicants, please complete the following Fil+ registration form to identify yourself as the applicant and also please add the contact information of the SP entities you are working with to store copies of the data.

This information will be reviewed by Fil+ Governance team to confirm validity and then the application will be allowed to move forward for additional notary review.