filecoin-project / filecoin-plus-large-datasets

Hub for client applications for DataCap at a large scale
110 stars 62 forks source link

[DataCap Application] Raysun #884

Closed Raysunradar closed 1 year ago

Raysunradar commented 2 years ago

Large Dataset Notary Application

To apply for DataCap to onboard your dataset to Filecoin, please fill out the following.

Core Information

Please respond to the questions below by replacing the text saying "Please answer here". Include as much detail as you can in your answer.

Project details

Share a brief history of your project and organization.

Raysun is committed to developing the world's leading radar technology and roadside sensing solutions for Telematics, providing efficient and reliable holographic sensing data for intelligent transportation systems and driverless solutions. The team has been engaged in radar research dating back to 1945 and has nearly 20 years of experience in radar industrialization. Using advanced technology accumulation, years of radar R&D experience and strong industry support, the company has developed low-cost, highly intelligent and stable millimeter wave radar and radar vision fusion sensors to provide users with more efficient and reliable roadside sensing solutions.

What is the primary source of funding for this project?

From finance investment.

What other projects/ecosystem stakeholders is this project associated with?

We only attend Filecoin project---LDN.

Use-case details

Describe the data being stored onto Filecoin

Videos----mp4 about road monitoring.

Where was the data in this dataset sourced from?

Data is from our products which provide service about monitoring.

Can you share a sample of the data? A link to a file, an image, a table, etc., are good ways to do this. 

There are two videos as samples.
[sample.for.Raysun.zip](https://github.com/filecoin-project/filecoin-plus-large-datasets/files/9442035/sample.for.Raysun.zip)
https://drive.google.com/file/d/1JgIHTju2hBtjmpHTVXPxCzGAn3tt-p7M/view?usp=sharing

         Confirm that this is a public dataset that can be retrieved by anyone on the Network (i.e., no specific permissions or access rights are required to view the data).

We confirm these data is authorized as copies to store in Filecoin.

What is the expected retrieval frequency for this data?

Ideal frequency is every two years. We just need to make it safely.

For how long do you plan to keep this dataset stored on Filecoin?

2 years --- the first step.

DataCap allocation plan

In which geographies (countries, regions) do you plan on making storage deals?

Asia is ok.

How will you be distributing your data to storage providers? Is there an offline data transfer process?

Yes. Offline transfer is proper for us to transfer data, by express.

How do you plan on choosing the storage providers with whom you will be making deals? This should include a plan to ensure the data is retrievable in the future both by you and others.

Github is a good platfom to find SP. They should have enough source to recieve our deals----their capacity, funds.

How will you be distributing deals across storage providers?

To every sp, we will send less than 25% deals.

Do you have the resources/funding to start making deals as soon as you receive DataCap? What support from the community would help you onboard onto Filecoin?

Yes.
large-datacap-requests[bot] commented 2 years ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

Raysunradar commented 2 years ago

@raghavrmadya @Sunnyiscoming Here is our previous application. We have finished KYC and provided SPs we have contacted with! https://github.com/filecoin-project/filecoin-plus-large-datasets/issues/507 Please check and grant our datacap request!

large-datacap-requests[bot] commented 1 year ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

raghavrmadya commented 1 year ago

Datacap Request Trigger

Total DataCap requested

5PiB

Expected weekly DataCap usage rate

100TiB

Client address

f1jdmx2cuswzjlt4pnsv3t7ipmesywzxsg6q56a2a

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Multisig Notary address

f01858410

Client address

f1jdmx2cuswzjlt4pnsv3t7ipmesywzxsg6q56a2a

DataCap allocation requested

50TiB

MatrixStorage commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceatwldxvcljjrjoe2qsv527hvhudfal5ua6p5htydvbyds4ozozss

Address

f1jdmx2cuswzjlt4pnsv3t7ipmesywzxsg6q56a2a

Datacap Allocated

50.00TiB

Signer Address

f1tbxqwjxfyv7swsdin4einirlsfquv3vnmlapley

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceatwldxvcljjrjoe2qsv527hvhudfal5ua6p5htydvbyds4ozozss

BlockMakeronline commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacecbh2m7hoh6w26nc3f3skoo42mjmpk7tfxrl7jyhlplouwafqwsfw

Address

f1jdmx2cuswzjlt4pnsv3t7ipmesywzxsg6q56a2a

Datacap Allocated

50.00TiB

Signer Address

f1o3twrcpwjtpcd4q36lpq4qmy2qfbgtyy5h6tsty

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecbh2m7hoh6w26nc3f3skoo42mjmpk7tfxrl7jyhlplouwafqwsfw

BDE-io commented 1 year ago

@Raysunradar Hi! Great to see you have gotten approval for DataCap and advancing the mission of preserving humanity’s most important information. If you are looking for storage providers to store these data or have any questions, please visit #bigdata-exchange on Filecoin Slack or reply here.

We have strong demand from a diverse group of SPs, who are actively looking to onboard more data.

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 2

Multisig Notary address

f01858410

Client address

f1jdmx2cuswzjlt4pnsv3t7ipmesywzxsg6q56a2a

DataCap allocation requested

100TiB

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f1jdmx2cuswzjlt4pnsv3t7ipmesywzxsg6q56a2a

Last two approvers

BlockMakeronline & MatrixStorage

Rule to calculate the allocation request amount

100% of weekly dc amount requested

DataCap allocation requested

100TiB

Total DataCap granted for client so far

50TiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

4.95PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
0 0 50TiB 0 5TiB
UnionLabs2020 commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacec6s2vaoqf2jbshbdvcwx5nhmurviz4iqgattrz6o3clq64w4vb3c

Address

f1jdmx2cuswzjlt4pnsv3t7ipmesywzxsg6q56a2a

Datacap Allocated

100.00TiB

Signer Address

f17xdri3wunqgld7dm23e4f3eqsntjakwc47xjo6i

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacec6s2vaoqf2jbshbdvcwx5nhmurviz4iqgattrz6o3clq64w4vb3c

liyunzhi-666 commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacedl37knoqggwcifj3n5jbwsbykjxsghdtdnxzibrtohp7q76isfcc

Address

f1jdmx2cuswzjlt4pnsv3t7ipmesywzxsg6q56a2a

Datacap Allocated

100.00TiB

Signer Address

f1pszcrsciyixyuxxukkvtazcokexbn54amf7gvoq

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedl37knoqggwcifj3n5jbwsbykjxsghdtdnxzibrtohp7q76isfcc

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 3

Multisig Notary address

f01858410

Client address

f1jdmx2cuswzjlt4pnsv3t7ipmesywzxsg6q56a2a

DataCap allocation requested

200TiB

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f1jdmx2cuswzjlt4pnsv3t7ipmesywzxsg6q56a2a

Last two approvers

liyunzhi-666 & UnionLabs2020

Rule to calculate the allocation request amount

200% of weekly dc amount requested

DataCap allocation requested

200TiB

Total DataCap granted for client so far

150TiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

4.85PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
1280 4 100TiB 33.33 24.06TiB
MetaWaveInfo commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceae7uvo4gmxj5cewbnl5ub4bvbwy24yhrnhvwfaqtrctlccewauuy

Address

f1jdmx2cuswzjlt4pnsv3t7ipmesywzxsg6q56a2a

Datacap Allocated

200.00TiB

Signer Address

f1ktlkcxnmzxcdaoqfsunrg3vocfbmgv4n3mrn74a

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceae7uvo4gmxj5cewbnl5ub4bvbwy24yhrnhvwfaqtrctlccewauuy

Destore2023 commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacea3kshsfb7eazo2tcojbzado7t34nkkaoqatdebpk7usjk7z3tln6

Address

f1jdmx2cuswzjlt4pnsv3t7ipmesywzxsg6q56a2a

Datacap Allocated

200.00TiB

Signer Address

f1yh6q3nmsg7i2sys7f7dexcuajgoweudcqj2chfi

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacea3kshsfb7eazo2tcojbzado7t34nkkaoqatdebpk7usjk7z3tln6

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 4

Multisig Notary address

f01858410

Client address

f1jdmx2cuswzjlt4pnsv3t7ipmesywzxsg6q56a2a

DataCap allocation requested

400TiB

Id

93f0a469-c015-4a8c-9411-dbd5807efbf9

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f1jdmx2cuswzjlt4pnsv3t7ipmesywzxsg6q56a2a

Last two approvers

swatchliu & MetaWaveInfo

Rule to calculate the allocation request amount

400% of weekly dc amount requested

DataCap allocation requested

400TiB

Total DataCap granted for client so far

350TiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

4.65PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
5715 7 200TiB 24.60 44.5TiB
1475Notary commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacedit6y7utyrsrrr5xuifnpvgyxqqm6p4o2n4o5otr4y7puty42ina

Address

f1jdmx2cuswzjlt4pnsv3t7ipmesywzxsg6q56a2a

Datacap Allocated

400.00TiB

Signer Address

f1ofq4mngy7ggcp755pfquq2gphjjnlydolf6awtq

Id

93f0a469-c015-4a8c-9411-dbd5807efbf9

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedit6y7utyrsrrr5xuifnpvgyxqqm6p4o2n4o5otr4y7puty42ina

liyunzhi-666 commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacedspojyyo674qtmixrylwp2ivbja6w3gbzjsqxzgbepywruur7moa

Address

f1jdmx2cuswzjlt4pnsv3t7ipmesywzxsg6q56a2a

Datacap Allocated

400.00TiB

Signer Address

f1pszcrsciyixyuxxukkvtazcokexbn54amf7gvoq

Id

93f0a469-c015-4a8c-9411-dbd5807efbf9

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedspojyyo674qtmixrylwp2ivbja6w3gbzjsqxzgbepywruur7moa

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 5

Multisig Notary address

f01858410

Client address

f1jdmx2cuswzjlt4pnsv3t7ipmesywzxsg6q56a2a

DataCap allocation requested

800TiB

Id

a5a716f1-ad14-41cd-864c-6e45e043251a

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f1jdmx2cuswzjlt4pnsv3t7ipmesywzxsg6q56a2a

Last two approvers

liyunzhi-666 & 1475Notary

Rule to calculate the allocation request amount

800% of weekly dc amount requested

DataCap allocation requested

800TiB

Total DataCap granted for client so far

750TiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

4.26PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
12677 8 400TiB 47.79 99.90TiB
MetaWaveInfo commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacedryr344ubpoc7dptm5vqnyndj5zad5qsavvb5pqf4vhr2hdhbe6o

Address

f1jdmx2cuswzjlt4pnsv3t7ipmesywzxsg6q56a2a

Datacap Allocated

800.00TiB

Signer Address

f1ktlkcxnmzxcdaoqfsunrg3vocfbmgv4n3mrn74a

Id

a5a716f1-ad14-41cd-864c-6e45e043251a

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedryr344ubpoc7dptm5vqnyndj5zad5qsavvb5pqf4vhr2hdhbe6o

YuanHeHK commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacedj3xrofgcmjurnpvn4yobyuzbwgin5wkqjvg3dny575ty7vt3lqe

Address

f1jdmx2cuswzjlt4pnsv3t7ipmesywzxsg6q56a2a

Datacap Allocated

800.00TiB

Signer Address

f1fg6jkxsr3twfnyhdlatmq36xca6sshptscds7xa

Id

a5a716f1-ad14-41cd-864c-6e45e043251a

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedj3xrofgcmjurnpvn4yobyuzbwgin5wkqjvg3dny575ty7vt3lqe

filplus-checker commented 1 year ago

DataCap and CID Checker Report[^1]

If this is the first time a provider takes verified deal, it will be marked as new.

For most of the datacap application, below restrictions should apply.

⚠️ f01962589 has sealed 41.77% of total datacap.

⚠️ 89.87% of total deal sealed by f01962589 are duplicate data.

⚠️ f01962589 has unknown IP location.

⚠️ f01926914 has sealed 31.97% of total datacap.

⚠️ 73.26% of total deal sealed by f01926914 are duplicate data.

⚠️ 77.93% of total deal sealed by f01937964 are duplicate data.

⚠️ 78.78% of total deal sealed by f01926585 are duplicate data.

⚠️ 77.95% of total deal sealed by f01832632 are duplicate data.

⚠️ 88.51% of total deal sealed by f01828096 are duplicate data.

⚠️ 70.63% of total deal sealed by f01924416 are duplicate data.

⚠️ 67.19% of total deal sealed by f01924325 are duplicate data.

⚠️ 71.09% of total deal sealed by f01924350 are duplicate data.

Provider Location Total Deals Sealed Percentage Unique Data Duplicate Deals
f01962589new Unknown 301.66 TiB 41.77% 30.56 TiB 89.87%
f01926914new Ashburn, Virginia, US 230.91 TiB 31.97% 61.75 TiB 73.26%
f01937964 Tokyo, Tokyo, JP 45.88 TiB 6.35% 10.13 TiB 77.93%
f01926585 Ashburn, Virginia, US 39.91 TiB 5.53% 8.47 TiB 78.78%
f01832632 San Jose, California, US 36.00 TiB 4.99% 7.94 TiB 77.95%
f01828096 San Jose, California, US 34.81 TiB 4.82% 4.00 TiB 88.51%
f01924416 Singapore, Singapore, SG 15.00 TiB 2.08% 4.41 TiB 70.63%
f01924325 Singapore, Singapore, SG 10.00 TiB 1.38% 3.28 TiB 67.19%
f01924350 Singapore, Singapore, SG 8.00 TiB 1.11% 2.31 TiB 71.09%

Provider Distribution

Deal Data Replication

The below table shows how each many unique data are replicated across storage providers.

⚠️ 100.00% of deals are for data replicated across less than 4 storage providers.

Unique Data Size Total Deals Made Number of Providers Deal Percentage
128.41 TiB 707.72 TiB 1 98.00%
2.22 TiB 14.44 TiB 2 2.00%

Replication Distribution

Deal Data Shared with other Clients

The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.

⚠️ CID sharing has been observed.

Other Client Application Total Deals Affected Unique CIDs Verifier
f1bb2z36lpq3pnwiiowiraagpzqnpow4bonjacx7a Hola Space 173.66 TiB 1,536 LDN v3 multisig
f1727w2vwjctfo7hflr5trgqkl3c7texh7pl4grzq GMverse 171.03 TiB 1,530 LDN v3 multisig
f1dwhevm3p2slu6itmkssznscmpkpltdiztprnpya Hiscene 44.56 TiB 250 LDN v3 multisig
f1vtcetpapwwyka6txwqjwymsa67npdfilbkwh64a Chimay 41.28 TiB 308 LDN v3 multisig
f1f5edx6ofn3lf6rk3yfpldbi2pzgq2egoyu6ubpi Samdata Trade 37.69 TiB 232 LDN v3 multisig
f1xtnkj5ti77f5gbzhclnpj3xt6e5dwhfzive2yca Beacon Project 36.81 TiB 87 Project Beacon, 12 LDNs LDN # 444, 446, 447, 448, 474, 475, 476, 477, 479, 480, 481, 482
f1ajdk7e6ex7fvtjtydzgys47bcg7jub2baucun7y Ruikuyun Information Technology Co., Ltd 20.94 TiB 163 LDN v3 multisig
f1einobkrjcjk6gfc5ov6663vrri75hwdsjfs6pmq Cansoti 20.53 TiB 101 LDN v3 multisig
f1clwd2dooy2cflfilhzeq2ycl544b3heqsiwhjrq FiboAI 9.66 TiB 95 LDN v3 multisig
f1zb6pgkktdbyy7zxfob6gripqxuc25ukf35cc7fq Maxpic PhotoGraphic Studio 5.25 TiB 49 LDN v3 multisig
f1mn5mw2dpqz6p3s7vxrlkhkh3okdtc6t7wqro4xa Unisound 4.69 TiB 54 LDN v3 multisig
f1ffbtksiso5za73pypuxbxznng6rdv64nbihdtba EpikProtocol 2.78 TiB 28 LDN # 281
f1ivsvpljx4ovp2tth73pllkxmumrudemks623iia TIS Inc. group 1.94 TiB 15 LDN v3 multisig
f1tgii4xgcp6um4n2w7eqaw6bwvnvyii2u7cjgzka Meson.Network 704.00 GiB 3 LDN v3 multisig
f1rnwp6p5kx7pcwexpucoav6mmwz3rkxw5blrboyy MigoVideo 576.00 GiB 9 LDN v3 multisig
f1zav4f4rak2yvbrq357z3whj224wn4dipl7eiesy Shanghai Zhixun 128.00 GiB 2 LDN v3 multisig
f1quofpadzcqlonmz7v3mv7dfqvm5hdztucdsjqsy HENAN 863 SOFTWARE CO., LTD 64.00 GiB 1 LDN v3 multisig

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

large-datacap-requests[bot] commented 1 year ago

Thanks for your request! :exclamation: We have found some problems in the information provided. We could not find Organization Name field in the information provided We could not find Website \/ Social Media field in the information provided We could not find Total amount of DataCap being requested (between 500 TiB and 5 PiB) field in the information provided We could not find Weekly allocation of DataCap requested (usually between 1-100TiB) field in the information provided We could not find On-chain address for first allocation field in the information provided

Please, take a look at the request and edit the body of the issue providing all the required information.
github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 14 days, so for now it is being closed. Please feel free to contact the Fil+ Gov team to re-open the application if it is still being processed. Thank you!

Sunnyiscoming commented 10 months ago

Hello, @Raysunradar per the https://github.com/filecoin-project/notary-governance/issues/922 for Open, Public Dataset applicants, please complete the following Fil+ registration form to identify yourself as the applicant and also please add the contact information of the SP entities you are working with to store copies of the data.

This information will be reviewed by Fil+ Governance team to confirm validity and then the application will be allowed to move forward for additional notary review.

aggregation-and-compliance-bot[bot] commented 9 months ago
Client f01885335 does not follow the datacap usage rules. More info here. This application has been failing the requirements for 7 days. Please take appropiate action to fix the following DataCap usage problems. Criteria Treshold Reason
Cid Checker score > 25% The client has a CID checker score of 14%. This should be greater than 25%. To find out more about CID checker score please look at this issue: https://github.com/filecoin-project/notary-governance/issues/986