search

filecoin-project / filecoin-plus-large-datasets

Hub for client applications for DataCap at a large scale
110 stars 62 forks source link

[DataCap Application] Neusoft #972

Closed NeusoftCorporation closed 1 year ago

NeusoftCorporation commented 2 years ago

Large Dataset Notary Application

To apply for DataCap to onboard your dataset to Filecoin, please fill out the following.

Core Information

Please respond to the questions below by replacing the text saying "Please answer here". Include as much detail as you can in your answer.

Project details

Share a brief history of your project and organization.

Neusoft Corporation (SSE: 600718), an industry-leading information technology, products and solutions company for global market, is committed to promoting industrial innovation and digital transformation. Founded in 1991, Neusoft is the first listed software company in China. With insights into the latest market trends, Neusoft has always been exploring software technology innovation and applications, to help medium and large clients globally to achieve digital and intelligent development. We possess leading positions in the fields of smart city, healthcare, intelligent vehicle connectivity, enterprise digital transformation, as well as international software services.

What is the primary source of funding for this project?

Our financial support comes mainly from our shareholders.

What other projects/ecosystem stakeholders is this project associated with?

No, only our own shareholders.

Use-case details

Describe the data being stored onto Filecoin

Videos---mp4, flv. Data about our business. We do training on our products and do demonstrations and explanations via live show.

Where was the data in this dataset sourced from?

From our company and clients.

Can you share a sample of the data? A link to a file, an image, a table, etc., are good ways to do this. 

https://drive.google.com/file/d/1dY-2gfaMhKmTN14acADkYXYsveZBTDA2/view?usp=sharing

         Confirm that this is a public dataset that can be retrieved by anyone on the Network (i.e., no specific permissions or access rights are required to view the data).

Confirm.

What is the expected retrieval frequency for this data?

Once a year for future retrieval.

For how long do you plan to keep this dataset stored on Filecoin?

5 years.

DataCap allocation plan

In which geographies (countries, regions) do you plan on making storage deals?

Mainly in Asia. Like Korea, Japan, Singapore.

How will you be distributing your data to storage providers? Is there an offline data transfer process?

We will mainly select offline data transfer for data transfer abroad.

How do you plan on choosing the storage providers with whom you will be making deals? This should include a plan to ensure the data is retrievable in the future both by you and others.

We would choose SP who supports retrieval and who has strong technology for deals. Now we have f0752695, f0106949, f01117341 for this cooperation, and we will find more SPs.

How will you be distributing deals across storage providers?

We do obey rules about distributing 25% deals for every SP.

Do you have the resources/funding to start making deals as soon as you receive DataCap? What support from the community would help you onboard onto Filecoin?

Yes, our funding is enough.
large-datacap-requests[bot] commented 2 years ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

large-datacap-requests[bot] commented 2 years ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

large-datacap-requests[bot] commented 2 years ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

simonkim0515 commented 1 year ago

Please provide more information. What's the relationship between you and the organization? Can you provide more detailed information about other storage providers participated in this program, such as you can list Have you contacted more SPs? Can you explain your data composition? And to provide more data samples related with data you will store to prove that you have 5 PB already. How many copies will you store?

NeusoftCorporation commented 1 year ago

@simonkim0515 Hello Simon, thank you for your question! After all, we have not received any progress on our application for a long time. I am an employee of our technical department of Neusoft. Our company let me in charge of finding a secure and inexpensive way to store data, so I followed filecoin and came to apply for datacap. Now we have f0752695, f0106949, f01117341 for this cooperation, and we will find more SPs. Our data is about our business. We do training on our products and do demonstrations and explanations via live show. We already uploaded 1.83G dataset for you, here's the link: https://drive.google.com/file/d/1dY-2gfaMhKmTN14acADkYXYsveZBTDA2/view?usp=sharing You can check it here! I don't know if this amount is enough. Can you please tell us how much data we need to upload? We'd like store 6 copies, so that we can store data decentrally and securely.

simonkim0515 commented 1 year ago

Datacap Request Trigger

Total DataCap requested

5PiB

Expected weekly DataCap usage rate

100TiB

Client address

f1jsgrkuicjbw5g3u7f4tcs4b6zdctwxq4h6rw5na

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Multisig Notary address

f02049625

Client address

f1jsgrkuicjbw5g3u7f4tcs4b6zdctwxq4h6rw5na

DataCap allocation requested

50TiB

Id

bda76a05-86e2-4f09-b7a4-f21924ed99c3

MetaWaveInfo commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacea3kowvkpgjby6nonwhndvrul7lou6trchpd3zpuv2qvt7wgkczle

Address

f1jsgrkuicjbw5g3u7f4tcs4b6zdctwxq4h6rw5na

Datacap Allocated

50.00TiB

Signer Address

f1ktlkcxnmzxcdaoqfsunrg3vocfbmgv4n3mrn74a

Id

bda76a05-86e2-4f09-b7a4-f21924ed99c3

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacea3kowvkpgjby6nonwhndvrul7lou6trchpd3zpuv2qvt7wgkczle

YuanHeHK commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceap3iqpwuewwsvfgxua6g5bcz4v2xwpjve6tnzqq3izr6rmmagyea

Address

f1jsgrkuicjbw5g3u7f4tcs4b6zdctwxq4h6rw5na

Datacap Allocated

50.00TiB

Signer Address

f1fg6jkxsr3twfnyhdlatmq36xca6sshptscds7xa

Id

bda76a05-86e2-4f09-b7a4-f21924ed99c3

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceap3iqpwuewwsvfgxua6g5bcz4v2xwpjve6tnzqq3izr6rmmagyea

BDE-io commented 1 year ago

@NeusoftCorporation Hi! Great to see you have gotten approval for DataCap. If you are looking for storage providers to store these data or have any questions, please visit #bigdata-exchange on Filecoin Slack or reply here.

We have strong demand from a diverse group of SPs, who are actively looking to onboard more data.

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 2

Multisig Notary address

f02049625

Client address

f1jsgrkuicjbw5g3u7f4tcs4b6zdctwxq4h6rw5na

DataCap allocation requested

100TiB

Id

ad1d999b-5aa7-4f5d-96d3-7cd8874d2d36

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f1jsgrkuicjbw5g3u7f4tcs4b6zdctwxq4h6rw5na

Last two approvers

fireflyHZ & MetaWaveInfo

Rule to calculate the allocation request amount

100% of weekly dc amount requested

DataCap allocation requested

100TiB

Total DataCap granted for client so far

50TiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

4.95PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
0 0 50TiB 0 8.18TiB
1475Notary commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacec47ni7cpewlx5bzqnb2rvpid3b7cbv2mikpnexjzhybnwefmbami

Address

f1jsgrkuicjbw5g3u7f4tcs4b6zdctwxq4h6rw5na

Datacap Allocated

100.00TiB

Signer Address

f1ofq4mngy7ggcp755pfquq2gphjjnlydolf6awtq

Id

ad1d999b-5aa7-4f5d-96d3-7cd8874d2d36

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacec47ni7cpewlx5bzqnb2rvpid3b7cbv2mikpnexjzhybnwefmbami

Destore2023 commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacea3diabrhqftz3ncjh7wueg5teccp56onfqdi36z6b4h4ij2raeac

Address

f1jsgrkuicjbw5g3u7f4tcs4b6zdctwxq4h6rw5na

Datacap Allocated

100.00TiB

Signer Address

f1yh6q3nmsg7i2sys7f7dexcuajgoweudcqj2chfi

Id

ad1d999b-5aa7-4f5d-96d3-7cd8874d2d36

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacea3diabrhqftz3ncjh7wueg5teccp56onfqdi36z6b4h4ij2raeac

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 3

Multisig Notary address

f02049625

Client address

f1jsgrkuicjbw5g3u7f4tcs4b6zdctwxq4h6rw5na

DataCap allocation requested

200TiB

Id

dee5ae43-99b3-43fc-8d88-f3daac6d3a27

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f1jsgrkuicjbw5g3u7f4tcs4b6zdctwxq4h6rw5na

Last two approvers

swatchliu & 1475Notary

Rule to calculate the allocation request amount

200% of weekly dc amount requested

DataCap allocation requested

200TiB

Total DataCap granted for client so far

50TiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

4.95PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
0 0 100TiB 0 0B
MetaWaveInfo commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceafugq2ixkpahcd7wkgojbf2pdrzafkyjlvf7t2ltgywg2jhiazvy

Address

f1jsgrkuicjbw5g3u7f4tcs4b6zdctwxq4h6rw5na

Datacap Allocated

200.00TiB

Signer Address

f1ktlkcxnmzxcdaoqfsunrg3vocfbmgv4n3mrn74a

Id

dee5ae43-99b3-43fc-8d88-f3daac6d3a27

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceafugq2ixkpahcd7wkgojbf2pdrzafkyjlvf7t2ltgywg2jhiazvy

filplus-checker commented 1 year ago

DataCap and CID Checker Report[^1]

If this is the first time a provider takes verified deal, it will be marked as new.

For most of the datacap application, below restrictions should apply.

⚠️ f01974746 has sealed 58.82% of total datacap.

⚠️ 89.75% of total deal sealed by f01974746 are duplicate data.

⚠️ f01974746 has unknown IP location.

⚠️ f01962589 has sealed 41.18% of total datacap.

⚠️ 90.00% of total deal sealed by f01962589 are duplicate data.

⚠️ f01962589 has unknown IP location.

⚠️ All storage providers are located in the same region.

Provider Location Total Deals Sealed Percentage Unique Data Duplicate Deals
f01974746 Unknown 50.00 TiB 58.82% 5.13 TiB 89.75%
f01962589 Unknown 35.00 TiB 41.18% 3.50 TiB 90.00%

Provider Distribution

Deal Data Replication

The below table shows how each many unique data are replicated across storage providers.

⚠️ 100.00% of deals are for data replicated across less than 4 storage providers.

Unique Data Size Total Deals Made Number of Providers Deal Percentage
8.63 TiB 85.00 TiB 1 100.00%

Replication Distribution

Deal Data Shared with other Clients

The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.

⚠️ CID sharing has been observed.

Other Client Application Total Deals Affected Unique CIDs Verifier
f1b5r6ewhodewcjwqumkeycpvfkxcxkzrstlvo5ga Ruiyi 672.00 GiB 4 LDN v3 multisig
f1fmdka4yaspkjp3kw65azeygbmgp5dujl6wlghti Bole digital 608.00 GiB 3 LDN v3 multisig

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

Destore2023 commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceascr2uc67lt6jn2w5agbkqzivpnbv6riius5yssftyhsfisfecn2

Address

f1jsgrkuicjbw5g3u7f4tcs4b6zdctwxq4h6rw5na

Datacap Allocated

200.00TiB

Signer Address

f1yh6q3nmsg7i2sys7f7dexcuajgoweudcqj2chfi

Id

dee5ae43-99b3-43fc-8d88-f3daac6d3a27

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceascr2uc67lt6jn2w5agbkqzivpnbv6riius5yssftyhsfisfecn2

BDEio commented 1 year ago

@NeusoftCorporation Hi! Congratulations on your DataCap approval！ BDE is a verified deals auction house helping you to get paid storing your data with reliable storage providers. If you need any help, please get in touch.

cryptowhizzard commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report[^1]

Storage Provider Distribution

The below table shows the distribution of storage providers that have stored data for this client.

If this is the first time a provider takes verified deal, it will be marked as new.

For most of the datacap application, below restrictions should apply.

⚠️ f01974746 has sealed 58.82% of total datacap.

⚠️ 89.75% of total deal sealed by f01974746 are duplicate data.

⚠️ f01962589 has sealed 41.18% of total datacap.

⚠️ 90.00% of total deal sealed by f01962589 are duplicate data.

Provider Location Total Deals Sealed Percentage Unique Data Duplicate Deals
f01974746 Chicago, Illinois, US
HIVELOCITY, Inc.		 50.00 TiB 58.82% 5.13 TiB 89.75%
f01962589 London, England, GB
SpeedyPage Ltd		 35.00 TiB 41.18% 3.50 TiB 90.00%

Provider Distribution

Deal Data Replication

The below table shows how each many unique data are replicated across storage providers.

⚠️ 100.00% of deals are for data replicated across less than 4 storage providers.

Unique Data Size Total Deals Made Number of Providers Deal Percentage
8.63 TiB 85.00 TiB 1 100.00%

Replication Distribution

Deal Data Shared with other Clients

The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.

However, this could be possible if all below clients use same software to prepare for the exact same dataset or they belong to a series of LDN applications for the same dataset.

⚠️ CID sharing has been observed.

Other Client Application Total Deals Affected Unique CIDs Approvers
f1b5r6ewhodewcjwqumkeycpvfkxcxkzrstlvo5ga Ruiyi 672.00 GiB 4 1stcouldlisa
1swatchliu
1UnionLabs2020
1YuanHeHK
f1fmdka4yaspkjp3kw65azeygbmgp5dujl6wlghti Bole digital 608.00 GiB 3 11475Notary
1liyunzhi-666
1MetaWaveInfo
1UnionLabs2020

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

cryptowhizzard commented 1 year ago

Hello,

Both of your SP's have been heavily involved of non compliant storage for FIL+.

Making matters worse i have seen the SP's move : from: https://filfox.info/en/message/bafy2bzacedtp6apdicl75667rvldrte7bpxfqunajfkuobeihlp66kglvisaa to: https://filfox.info/en/message/bafy2bzacebmjphk3dvnttz2ccqs2pc267226lvtkfau2vzsemfn6xz23yvagm The decoded message reads: From ip address 15.223.20.110 ( Ontario AWS ) to 5.44.251.28 ( London ).

Can you tell us what organization these SP ID's belong to?

To get your LDN on track again ( if you are interested ) i would like you to fill out this form to provide us with the necessary information to make a educated decision on your LDN request if we would like to support it.

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 14 days, so for now it is being closed. Please feel free to contact the Fil+ Gov team to re-open the application if it is still being processed. Thank you!

large-datacap-requests[bot] commented 1 year ago

Thanks for your request! :exclamation: We have found some problems in the information provided. We could not find Organization Name field in the information provided We could not find Website \/ Social Media field in the information provided We could not find Total amount of DataCap being requested (between 500 TiB and 5 PiB) field in the information provided We could not find Weekly allocation of DataCap requested (usually between 1-100TiB) field in the information provided We could not find On-chain address for first allocation field in the information provided We could not find Data Type of Application field in the information provided

Please, take a look at the request and edit the body of the issue providing all the required information.
aggregation-and-compliance-bot[bot] commented 10 months ago
Client f01920136 does not follow the datacap usage rules. More info here. This application has been failing the requirements for 7 days. Please take appropiate action to fix the following DataCap usage problems. Criteria Treshold Reason
Cid Checker score > 25% The client has a CID checker score of 0%. This should be greater than 25%. To find out more about CID checker score please look at this issue: https://github.com/filecoin-project/notary-governance/issues/986
Percent of used DataCap stored with top provider < 75 The percent of Data from the client that is stored with their top provider is 75.71%. This should be less than 75%