search

filecoin-project / filecoin-plus-large-datasets

Hub for client applications for DataCap at a large scale
110 stars 62 forks source link

[DataCap Application] Shenzhen Most Profound Network Technology #1025

Closed yua3891 closed 1 year ago

yua3891 commented 2 years ago

Large Dataset Notary Application

To apply for DataCap to onboard your dataset to Filecoin, please fill out the following.

Core Information

Please respond to the questions below by replacing the text saying "Please answer here". Include as much detail as you can in your answer.

Project details

Share a brief history of your project and organization.

Shenzhen Most Profound Network Technology Co., Ltd. was established on April 25, 2017. Based on artificial intelligence and blockchain technology, the company provides customers with trustworthy system solutions. Its main products include boring SCRM, gas industry ERP and other software products, serving thousands of small and medium-sized enterprises.

What is the primary source of funding for this project?

Own funds.

What other projects/ecosystem stakeholders is this project associated with?

No.

Use-case details

Describe the data being stored onto Filecoin

In the past five years, the company has copyrighted the product plans, data manuscripts, 3D models, audio and video, etc. for customers.

Where was the data in this dataset sourced from?

Publicly available business data from the company.

Can you share a sample of the data? A link to a file, an image, a table, etc., are good ways to do this. 

https://pan.baidu.com/s/1jQEXcm5d5X7UdScgYbu1jg?pwd=i8fq

Confirm that this is a public dataset that can be retrieved by anyone on the Network (i.e., no specific permissions or access rights are required to view the data).

We Confirm.

What is the expected retrieval frequency for this data?

About twice a year.

For how long do you plan to keep this dataset stored on Filecoin?

about 36 months.

DataCap allocation plan

In which geographies (countries, regions) do you plan on making storage deals?

All.

How will you be distributing your data to storage providers? Is there an offline data transfer process?

The data is large and we transmit it offline.

How do you plan on choosing the storage providers with whom you will be making deals? This should include a plan to ensure the data is retrievable in the future both by you and others.

We will find reputable SPs in the community to sealing  data.

How will you be distributing deals across storage providers?

Offline data transfer.

Do you have the resources/funding to start making deals as soon as you receive DataCap? What support from the community would help you onboard onto Filecoin?

Yes and no additional support is needed. We may contact Filecoin slack if assistance is needed.
large-datacap-requests[bot] commented 2 years ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

raghavrmadya commented 1 year ago

What's your relationship with the company?

yua3891 commented 1 year ago

Hi, @raghavrmadya, I work for this company. I also pay attention to filecoin's storage technology, so I want to apply for a quota to store our data. thank you!

Sunnyiscoming commented 1 year ago

Can you explain your data composition? How many copies will you store? What's the relationship between you and the organization? Can you provide more detailed information about other storage providers participated in this program, such as you can list SPs you have contacted with at present?

yua3891 commented 1 year ago

The data I'm going to store are product historical documents, including audio and video, product solutions, desensitized DB data, etc. I can store no more than 4 copies. I am an engineer of the company.

We found some reputable storage providers in the slack to provide services for us. The following SPs were reported to me: f01926802, f01922865, f01803380, f01882219, f01953985, f01270767.

Thank you!

simonkim0515 commented 1 year ago

Datacap Request Trigger

Total DataCap requested

1PiB

Expected weekly DataCap usage rate

100TiB

Client address

f1xxsgv4rojysunaqenekoogyutb54sqbbxukn77y

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Multisig Notary address

f01858410

Client address

f1xxsgv4rojysunaqenekoogyutb54sqbbxukn77y

DataCap allocation requested

50TiB

Id

baa84494-87a7-40a6-9f09-f86211d9d72e

newwebgroup commented 1 year ago

Could you send an email to filplus-app-review@fil.org with your official domain in order to confirm your identity? Email name should includes the issue id https://github.com/filecoin-project/filecoin-plus-large-datasets/issues/1025.

yua3891 commented 1 year ago

Actually, I only applied for 1PiB. I plan to store 5 copies. My current data volume is about 300TiB.

yua3891 commented 1 year ago

hi, @newwebgroup, The email has been sent, thank you.

11

ipfscn commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacecksur2yp37znatkfkdejpfed57idfgsra3nv4lhd3khazpqjbasm

Address

f1xxsgv4rojysunaqenekoogyutb54sqbbxukn77y

Datacap Allocated

50.00TiB

Signer Address

f1j4n74chme7whbz3yls4a7ixqewb6dijypqg2a3a

Id

baa84494-87a7-40a6-9f09-f86211d9d72e

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecksur2yp37znatkfkdejpfed57idfgsra3nv4lhd3khazpqjbasm

large-datacap-requests[bot] commented 1 year ago

Aborting. Exit Code is Non 0

newwebgroup commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaced2jxy6szqhmfa4ii7uunvnxjx2a2rruregfah54wavu3poeoo5pk

Address

f1xxsgv4rojysunaqenekoogyutb54sqbbxukn77y

Datacap Allocated

50.00TiB

Signer Address

f1e77zuityhvvw6u2t6tb5qlnsegy2s67qs4lbbbq

Id

baa84494-87a7-40a6-9f09-f86211d9d72e

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaced2jxy6szqhmfa4ii7uunvnxjx2a2rruregfah54wavu3poeoo5pk

large-datacap-requests[bot] commented 1 year ago

Aborting. Exit Code is Non 0

Sunnyiscoming commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report[^1]

Storage Provider Distribution

The below table shows the distribution of storage providers that have stored data for this client.

If this is the first time a provider takes verified deal, it will be marked as new.

For most of the datacap application, below restrictions should apply.

Since this is the 3rd allocation, the following restrictions have been relaxed:

✔️ Storage provider distribution looks healthy.

Provider Location Total Deals Sealed Percentage Unique Data Duplicate Deals
f01807707 Shenzhen, Guangdong, CN
China Telecom (Group)		 6.49 TiB 43.03% 6.49 TiB 0.00%
f0478837new Quanzhou, Fujian, CN
CHINANET-BACKBONE		 8.59 TiB 56.97% 8.59 TiB 0.00%

Provider Distribution

Deal Data Replication

The below table shows how each many unique data are replicated across storage providers.

Since this is the 3rd allocation, the following restrictions have been relaxed:

⚠️ 100.00% of deals are for data replicated across less than 3 storage providers.

Unique Data Size Total Deals Made Number of Providers Deal Percentage
15.08 TiB 15.08 TiB 1 100.00%

Replication Distribution

Deal Data Shared with other Clients

The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.

However, this could be possible if all below clients use same software to prepare for the exact same dataset or they belong to a series of LDN applications for the same dataset.

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

cryptowhizzard commented 1 year ago

Hi,

Can you provide me with 2 more organizations here for storing the next tranche of datacap? As far as i can see you store with one organization, that is against the rules of FIL+.

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 2

Multisig Notary address

f02049625

Client address

f1xxsgv4rojysunaqenekoogyutb54sqbbxukn77y

DataCap allocation requested

100TiB

Id

b25ead7f-456a-408a-8a8e-de018c4fb65c

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f1xxsgv4rojysunaqenekoogyutb54sqbbxukn77y

Rule to calculate the allocation request amount

100% of weekly dc amount requested

DataCap allocation requested

100TiB

Total DataCap granted for client so far

50TiB

Datacap to be granted to reach the total amount requested by the client (1PiB)

974TiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
847 4 50TiB 44.53 13.96TiB
filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 99.30% of deals are for data replicated across less than 3 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the full report.

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 99.30% of deals are for data replicated across less than 3 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the full report.

sxxfuture-official commented 1 year ago

image deal_id from https://filecoin.tools/f01985891

Randomly tested data retrievability, the result was OK. The CID checker shows that the number of data replica is not enough, but considering that the current project is in the initial stage, adjustments must be made to this aspect later, support this round and I will continue to pay attention.

sxxfuture-official commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceadxdaxyx5wvwiywyj4abpomcgborcbbutvbxpstefy4ryn7bp6fa

Address

f1xxsgv4rojysunaqenekoogyutb54sqbbxukn77y

Datacap Allocated

100.00TiB

Signer Address

f1foiomqlmoshpuxm6aie4xysffqezkjnokgwcecq

Id

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceadxdaxyx5wvwiywyj4abpomcgborcbbutvbxpstefy4ryn7bp6fa

igoovo commented 1 year ago

Provide initial support, please match the number of stored copies with the rules in the future.

Normalnoise commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 99.50% of deals are for data replicated across less than 3 storage providers.

Deal Data Shared with other Clients[^3]

⚠️ CID sharing has been observed. (Top 3)

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the full report.

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

Swift-scouts commented 1 year ago

ok,keep this application open.

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 14 days, so for now it is being closed. Please feel free to contact the Fil+ Gov team to re-open the application if it is still being processed. Thank you!

Sunnyiscoming commented 11 months ago

Hello, @yua3891 per the https://github.com/filecoin-project/notary-governance/issues/922 for Open, Public Dataset applicants, please complete the following Fil+ registration form to identify yourself as the applicant and also please add the contact information of the SP entities you are working with to store copies of the data.

This information will be reviewed by Fil+ Governance team to confirm validity and then the application will be allowed to move forward for additional notary review.

large-datacap-requests[bot] commented 9 months ago

Thanks for your request! :exclamation: We have found some problems in the information provided. We could not find Website \/ Social Media field in the information provided We could not find Total amount of DataCap being requested (between 500 TiB and 5 PiB) field in the information provided We could not find Weekly allocation of DataCap requested (usually between 1-100TiB) field in the information provided We could not find On-chain address for first allocation field in the information provided We could not find Data Type of Application field in the information provided

Please, take a look at the request and edit the body of the issue providing all the required information.
large-datacap-requests[bot] commented 6 months ago

RootKeyHolders have approved multisig account. You can now request first datacap release