filecoin-project / filecoin-plus-large-datasets

Hub for client applications for DataCap at a large scale
110 stars 62 forks source link

[DataCap Application] Gemdale group #1000

Closed linice closed 1 year ago

linice commented 2 years ago

Large Dataset Notary Application

To apply for DataCap to onboard your dataset to Filecoin, please fill out the following.

Core Information

Please respond to the questions below by replacing the text saying "Please answer here". Include as much detail as you can in your answer.

Project details

Share a brief history of your project and organization.

Gemdale  Group is one of the top 500 companies in China. Gemdale group was founded in Shenzhen, China in 1988 and listed on the Shanghai Stock Exchange (600383. SH) in 2001. After decades of exploration and practice, it has developed into a comprehensive listed company with real estate development as its main business and related diversified businesses. The business covers real estate development, commercial real estate and industrial park and town development and operation, real estate finance, smart services, sports industry operation, home decoration industry, agent construction industry, education industry, etc. The business covers more than 280 large and medium-sized cities in China and 8 different cities and regions on the East and west coasts of the United States. As of December 31, 2021, Gemdale group had a total asset of about 462.8 billion yuan and a net asset attributable to shareholders of about 63 billion yuan. It has been listed in the Forbes 2000 global enterprises and the Fortune 500 China list for many consecutive years.

What is the primary source of funding for this project?

own capital.

What other projects/ecosystem stakeholders is this project associated with?

No.

Use-case details

Describe the data being stored onto Filecoin

Data includes group publications, slideshows, training videos/audio and business data and service logs, etc.

Where was the data in this dataset sourced from?

- Publications are public offerings.
- These slides are made by the in-house team and are mainly used for the presentation of the business.
-The video and audio are recorded by ourselves.
- Lecture materials are produced by senior members of our team.
-Business data is data that requires cold backup.
- Service logs are regular logs for web services, DB services, file services, etc.

Can you share a sample of the data? A link to a file, an image, a table, etc., are good ways to do this.

https://drive.google.com/drive/folders/1-6HDnVRbLmOGvwoXXxOSsL2lNgiJ6FQm?usp=sharing

Confirm that this is a public dataset that can be retrieved by anyone on the Network (i.e., no specific permissions or access rights are required to view the data).

Yes. All data is public and can be retrieved by anyone on the Network.

What is the expected retrieval frequency for this data?

Multiple times per year.

For how long do you plan to keep this dataset stored on Filecoin?

At least three years.

DataCap allocation plan

In which geographies (countries, regions) do you plan on making storage deals?

Asia.

How will you be distributing your data to storage providers? Is there an offline data transfer process?

Yes, I choose offline data transfer primarily.

How do you plan on choosing the storage providers with whom you will be making deals? This should include a plan to ensure the data is retrievable in the future both by you and others.

I would ensure if they are credible for coorperation and their ability of actual deal recieving.

How will you be distributing deals across storage providers?

We plan having 5 SPs for deals and we may distribute deals to them for different percentage.

Do you have the resources/funding to start making deals as soon as you receive DataCap? What support from the community would help you onboard onto Filecoin?

I have all I need to start making deals.
large-datacap-requests[bot] commented 2 years ago

Thanks for your request! :exclamation: We have found some problems in the information provided. We could not find your Name in the information provided We could not find any Region in the information provided

Please, take a look at the request and edit the body of the issue providing all the required information.
large-datacap-requests[bot] commented 2 years ago

Thanks for your request! :exclamation: We have found some problems in the information provided. We could not find your Name in the information provided We could not find any Region in the information provided

Please, take a look at the request and edit the body of the issue providing all the required information.
large-datacap-requests[bot] commented 2 years ago

Thanks for your request! :exclamation: We have found some problems in the information provided. We could not find your Name in the information provided We could not find any Region in the information provided

Please, take a look at the request and edit the body of the issue providing all the required information.
large-datacap-requests[bot] commented 2 years ago

Thanks for your request! :exclamation: We have found some problems in the information provided. We could not find your Name in the information provided We could not find any Region in the information provided

Please, take a look at the request and edit the body of the issue providing all the required information.
large-datacap-requests[bot] commented 2 years ago

Thanks for your request! :exclamation: We have found some problems in the information provided. We could not find your Name in the information provided We could not find any Region in the information provided

Please, take a look at the request and edit the body of the issue providing all the required information.
large-datacap-requests[bot] commented 2 years ago

Thanks for your request! :exclamation: We have found some problems in the information provided. We could not find your Name in the information provided We could not find any Region in the information provided

Please, take a look at the request and edit the body of the issue providing all the required information.
large-datacap-requests[bot] commented 2 years ago

Thanks for your request!

Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!
large-datacap-requests[bot] commented 2 years ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

raghavrmadya commented 1 year ago

It is unclear from your samples what you are looking to store. Please provide accurate and proper samples

linice commented 1 year ago

It is unclear from your samples what you are looking to store. Please provide accurate and proper samples

Well, the previous sample is really a bit miscellaneous. In fact, we mainly store logs and company related videos, We have created some new samples: https://drive.google.com/drive/folders/1QmADfecTZbTT3Lm_uft6UKURwE9tWDa6 https://drive.google.com/drive/folders/1mBjp9SOlquQuaN7YFnfSsKz-9YUWI4Ux

thank you!

Sunnyiscoming commented 1 year ago

Can you explain your data composition? How many logs and company related videos are there? How many copies will you store? What's the relationship between you and the organization? Can you provide more detailed information about other storage providers participated in this program, such as you can list SPs you have contacted with at present?

linice commented 1 year ago

Can you explain your data composition? How many logs and company related videos are there? How many copies will you store? What's the relationship between you and the organization? Can you provide more detailed information about other storage providers participated in this program, such as you can list SPs you have contacted with at present?

Hello, @Sunnyiscoming, I am an employee of the company, responsible for technical operation and service operation and maintenance. As a real estate group with a history of more than 20 years, the group companies and their business entities have a huge amount of data that needs to be cold backed up. The data are mainly concentrated in logs (daily office monitoring, service platform logs [Web/DB/MQ/MAIL and other services]), and publicity materials that can be published by the media,

About 1 PB of logs and company videos, and about 200 TiB of other publicity data, I plan to store 5 copies of data.

I am an employee of the company, responsible for technical operation and maintenance.

I tried to contact some storage providers near the company, including New Web Group, MK Storage and other service providers. Their nodes include but are not limited to f049911, f01101196, f01900537, f01914991, f01036920, f0392813, f0149765 and f0816168.

simonkim0515 commented 1 year ago

Datacap Request Trigger

Total DataCap requested

5PiB

Expected weekly DataCap usage rate

200TiB

Client address

f167x5eokj2rlemqwroakbudhezeqrziorokqypua

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Multisig Notary address

f02049625

Client address

f167x5eokj2rlemqwroakbudhezeqrziorokqypua

DataCap allocation requested

100TiB

Id

e4922c71-2429-48fe-8750-5f33930e9446

Sunnyiscoming commented 1 year ago

Hey @linice , if you still want to apply for datacap, you can ask notaries to do client due diligence in slack channel. https://app.slack.com/client/TEHTVS1L6/C036JKD8NVA/thread/C03BG1MNQ4T-1673888660.823499

cryptowhizzard commented 1 year ago

Dear applicant,

Thank you for applying for datacap. As Filecoin FIL+ notary i am screening your application and conducting due diligence.

Looking at your application i have some questions: As you are brand new on Github and have no history of past applications it seems to me that applying for 5PB of datacap is a lot. One needs comprehensive knowledge of Filecoin, packing of data, distribution of data and all it's requirements coming with it. Are you brand new in the Filecoin space or have you applied for datacap in the past on different Github account names?

Can you show us visible proof of the size of your data and the storage systems you have there?

As last question i would like you to fill out this form to provide us with the necessary information to make a educated decision on your LDN request if we would like to support it.

Thanks!

linice commented 1 year ago

Hey @linice , if you still want to apply for datacap, you can ask notaries to do client due diligence in slack channel. https://app.slack.com/client/TEHTVS1L6/C036JKD8NVA/thread/C03BG1MNQ4T-1673888660.823499

Hi @Sunnyiscoming, I got it. Thank you!

mjroddy commented 1 year ago

This would be better suited towards regular deals I believe.

“Filecoin Plus is a program that aims to maximize the amount of useful storage that Filecoin can and will support.

The ultimate goal of Filecoin Plus is to accelerate the timeframe over which storage goods and services on Filecoin become more useful and attractive. The program plays an essential role in shaping the product offering on the network in collaboration with storage miners.”

igoovo commented 1 year ago

You can use your official domain name to filplus-app-review@fil.org Send email and copy to goovolvo@gmail.com To confirm your identity? The email name should include question ID # 1000.

linice commented 1 year ago

You can use your official domain name to filplus-app-review@fil.org Send email and copy to goovolvo@gmail.com To confirm your identity? The email name should include question ID # 1000. I have sent the email, please check it. 1000

igoovo commented 1 year ago

I received an email confirming that this is a real application.

igoovo commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacecj2ms6zh7lh277loz3yn5rhebhabpmn7hobvxigypkd244q52jh4

Address

f167x5eokj2rlemqwroakbudhezeqrziorokqypua

Datacap Allocated

100.00TiB

Signer Address

f1shnsfayxqll77svffaxnjenms7bbbysbqcatrpy

Id

e4922c71-2429-48fe-8750-5f33930e9446

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecj2ms6zh7lh277loz3yn5rhebhabpmn7hobvxigypkd244q52jh4

liyunzhi-666 commented 1 year ago

@linice Please send me a copy (patricckk886@gmail.com) and the attachment should contain the business license. Also please state again in the issue comments the miner ID you contacted and a sample of the data.

liyunzhi-666 commented 1 year ago

I received the email from the client and confirmed the relevant information.

liyunzhi-666 commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceaa7od573rkcseydssho6ozz4ospyga3ujomiyqmgclkg7ncrxszu

Address

f167x5eokj2rlemqwroakbudhezeqrziorokqypua

Datacap Allocated

100.00TiB

Signer Address

f1pszcrsciyixyuxxukkvtazcokexbn54amf7gvoq

Id

e4922c71-2429-48fe-8750-5f33930e9446

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceaa7od573rkcseydssho6ozz4ospyga3ujomiyqmgclkg7ncrxszu

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 2

Multisig Notary address

f02049625

Client address

f167x5eokj2rlemqwroakbudhezeqrziorokqypua

DataCap allocation requested

200TiB

Id

163b120e-7e03-4f67-a1c3-274b00cffbc1

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f02049625

Client address

f167x5eokj2rlemqwroakbudhezeqrziorokqypua

Rule to calculate the allocation request amount

100% of weekly dc amount requested

DataCap allocation requested

200TiB

Total DataCap granted for client so far

100TiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

4.90PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
1650 2 100TiB 73.82 5.39TiB
luobin544 commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceaqckfojzwhn4cojne2f4fafmf5zvlbhht3ahu7sfmggbruzq357q

Address

f167x5eokj2rlemqwroakbudhezeqrziorokqypua

Datacap Allocated

200.00TiB

Signer Address

f1tbd632f6w62glfaf7wjpimacbnjiz26poyoes2q

Id

163b120e-7e03-4f67-a1c3-274b00cffbc1

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceaqckfojzwhn4cojne2f4fafmf5zvlbhht3ahu7sfmggbruzq357q

mikezli commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

⚠️ All retrieval success ratios are below 1%.

Storage Provider Distribution

⚠️ 1 storage providers sealed more than 70% of total datacap - f02063867: 79.15%

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 3 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval report.

mikezli commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacedl5yung6ubinosnunhkelf2gqymzpyf3dwaf5gye3w4m3rmcsxy2

Address

f167x5eokj2rlemqwroakbudhezeqrziorokqypua

Datacap Allocated

200.00TiB

Signer Address

f1dnb3uz7sylxk6emti3ififcvu3nlufnnsjui6ea

Id

163b120e-7e03-4f67-a1c3-274b00cffbc1

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedl5yung6ubinosnunhkelf2gqymzpyf3dwaf5gye3w4m3rmcsxy2

mikezli commented 1 year ago

The customer contacted me, promising to increase the retrieval rate, and promised that there would be a better distribution plan. Considering that this is the second round of packaging for the customer, I will support them temporarily and I will keep an eye on it.

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 3

Multisig Notary address

f02049625

Client address

f167x5eokj2rlemqwroakbudhezeqrziorokqypua

DataCap allocation requested

400TiB

Id

bb35ceaa-0a9c-4ee0-95ff-4018163ef700

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f02049625

Client address

f167x5eokj2rlemqwroakbudhezeqrziorokqypua

Rule to calculate the allocation request amount

200% of weekly dc amount requested

DataCap allocation requested

400TiB

Total DataCap granted for client so far

181898.9YiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

181898.9YiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
3189 11 200TiB 38.04 49.40TiB
filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

⚠️ All retrieval success ratios are below 1%.

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 83.87% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval report.

Normalnoise commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

⚠️ All retrieval success ratios are below 1%.

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 81.22% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval report.

liyunzhi-666 commented 1 year ago

Why is the success rate for all searches below 1%?

linice commented 1 year ago

Why is the success rate for all searches below 1%?

There is really not much data to retrieve at the moment. The reason is that the failure is caused by the improper modification of the miner process code by the employee who performed the encapsulation operation. That it can't be retrieved.

Now, in the process of full recovery of organizational strength, searchability can be restored to a considerable state by one week at the latest.

Please wait patiently for some time, thank you for your understanding!

liyunzhi-666 commented 1 year ago

Before solving these disputes and the success rate of retrieval, I suggest to suspend this application and contact SP to solve the problem first.

igoovo commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 80.69% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval report.

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 80.37% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval report.

linice commented 1 year ago

Before solving these disputes and the success rate of retrieval, I suggest to suspend this application and contact SP to solve the problem first.

I contacted SP, and they are continuing to fix the failure. It's okay to see the effect now.

Request to continue with the packaging , thank you!

Normalnoise commented 1 year ago

⚠️ 81.22% of deals are for data replicated across less than 4 storage providers.

@linice can you explain this?

linice commented 1 year ago

⚠️ 81.22% of deals are for data replicated across less than 4 storage providers.

@linice can you explain this?

I have already responded to this question with SP, and they replied that this number will be reduced to the rule in the next round. Thank you!

Normalnoise commented 1 year ago

Hope to follow the Fil+ rule,willing to support in the round. I will keep my eyes on the next distribution

Normalnoise commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacec7afw4lykzcpcfyksruen7vtfzluatb5j5r44xrlwvygps2iilam

Address

f167x5eokj2rlemqwroakbudhezeqrziorokqypua

Datacap Allocated

400.00TiB

Signer Address

f1c5non5yf35avgcpsqvxu4yj54yyvxorwyjochqq

Id

bb35ceaa-0a9c-4ee0-95ff-4018163ef700

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacec7afw4lykzcpcfyksruen7vtfzluatb5j5r44xrlwvygps2iilam

Tom-OriginStorage commented 1 year ago

Other notaries have completed the investigation and are willing to support it

Tom-OriginStorage commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacedye4fdykas4dggcbclgfdxz5zyru35puy44tuou4iuw53vfvwyoy

Address

f167x5eokj2rlemqwroakbudhezeqrziorokqypua

Datacap Allocated

400.00TiB

Signer Address

f1q6bpjlqia6iemqbrdaxr2uehrhpvoju3qh4lpga

Id

bb35ceaa-0a9c-4ee0-95ff-4018163ef700

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedye4fdykas4dggcbclgfdxz5zyru35puy44tuou4iuw53vfvwyoy