Storify-LLC / Storify-Data-Pathway

0 stars 0 forks source link

[DataCap Application] <Xuet> #5

Open winter0707winter opened 3 months ago

winter0707winter commented 3 months ago

Version

1

DataCap Applicant

winter

Project ID

5

Data Owner Name

Xuet

Data Owner Country/Region

China

Data Owner Industry

Education & Training

Website

https://www.xuetian.cn/

Social Media Handle

https://www.xuetian.cn/

Social Media Type

Other

What is your role related to the dataset

Data Preparer

Total amount of DataCap being requested

15PiB

Expected size of single dataset (one copy)

950TiB

Number of replicas to store

10

Weekly allocation of DataCap requested

1000TiB

On-chain address for first allocation

f13ckbkkygufutsdlxwz5zzlupvqlnz5fwdreqqoa

Data Type of Application

Public, Open Commercial/Enterprise

Custom multisig

Identifier

No response

Share a brief history of your project and organization

Since its founding in 2010, Xuetian Education has become a multi-disciplinary, comprehensive and professional education platform enterprise integrating training and teaching, educational product development, and vocational skills training by virtue of its professional, leading and trustworthy teaching and training services. At present, it has opened more than 90 branches in Hangzhou, Beijing, Shanghai, Guangzhou, Shenzhen, Xi'an, Nanjing, Hefei, Zhengzhou, Shenyang, Jinan and other key cities across the country, serving hundreds of thousands of students every year, with a cumulative total of more than one million students, and tens of thousands of enterprises in various industries.

Is this project associated with other projects/ecosystem stakeholders?

No

If answered yes, what are the other projects/ecosystem stakeholders

No response

Describe the data being stored onto Filecoin

Mainly educational videos, training videos, etc.

Where was the data currently stored in this dataset sourced from

My Own Storage Infra

If you answered "Other" in the previous question, enter the details here

No response

If you are a data preparer. What is your location (Country/Region)

None

If you are a data preparer, how will the data be prepared? Please include tooling used and technical details?

No response

If you are not preparing the data, who will prepare the data? (Provide name and business)

No response

Has this dataset been stored on the Filecoin network before? If so, please explain and make the case why you would like to store this dataset again to the network. Provide details on preparation and/or SP distribution.

No response

Please share a sample of the data

https://www.xuetian.cn/open-class

Confirm that this is a public dataset that can be retrieved by anyone on the Network

If you chose not to confirm, what was the reason

No response

What is the expected retrieval frequency for this data

Sporadic

For how long do you plan to keep this dataset stored on Filecoin

1.5 to 2 years

In which geographies do you plan on making storage deals

Greater China, Asia other than Greater China, Africa, North America, South America, Europe, Australia (continent), Antarctica

How will you be distributing your data to storage providers

HTTP or FTP server, Shipping hard drives

How did you find your storage providers

Slack, Partners

If you answered "Others" in the previous question, what is the tool or platform you used

No response

Please list the provider IDs and location of the storage providers you will be working with.

f03000070
f03074583  
f03074586   
f03074587   
f03074589   
f03074592

How do you plan to make deals to your storage providers

Boost client, Lotus client

If you answered "Others/custom tool" in the previous question, enter the details here

No response

Can you confirm that you will follow the Fil+ guideline

Yes

datacap-bot[bot] commented 3 months ago

Application is waiting for allocator review

shizhigu commented 3 months ago

Thank you for opening this issue. Could you please provide more information to help us better understand the situation? Are you a data preparer? How will the data be prepared? Please include tooling used and technical details. Please disclose information on SP cooperation? Are the pledged coins sufficiently prepared? When do you plan to start storage?

winter0707winter commented 3 months ago

Dear official allocator, thanks for the review!

  1. As a deep filecoin enthusiast, I am very optimistic about the future development of IPFS, and I have been quite experienced in data preparation, mainly through the official filecoin tools boost and Lotus;
  2. the basic situation of the SPs we are currently communicating with is as follows, we will also try to contact more SPs f03074583 Tokyo Fly f03074589 HongKong Xing f03074586 HongKong Datastone f03074587 Seoul Hanku f03000070 China Honglian Tec f03074592 USA HKblockchain f03091739 USA lanxin
  3. The contacted SPs have committed to have at least 80% of the pledged coins ready and plan to start storing them in late June or early July.
ChrisDracula commented 3 months ago

Can you send a business license to my email for review?

chenzhuodd@sina.com

winter0707winter commented 3 months ago
image

Business license has been provided.

ChrisDracula commented 3 months ago
f98e80c33bc75e91bf254ca5da074c7

Check the past records, have a good storage experience, the first round is willing to support, can be issued according to the "good reputation and perfect history of the old customer" criteria, considering the total amount of applications is relatively large, the first round of the 512 TiB according to the amount issued.

datacap-bot[bot] commented 3 months ago

Datacap Request Trigger

Total DataCap requested

15PiB

Expected weekly DataCap usage rate

1000TiB

DataCap Amount - First Tranche

512TiB

Client address

f13ckbkkygufutsdlxwz5zzlupvqlnz5fwdreqqoa

datacap-bot[bot] commented 3 months ago

DataCap Allocation requested

Multisig Notary address

Client address

f13ckbkkygufutsdlxwz5zzlupvqlnz5fwdreqqoa

DataCap allocation requested

512TiB

Id

115b4005-c9de-41bc-829f-bb34f8869da6

datacap-bot[bot] commented 3 months ago

Application is ready to sign

datacap-bot[bot] commented 3 months ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacedxox6gxvwbr7xzpjmnu2urgucfgvgbs7jti43ij7tsll55oosll6

Address

f13ckbkkygufutsdlxwz5zzlupvqlnz5fwdreqqoa

Datacap Allocated

512TiB

Signer Address

f13a6ov3nrxllvyqkduwczpyashgu3luivodwyvgq

Id

115b4005-c9de-41bc-829f-bb34f8869da6

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedxox6gxvwbr7xzpjmnu2urgucfgvgbs7jti43ij7tsll55oosll6

datacap-bot[bot] commented 3 months ago

Application is Granted

datacap-bot[bot] commented 2 months ago

Client used 75% of the allocated DataCap. Consider allocating next tranche.

winter0707winter commented 2 months ago

checker:manualTrigger

datacap-bot[bot] commented 2 months ago

DataCap and CID Checker Report[^1]

No client address found for this issue.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

winter0707winter commented 2 months ago

checker:manualTrigger

datacap-bot[bot] commented 2 months ago

DataCap and CID Checker Report[^1]

No client address found for this issue.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

winter0707winter commented 2 months ago

Client used 75% of the allocated DataCap. Consider allocating next tranche.

The datacap-bot DC usage quota assignment push looks fine, but the checker:manualTrigger button doesn't seem to be recognized.That's fine, I'll submit a work order for the official team to handle. @willscott

winter0707winter commented 2 months ago

Hi @ChrisDracula Based on the past good storage experience and record, please support the second round of DC, is in communication with f03156617, f03091739, f03055005,f03148356,f03144037 and other SPs, you can pay attention to the follow-up report, we will be compliant.Thank you very much!

ChrisDracula commented 2 months ago

Based on a good history, I‘m willing to keep the trust going in new rounds, please follow the rules for data storage. Also, I would like to know @willscott how I can review the user's sealed data reports behind the scenes?

ChrisDracula commented 2 months ago

Given that a sufficient number of miners have been reached, we are willing to approve a second batch of 512TiB.

datacap-bot[bot] commented 2 months ago

Application is in Refill

datacap-bot[bot] commented 2 months ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceaxbu4zo2fq47kx3x4xm6fllsiof2h5t4klznbfnwigd2q7ohi4n4

Address

f13ckbkkygufutsdlxwz5zzlupvqlnz5fwdreqqoa

Datacap Allocated

512TiB

Signer Address

f13a6ov3nrxllvyqkduwczpyashgu3luivodwyvgq

Id

e122faa5-98e8-40db-92b3-9cfc3beaa5c5

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceaxbu4zo2fq47kx3x4xm6fllsiof2h5t4klznbfnwigd2q7ohi4n4

datacap-bot[bot] commented 2 months ago

Application is Granted

datacap-bot[bot] commented 2 months ago

Client used 75% of the allocated DataCap. Consider allocating next tranche.

ChrisDracula commented 2 months ago

checker:manualTrigger

datacap-bot[bot] commented 2 months ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

⚠️ 60.00% of Storage Providers have retrieval success rate equal to zero.

⚠️ The average retrieval success rate is 14.28%

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report.

ChrisDracula commented 2 months ago

Why is the Spark retrieval rate not successful enough?

winter0707winter commented 2 months ago

As we all know, we have always known that the community consensus search methods are GraphSync, Bitswap and Http, so we have been using the results of these three search methods as a sign of search success, until we learned at the notarized meeting that the newest search criterion is based on the retrieval results on Spark.

Some of our SPs have timely information access, some nodes have reached 27% and 89%, and some SPs are studying Spark search principles and adjusting their configurations to adapt to Spark search requirements.

Please continue to support, Spark retrieval success rate will continue to improve.

ChrisDracula commented 2 months ago

We are willing to support this signature, but please improve the retrieval rate.

datacap-bot[bot] commented 2 months ago

Application is in Refill

datacap-bot[bot] commented 2 months ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceb2auqvaim3omr2or3tzqvryntu6iw6pym3agakm33knnvz6tisks

Address

f13ckbkkygufutsdlxwz5zzlupvqlnz5fwdreqqoa

Datacap Allocated

1PiB

Signer Address

f13a6ov3nrxllvyqkduwczpyashgu3luivodwyvgq

Id

5e380056-e79c-4238-873b-58bc36eebcf2

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceb2auqvaim3omr2or3tzqvryntu6iw6pym3agakm33knnvz6tisks

datacap-bot[bot] commented 2 months ago

Application is Granted

datacap-bot[bot] commented 2 months ago

Client used 75% of the allocated DataCap. Consider allocating next tranche.

shizhigu commented 1 month ago

checker:manualTrigger

datacap-bot[bot] commented 1 month ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

⚠️ 40.00% of Storage Providers have retrieval success rate equal to zero.

⚠️ 70.00% of Storage Providers have retrieval success rate less than 75%.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

⚠️ CID sharing has been observed. (Top 3)

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report.

winter0707winter commented 2 weeks ago

We are currently in communication and collaboration with the following SPs:

f01106668 f0870558 f01315096 f03055018 f03055029 f01518369 f01889668 f03151449 f03151456 f03179555 f03179570 f03188440 f03190614 f03190616

shizhigu commented 2 weeks ago

checker:manualTrigger

datacap-bot[bot] commented 2 weeks ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

⚠️ 30.00% of Storage Providers have retrieval success rate equal to zero.

⚠️ 70.00% of Storage Providers have retrieval success rate less than 75%.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report.

shizhigu commented 2 weeks ago

Overall it looks like an improvement, can you elaborate on the reason why ⚠️ 30.00% of Storage Providers have retrieval success rate equal to zero?

winter0707winter commented 2 weeks ago

Dear Notary,we have had repeated communications with the SPs with a Spark retrieval rate of 0. They have informed us that adapting to the Spark model requires some adjustments and that they are currently on the Mid-Autumn Festival holiday in China. The technical staff from the SPs have assured us that they will gradually improve the Spark retrieval rate in the future. As indicated in the report, most of the SPs we are working with are making continuous progress. We appreciate your continued support. Thank you!

shizhigu commented 2 weeks ago

Given the positive historical performance, we will continue to support this round. However, if there is no improvement in the Spark retrieval rate in the future, I will consider implementing restrictions or suspending the Datacap distribution strategy.

datacap-bot[bot] commented 1 week ago

Application is in Refill

datacap-bot[bot] commented 1 week ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceah2cvwf2gzxfsxmvy52otgoyb67dagosfj3eoeizdimwapoiaw56

Address

f13ckbkkygufutsdlxwz5zzlupvqlnz5fwdreqqoa

Datacap Allocated

2PiB

Signer Address

f13a6ov3nrxllvyqkduwczpyashgu3luivodwyvgq

Id

4fe9e025-907f-4a4f-95cb-5b0188d8632e

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceah2cvwf2gzxfsxmvy52otgoyb67dagosfj3eoeizdimwapoiaw56

datacap-bot[bot] commented 1 week ago

Application is Granted

shizhigu commented 1 week ago

checker:manualTrigger

datacap-bot[bot] commented 1 week ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

⚠️ 20.00% of Storage Providers have retrieval success rate equal to zero.

⚠️ 80.00% of Storage Providers have retrieval success rate less than 75%.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report.

shizhigu commented 4 days ago

checker:manualTrigger

datacap-bot[bot] commented 4 days ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

⚠️ 8 storage providers sealed too much duplicate data - f03179570: 40.69%, f03178144: 49.64%, f03178077: 48.93%, f03055018: 49.72%, f03055029: 49.68%, f03151456: 40.44%, f03151449: 39.05%, f02013352: 49.13%

⚠️ 17.65% of Storage Providers have retrieval success rate equal to zero.

⚠️ 70.59% of Storage Providers have retrieval success rate less than 75%.

Deal Data Replication

⚠️ 25.50% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report.

shizhigu commented 16 hours ago

Why does the report seem to have worsened, please explain or I will be making further Datacap approval interventions.