search

filecoin-project / filecoin-plus-large-datasets

Hub for client applications for DataCap at a large scale
110 stars 62 forks source link

[DataCap Application] <TOPSCHOOLS> - <topschools> #1318

Closed 1613557499 closed 1 year ago

1613557499 commented 1 year ago

Large Dataset Notary Application

To apply for DataCap to onboard your dataset to Filecoin, please fill out the following.

Core Information

Please respond to the questions below by replacing the text saying "Please answer here". Include as much detail as you can in your answer.

Project details

Share a brief history of your project and organization.

TopSchools was founded on August 28, 2016.  As the resource aggregation platform of K12 international Education, TopSchools is committed to supporting the sustainable development of the international school market through community communication, data research, teacher training and talent recruitment.  Topschools is a close partner of international schools and international education institutions.  Provides industry with information on international education policies, operations, investments, schools, and people.  Organized various online and offline activities, cooperated with various examination bureaus, global top universities, research institutions, embassies and consulates, and provided services and support for more than 600 schools across the country;  We are linked to thousands of quality school service providers around the world to provide a variety of solutions for schools.

What is the primary source of funding for this project?

Our main sources of funding are education and training and product sales.

What other projects/ecosystem stakeholders is this project associated with?

There are no other stakeholders.

Use-case details

Describe the data being stored onto Filecoin

Our data is very large, mainly stored all kinds of courses of teaching videos, materials, documents.

Where was the data in this dataset sourced from?

The url of the company's website

Can you share a sample of the data? A link to a file, an image, a table, etc., are good ways to do this. 

[Please answer here.](http://www.topschools.cn/page263?article_id=3113)
[[Please answer here.](http://www.topschools.cn/online-training)](http://www.topschools.cn/page263?article_id=2801)

Confirm that this is a public dataset that can be retrieved by anyone on the Network (i.e., no specific permissions or access rights are required to view the data).

yes, Confirm that this is a public dataset that can be retrieved by anyone on the Network

What is the expected retrieval frequency for this data?

Not less than 2 times a year to search frequency

For how long do you plan to keep this dataset stored on Filecoin?

3-4 years or more

DataCap allocation plan

In which geographies (countries, regions) do you plan on making storage deals?

Asia, America and other regions. The goal is the global

How will you be distributing your data to storage providers? Is there an offline data transfer process?

Both online and offline hardware transfers are fine

How do you plan on choosing the storage providers with whom you will be making deals? This should include a plan to ensure the data is retrievable in the future both by you and others.

We plan to cooperate and negotiate with professionals to ensure the safety and reliability of data, and achieve short-term or long-term effective storage to ensure the integrity of data

How will you be distributing deals across storage providers?

We will allocate the data to the storage provider based on the type of data

Do you have the resources/funding to start making deals as soon as you receive DataCap? What support from the community would help you onboard onto Filecoin?

Please rest assured that we have certain resources/funds to start trading immediately after receiving DataCap, and we have a professional technical team to track the progress. We hope to get approval as soon as possible, thank you
large-datacap-requests[bot] commented 1 year ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

large-datacap-requests[bot] commented 1 year ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

large-datacap-requests[bot] commented 1 year ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

simonkim0515 commented 1 year ago

Datacap Request Trigger

Total DataCap requested

1PiB

Expected weekly DataCap usage rate

100TiB

Client address

f1y5g6uqp3xuep4gep25xa54ytmlum33rxjkurety

1613557499 commented 1 year ago

@raghavrmadya @Kevin-FF-USA Hello I can't find my private key need to replace the Client address, trouble to help f1y5g6uqp3xuep4gep25xa54ytmlum33rxjkurety thank you

newwebgroup commented 1 year ago

You can modify it directly in Github's application @1613557499

image
1613557499 commented 1 year ago

@newwebgroup May I ask if I have changed the client address, and then I directly ask a notary to sign and authorize it? Looking forward to your reply. Thank you

newwebgroup commented 1 year ago

Yes.

1613557499 commented 1 year ago

@simonkim0515 @raghavrmadya @Kevin-FF-USA @galen-mcandrew @newwebgroup Hello, I have changed the client address, which has been approved before. Now I need to wait for RKH's approval before starting the allocation process. Could you please help me deal with it? Thank you very much

galen-mcandrew commented 1 year ago

Original address: f1iz7b6oxi72s2j6f6xjkc7govrcwtko7lna2wjyq has used the Glif autoverifier for 32GiB of DataCap, but has not gotten any proposals/approvals here from LDN multisig.

Based on this, changing the address to the requested f1y5g6uqp3xuep4gep25xa54ytmlum33rxjkurety from the client.

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Multisig Notary address

f01858410

Client address

f1y5g6uqp3xuep4gep25xa54ytmlum33rxjkurety

DataCap allocation requested

50TiB

Id

132cd303-c521-493a-aa50-c06ad7aa4cdb

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report[^1]

There is no previous allocation for this issue.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

cryptowhizzard commented 1 year ago

Dear applicant,

Thank you for applying for datacap. As Filecoin FIL+ notary i am screening your application and conducting due diligence.

Can you show us visible proof of the size of your data and the storage systems you have there?

As last question i would like you to fill out this form to provide us with the necessary information to make a educated decision on your LDN request if we would like to support it.

Thanks!

1613557499 commented 1 year ago

Dear Notary public， @cryptowhizzard @simonkim0515 image image I have submitted and completed the KYC process, please help to check it as soon as possible. Thank you very much and look forward to your reply

cryptowhizzard commented 1 year ago

Hi there,

Thanks for submitting. Indeed it is well received.

As the form states ->

RULES: In order to be eligible for the Filecoin+ incentive program, which provides 10x the power (QAP) for storing data on the Filecoin network, there are certain rules that must be followed:

Data must be stored with multiple independent service providers, not just one organization running multiple SPs. Data must be distributed across multiple regions. Using a VPN to fake presence is not allowed. Data must be publicly retrievable for verification that it is being stored as claimed. It is highly recommended to run boost. Data must align with the mission of FIL+, meaning it must be valuable for humanity, whether scientific or unique in some other way. Data must be open and not encrypted. If you wish to encrypt your data, consider applying for the FIL-E program instead. Note: As a data preparer, you are allowed to store one copy yourself for redundancy at the request of the client. However, if your copy is stored in the USA, the other organizations/SPs must be outside your region. Dcent encourages applications with a minimum spread of 2 continents and 3 different organizations.

You confirmed just one SP and as described above we need more before we can sign off.

1613557499 commented 1 year ago

Dear Notary public， @cryptowhizzard f01543586 | HK | Asia f01386984 | CN | Asia f01398391 | CN | Asia Thank you for your reply. I am ready to communicate and cooperate with these sps. Thank you

herrehesse commented 1 year ago

@1613557499

How are you going to manage multiple regions/continents? Only Asia is not following the Filecoin+ program rules and guidelines.

Your statement:

In which geographies (countries, regions) do you plan on making storage deals? Asia, America and other regions. The goal is the global

1613557499 commented 1 year ago

Dear Notary public， @herrehesse Thank you very much for your reply First of all, I think there are some irregular users in Asia. I believe that stricter requirements for FIL+ ecological rectification will change the current chaotic situation and the ecological environment will become better and better. Secondly, I am new to FIL+ and need to learn a lot of knowledge. As far as I know, sps needs to be unique in each round of distribution, so I focused on the Asian region in the first round Thanks!

herrehesse commented 1 year ago

@1613557499 A good environment starts with yourself.

For the first round I am willing to support, but I will demand for the next round:

Show everyone how it is done! Good luck.

cryptowhizzard commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacedlapmfk5kyyzsxzqfgb7hhensmxvkl43i3e326vsd25ehra2out2

Address

f1y5g6uqp3xuep4gep25xa54ytmlum33rxjkurety

Datacap Allocated

50.00TiB

Signer Address

f1krmypm4uoxxf3g7okrwtrahlmpcph3y7rbqqgfa

Id

132cd303-c521-493a-aa50-c06ad7aa4cdb

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedlapmfk5kyyzsxzqfgb7hhensmxvkl43i3e326vsd25ehra2out2

Alex11801 commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacedttigtz26bb3iojahipnyz243d5srca5gt5x4ceyik7zbw25wt5c

Address

f1y5g6uqp3xuep4gep25xa54ytmlum33rxjkurety

Datacap Allocated

50.00TiB

Signer Address

f1hhippi64yiyhpjdtbidfyzma6irc2nuav7mrwmi

Id

132cd303-c521-493a-aa50-c06ad7aa4cdb

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedttigtz26bb3iojahipnyz243d5srca5gt5x4ceyik7zbw25wt5c

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 2

Multisig Notary address

f02049625

Client address

f1y5g6uqp3xuep4gep25xa54ytmlum33rxjkurety

DataCap allocation requested

100TiB

Id

4236783c-3450-4420-8e03-2777af68cab9

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f1y5g6uqp3xuep4gep25xa54ytmlum33rxjkurety

Rule to calculate the allocation request amount

100% of weekly dc amount requested

DataCap allocation requested

100TiB

Total DataCap granted for client so far

50TiB

Datacap to be granted to reach the total amount requested by the client (1 PiB)

974TiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
3 1 50TiB 100 40.62TiB
filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

⚠️ All retrieval success ratios are below 1%.

Storage Provider Distribution

⚠️ All storage providers are located in the same region.

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 3 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval report.

Aaron01230 commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

⚠️ All retrieval success ratios are below 1%.

Storage Provider Distribution

⚠️ All storage providers are located in the same region.

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 3 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval report.

Aaron01230 commented 1 year ago

the datacapstats.io shows :

image

but the report shows :

image

is that a bug? @@raghavrmadya @Kevin-FF-USA

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

⚠️ All retrieval success ratios are below 1%.

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 3 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval report.

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

⚠️ All retrieval success ratios are below 1%.

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 3 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval report.

1613557499 commented 1 year ago

The SP told us that this LDN is in the process of being sealed, and has issued more than 40 T, but the data displayed in the report is only 10 T , and the report data is still changing. We promise that the retrieval rate and data distribution will be normal after 3 days.

Aaron01230 commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 3 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval report.

ipollo00 commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 3 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval report.

ipollo00 commented 1 year ago

DD: Willing to support. Node retrieval success rate is increasing. Half the amount of data has two copies which is acceptable from my end since it is the first allocation. Will keep following up on whether data replication will increase in the next round.

ipollo00 commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacecozh2sfinyjvo23xdz7ncpveqk7r5rouywj5u53vx4v5wq6wip6u

Address

f1y5g6uqp3xuep4gep25xa54ytmlum33rxjkurety

Datacap Allocated

100.00TiB

Signer Address

f1n5wlrrhoxpkgwij25xrtt7w7g2k3fhbthmdn6ri

Id

4236783c-3450-4420-8e03-2777af68cab9

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecozh2sfinyjvo23xdz7ncpveqk7r5rouywj5u53vx4v5wq6wip6u

lyjmry commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 3 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval report.

1613557499 commented 1 year ago

@cryptowhizzard

Due to some problems on the fourth SP package program, but because the other three SP packages are too fast, the first round of credit is consumed. I'm now asking for the next round of credits to spread out even more. Thank you.

cryptowhizzard commented 1 year ago

Hi,

I have been trying to retrieve your data but i am getting errors on all requests. Can you take a look please and correct the problem?

root@proposals:~/Dropbox/download.sh.finished# Error: Failed to retrieve content with candidate miner f02231024: data transfer failed: datatransfer error: data transfer channel 12D3KooWGJpT1vdLktshKZRWrA3Apw1eKBxwjPfoJF64AtEwdKrq-12D3KooWPRTbSE5enfvRZHJWhhwUatUxM5968437T1rN8SMaLbK9-1689598265477892932 failed to transfer data: channel 12D3KooWGJpT1vdLktshKZRWrA3Apw1eKBxwjPfoJF64AtEwdKrq-12D3KooWPRTbSE5enfvRZHJWhhwUatUxM5968437T1rN8SMaLbK9-1689598265477892932: graphsync request failed to complete: skip Error: Failed to retrieve content with candidate miner f02231024: data transfer failed: datatransfer error: data transfer channel 12D3KooWGJpT1vdLktshKZRWrA3Apw1eKBxwjPfoJF64AtEwdKrq-12D3KooWPRTbSE5enfvRZHJWhhwUatUxM5968437T1rN8SMaLbK9-1689598265477926683 failed to transfer data: channel 12D3KooWGJpT1vdLktshKZRWrA3Apw1eKBxwjPfoJF64AtEwdKrq-12D3KooWPRTbSE5enfvRZHJWhhwUatUxM5968437T1rN8SMaLbK9-1689598265477926683: graphsync request failed to complete: expected link (bafykbzaceandlnhmd3lixbaovhitvjkb7el5zkh5o5uljwz7uyw75of6ztsie) at path does not match link sent by remote (bafk2bzaced3v7ksve2wrj6uc6mtxpn7ewadcs2f67omcohuzdwys2xp4hkvcw), possible malicious responder

cryptowhizzard commented 1 year ago

I managed to download something tonight, but the result is still not ok.

gocar x -f bafykbzaceasj6cbxw3vmmgq2322qahqnu63lrlwacxyect6cotwoztn3jufzu.car 2023/07/17 22:57:59 invalid header: malformed stream: invalid appearance of int token; expected start of map

Let me know when the problems are fixed. If i keep downloading it is only wasting your bandwidth.

1613557499 commented 1 year ago

I contacted the SP and checked that the retrieval was successful

微信图片_20230718101804 微信图片_20230718101814
woshidama323 commented 1 year ago

It seems that data is ok on SP side ， Please check again the network of SP and check this from another server again Will support this first

woshidama323 commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceafhmw72xf2ul27r3kr2rj2sg46dutts6ptpbqqoowo4rxaxxi3pk

Address

f1y5g6uqp3xuep4gep25xa54ytmlum33rxjkurety

Datacap Allocated

100.00TiB

Signer Address

f12tk3adljauwnd3hjbigpfxb7b7gdlj63p6afwtq

Id

4236783c-3450-4420-8e03-2777af68cab9

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceafhmw72xf2ul27r3kr2rj2sg46dutts6ptpbqqoowo4rxaxxi3pk

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 3 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval report.

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 3 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval report.

Aaron01230 commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 3 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 3

Multisig Notary address

f02049625

Client address

f1y5g6uqp3xuep4gep25xa54ytmlum33rxjkurety

DataCap allocation requested

200TiB

Id

c4364ee4-0fc2-4458-b0fe-6f2a11a5b682

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f02049625

Client address

f1y5g6uqp3xuep4gep25xa54ytmlum33rxjkurety

Rule to calculate the allocation request amount

200% of weekly dc amount requested

DataCap allocation requested

200TiB

Total DataCap granted for client so far

9094.9YiB

Datacap to be granted to reach the total amount requested by the client (1 PiB)

9094.9YiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
null null 100TiB null 17.37TiB