search

filecoin-project / filecoin-plus-large-datasets

Hub for client applications for DataCap at a large scale
110 stars 62 forks source link

[DataCap Application] SXX Future Data - Web3 Publicity Media #1293

Open XindyTan opened 1 year ago

XindyTan commented 1 year ago

Large Dataset Notary Application

To apply for DataCap to onboard your dataset to Filecoin, please fill out the following.

Core Information

Please respond to the questions below by replacing the text saying "Please answer here". Include as much detail as you can in your answer.

Project details

Share a brief history of your project and organization.

Focusing on distributed big data storage, disaster data protection, encryption algorithm research, encrypted data product application and Web3.0 new-generation Internet research and development, SXX Future Data provides government enterprises and individual users with products and service system with data value as the core to meet the ever-expanding demand for mass data storage, management and application.

What is the primary source of funding for this project?

Income from customers and partners investment, the rest for business.

What other projects/ecosystem stakeholders is this project associated with?

NO other stakeholder.

Use-case details

SXX is committed to real data storage and has set up a professional Ipfs&Filecoin promotion working group with more than 10 people. We are always committed to preaching for filecoin in any way that promotes Ipfs&Filecoin. The data to be stored this time is the content translated into Chinese by SXX, such as official documents or video conferences posted by official PL or Filecoin foundations. And SXX promoters pushing a lot of new video information about Ipfs&Filecoin across the major platforms. We are active in wechat, Toutiao, Baidu, Bilibili, Twitter and other relevant platforms at home and abroad.

Where was the data in this dataset sourced from?

Video data related to preaching for Ipfs&Filecoin.

Can you share a sample of the data? A link to a file, an image, a table, etc., are good ways to do this. 

https://www.toutiao.com/video/7167228848751411746/?from_scene=all&log_from=50c52edfc39a6_1668930314250
https://www.toutiao.com/video/7090846231190209024/?from_scene=all&log_from=128f0efe046bb_1655881019973
https://www.toutiao.com/video/7148268348273328676/?from_scene=all&log_from=96c53e5c62b68_1664431023719
https://www.toutiao.com/video/7111241052958229027/?from_scene=all&log_from=d64c2cbdb839f_1655878988942
https://www.toutiao.com/video/7107164826572751394/?from_scene=all&log_from=cf13eff0aa9fc_1655881060060
https://www.toutiao.com/video/7110129720829837859/?from_scene=all&log_from=4be3683420a22_1655879022932
https://www.toutiao.com/video/7162019343570731535/?from_scene=all&log_from=e50b6a6001cbb_1668933872042
https://www.toutiao.com/video/7161716378322338344/?from_scene=all&log_from=8697a31ff5de1_1668933898244

Confirm that this is a public dataset that can be retrieved by anyone on the Network (i.e., no specific permissions or access rights are required to view the data).

Yes, our portfolio is open to users all over the world, and we hope that more people can appreciate our creations.

What is the expected retrieval frequency for this data?

About 10 more times per year, but this frequency depends on the later operation effect, and we will continue to work hard in this area.

For how long do you plan to keep this dataset stored on Filecoin?

Permanently stored.

DataCap allocation plan

In which geographies (countries, regions) do you plan on making storage deals?

Mainland China, Hong Kong, Singapore.

How will you be distributing your data to storage providers? Is there an offline data transfer process?

Use online download + offline disk mail for data transmission.

How do you plan on choosing the storage providers with whom you will be making deals? This should include a plan to ensure the data is retrievable in the future both by you and others.

1. choose reliable and highly reputable storage suppliers​.
2. Select a storage provider that can provide offline data transmission.
3.If SP can support fast retrieval, we will preferentially choose.

How will you be distributing deals across storage providers?

Average distribution.

Do you have the resources/funding to start making deals as soon as you receive DataCap? What support from the community would help you onboard onto Filecoin?

Our own company has sufficient project funds.
herrehesse commented 1 year ago

Can you share a distribution plan with me across SP's? Willing to support, as yesterday. You already sent me their names/locations. Thank you.

sxxfuture-official commented 1 year ago

It sounds good, I will split storage replicas evenly across regions

sxxfuture-official commented 1 year ago

Can you share a distribution plan with me across SP's? Willing to support, as yesterday. You already sent me their names/locations. Thank you.

@herrehesse are you forget? I sent it to you yesterday, and then you signed for me.

herrehesse commented 1 year ago

Yes you send it all, correct. Just no distribution plan, but we can see this on the coming CID report! Looking forward to it.

liyunzhi-666 commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the full report.

liyunzhi-666 commented 1 year ago

Hey , @sxxfuture-official I saw the results of the CID checker and everything looks good, I have two more questions.

sxxfuture-official commented 1 year ago

@liyunzhi-666 For the first question, Our plan for the next round of sealing is as follows(200T): f01986229 Hubei, China 50TiB f01986236 Califorlia, US 60TiB f01876488 Singapore 60TiB f01753456 Hong Kong 40TiB

For the second question, because we didn`t receive signature for a long time before yesterday, we used this time to transfer and format the data into a car, and the transfer method is to express mail to the storage server, future we will try online ways.

liyunzhi-666 commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaced46efhpx2zyqq5tshdncivfo6e65hqvnlnrmlwwcu5dasxyx4deo

Address

f1tmgsuko5ll2xq2zcxetgfu2kshegrfw67bbdzcq

Datacap Allocated

200.00TiB

Signer Address

f1pszcrsciyixyuxxukkvtazcokexbn54amf7gvoq

Id

7b8369c5-2dad-4cd8-8365-3e65312cbc2f

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaced46efhpx2zyqq5tshdncivfo6e65hqvnlnrmlwwcu5dasxyx4deo

cryptowhizzard commented 1 year ago

Hello,

Given that f01986236 is the only SP with a good standing reputation i will not sign this round.

sxxfuture-official commented 1 year ago

@cryptowhizzard I really confused! What things proved that other SP not good standing reputation....

cryptowhizzard commented 1 year ago

@sxxfuture-official

The fact they were involved in applications with abuse on Fil+.

sxxfuture-official commented 1 year ago

@cryptowhizzard
Which SP has violations in other LDNs? You can sync the information to me (Slack#Jintao - Sxxfuture), if I check it correctly, then I will adjust or terminate the storage plan of the SP.

cryptowhizzard commented 1 year ago

Hi @SXXFuture-Xindy

Below the output for just one of your Sp's.

It has been sealing in LDN f01940441 ->

Scherm­afbeelding 2023-02-21 om 09 50 35

https://github.com/filecoin-project/filecoin-plus-large-datasets/issues/638 That;s the reason it's flagged here.

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 4

Multisig Notary address

f01858410

Client address

f1tmgsuko5ll2xq2zcxetgfu2kshegrfw67bbdzcq

DataCap allocation requested

400TiB

Id

f2d26b53-6c48-4372-b4b7-ee4e3a5e1c7c

sxxfuture-official commented 1 year ago

@cryptowhizzard

https://filecoinproject.slack.com/archives/C01DLAPKDGX/p1677035621449349

As my community's point of view, it is really difficult to define this point. If SP does violate the rules, then what I can do is to adjust the SP participation plan. So at this stage, I hope you can provide me some good adjustment suggestions, on the other hand, please continue to support my project.

NDLABS-Leo commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 32.19% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the full report.

NDLABS-Leo commented 1 year ago

According to the audit standard of ND, the check bot shows good, and the node retrieval test is successful. Because the number of backups is an ongoing process, it can be explained. In addition, based on the reputation of sp, ND will be verified in the next round. If the subsequent check bot violates the rules, we will no longer support the storage of this LDN.

NDLABS-Leo commented 1 year ago
image
NDLABS-Leo commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacebn2uiu6dzsd4zuwbg5xrzanmtbddyltp7y6zvvwj3ayaezuwb3lc

Address

f1tmgsuko5ll2xq2zcxetgfu2kshegrfw67bbdzcq

Datacap Allocated

100.00TiB

Signer Address

f1yayfsv6whu3rheviucvventj3y6t542xfpb47ei

Id

677fe198-803d-4482-8cd2-2cad42c2597c

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebn2uiu6dzsd4zuwbg5xrzanmtbddyltp7y6zvvwj3ayaezuwb3lc

psh0691 commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceagof6h5ouisqnzhta5exry5yvu7kohnkf6zwv4gpupbtz4gvxppq

Address

f1tmgsuko5ll2xq2zcxetgfu2kshegrfw67bbdzcq

Datacap Allocated

100.00TiB

Signer Address

f1qdko4jg25vo35qmyvcrw4ak4fmuu3f5rif2kc7i

Id

f2d26b53-6c48-4372-b4b7-ee4e3a5e1c7c

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceagof6h5ouisqnzhta5exry5yvu7kohnkf6zwv4gpupbtz4gvxppq

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 5

Multisig Notary address

f01858410

Client address

f1tmgsuko5ll2xq2zcxetgfu2kshegrfw67bbdzcq

DataCap allocation requested

800TiB

Id

2e74e8f8-6f39-4c8f-a851-18a695cf0209

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f1tmgsuko5ll2xq2zcxetgfu2kshegrfw67bbdzcq

Last two approvers

psh0691 & not found

Rule to calculate the allocation request amount

800% of weekly dc amount requested

DataCap allocation requested

800TiB

Total DataCap granted for client so far

350TiB

Datacap to be granted to reach the total amount requested by the client (3.5PiB)

3.15PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
10740 8 400TiB 27.77 0B
filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 32.19% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the full report.

Joss-Hua commented 1 year ago
image
Joss-Hua commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacea3ang243dbdzjgxcwutlhgdinzcxh4pahgd3szyxsbwqao6r73oe

Address

f1tmgsuko5ll2xq2zcxetgfu2kshegrfw67bbdzcq

Datacap Allocated

800.00TiB

Signer Address

f1tfg54zzscugttejv336vivknmsnzzmyudp3t7wi

Id

2e74e8f8-6f39-4c8f-a851-18a695cf0209

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacea3ang243dbdzjgxcwutlhgdinzcxh4pahgd3szyxsbwqao6r73oe

Tom-OriginStorage commented 1 year ago
image
Tom-OriginStorage commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacedo576wcne6a4a4hg7hpqihz2ynqvorkla5ytfrigxmumi7j3x5ps

Address

f1tmgsuko5ll2xq2zcxetgfu2kshegrfw67bbdzcq

Datacap Allocated

800.00TiB

Signer Address

f1q6bpjlqia6iemqbrdaxr2uehrhpvoju3qh4lpga

Id

2e74e8f8-6f39-4c8f-a851-18a695cf0209

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedo576wcne6a4a4hg7hpqihz2ynqvorkla5ytfrigxmumi7j3x5ps

sxxfuture-official commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval report.

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

XindyTan commented 1 year ago

Currently, this LDN is being sealed.

sxxfuture-official commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

XindyTan commented 1 year ago

Hey @fabriziogianni7 @kevzak @simonkim0515 @Kevin-FF-USA, There is only 44T left in the last round, but the but the robot has never triggered the next round of DC yet. As far as I know, it has been few months. image The robot is not triggered, and the notary cannot find the bot in the background and cannot sign it. Can someone help fix this problem? We need the quota urgently. When can you guys fix it? Please fix it as soon as possible, thank you!

huseyincansoylu commented 1 year ago

@XindyTan hey this issue was missing one label for triggering new alloaction , I added. Now the bot should trigger new one. I will be watching this issue to help you on this.

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 6

Multisig Notary address

f02049625

Client address

f1tmgsuko5ll2xq2zcxetgfu2kshegrfw67bbdzcq

DataCap allocation requested

400TiB

Id

627da4a2-e234-4a35-b9f6-ddbc1d3a5817

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f1tmgsuko5ll2xq2zcxetgfu2kshegrfw67bbdzcq

Rule to calculate the allocation request amount

400% of weekly dc amount requested

DataCap allocation requested

400TiB

Total DataCap granted for client so far

7.275957614183427e+49YiB

Datacap to be granted to reach the total amount requested by the client (3.5PiB)

7.275957614183427e+49YiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
40322 16 800TiB 21.05 43.90TiB
1ane-1 commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

1ane-1 commented 1 year ago

The report shows everything goes well. Support!

1ane-1 commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacebrqzuydvztz3kridndhupaoiiydpecaihoypaqv5lq4xiqk5a6hi

Address

f1tmgsuko5ll2xq2zcxetgfu2kshegrfw67bbdzcq

Datacap Allocated

400.00TiB

Signer Address

f1mdk7s2vntzm6hu35yuo6vjubtrpfnb2awhgvrri

Id

627da4a2-e234-4a35-b9f6-ddbc1d3a5817

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebrqzuydvztz3kridndhupaoiiydpecaihoypaqv5lq4xiqk5a6hi

maxvint commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacea6udktsx2scmc7d36kpdlcpxn2q7f7fofqcnum4nw47y5afa3coq

Address

f1tmgsuko5ll2xq2zcxetgfu2kshegrfw67bbdzcq

Datacap Allocated

400.00TiB

Signer Address

f1ui5iy4mmkxjbw7752omiwp2ols2fzv4thrayagi

Id

627da4a2-e234-4a35-b9f6-ddbc1d3a5817

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacea6udktsx2scmc7d36kpdlcpxn2q7f7fofqcnum4nw47y5afa3coq

sxxfuture-official commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

sxxfuture-official commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

XindyTan commented 1 year ago

under sealing