search

filecoin-project / filecoin-plus-large-datasets

Hub for client applications for DataCap at a large scale
110 stars 62 forks source link

[DataCap Application] <Xingchi-Media> - [ 1 / 10 ] #1051

Closed Xingchi-Media closed 1 year ago

Xingchi-Media commented 2 years ago

Large Dataset Notary Application

To apply for DataCap to onboard your dataset to Filecoin, please fill out the following.

Core Information

Please respond to the questions below by replacing the text saying "Please answer here". Include as much detail as you can in your answer.

Project details

Share a brief history of your project and organization.

Founded in 2013, it is a full process content production service company for program development and production. The core creative team has more than 10 years of experience in the industry, and has many in-depth project cooperation with Korean, British, American and other program producers. It provides content planning, model development, director, screenwriter, post production and other services for more than 30 domestic top variety shows every year. In 2019, the business income will exceed 200 million yuan, and the number of production personnel will exceed 200.
Founded in 2016, Xingchi College is a training and education institution for film and television post production professionals,
With rich post production experience, massive original program materials, and elaborate curriculum system design,
To provide students with a professional and practical film and television production education system,
At present, it has delivered more than 800 professional film and television production personnel to major satellite TV and TV program production companies.
image image image image

What is the primary source of funding for this project?

Own enterprise funds.

What other projects/ecosystem stakeholders is this project associated with?

No.

Use-case details

Describe the data being stored onto Filecoin

Dataset from
More than 200 TV variety shows produced by us since 2013.
Mainly various variety show video materials produced by us under commercial authorization.

Where was the data in this dataset sourced from?

More than 200 TV variety shows produced by us since 2013.
Including 115 cooperation projects with TV stations and 87 cooperation projects with network platforms
Including: variety show post production; Stage multimedia design; Logo design; Production of variety show special effects; Variety program title and ending design; Program packaging design materials, etc
image image image image image image image image image image image

Can you share a sample of the data? A link to a file, an image, a table, etc., are good ways to do this. 

Project Dataset
Data sets of 150 variety show projects completed by us since 2013。
https://docs.google.com/spreadsheets/d/1G22bmWv5rKlx83OQIIG2pcTJEnG2EUsFi28xZ1WQvnU/edit?usp=sharing

Confirm that this is a public dataset that can be retrieved by anyone on the Network (i.e., no specific permissions or access rights are required to view the data).

Yes, the dataset is open worldwide.

What is the expected retrieval frequency for this data?

Once a year, mainly for disaster recovery.

For how long do you plan to keep this dataset stored on Filecoin?

Want permanent storage.

DataCap allocation plan

In which geographies (countries, regions) do you plan on making storage deals?

There is no regional restriction.

How will you be distributing your data to storage providers? Is there an offline data transfer process?

Offline transmission
Because the dataset is very large, we only support offline transmission.

How do you plan on choosing the storage providers with whom you will be making deals? This should include a plan to ensure the data is retrievable in the future both by you and others.

The technical service providers we are currently communicating with are:
“New web group” 
“Chuangshi IPFS”
“SXX”
“Great heat”
“F3”
“FrogHub”
“Chain up Cloud”
“Zhongshang Cloud”
“NDLabs”
“Proton Cloud”
“Waterdrop Cloud”
“Zhongheyi”
“Lucky Technology”
“Jiu Zhou Cloud”
“Time-space technology”
“ChengXin Cloud”
“HuiCun IPFS”

In addition, I also contacted Jack fan of BigD exchange, hoping to find more SPs through BDE to provide us with storage.
If any storage service provider wants to provide us with storage data, you can send an email to xingyuzhu@xcmedia.cn
Please attach your location, node number and the capacity you want to store.

How will you be distributing deals across storage providers?

No more than 5% of the total limit per SP.

Do you have the resources/funding to start making deals as soon as you receive DataCap? What support from the community would help you onboard onto Filecoin?

Yes, we already prepared enough funding for making deals.
In addition, the Filecoin Foundation will give us some help.
Xingchi-Media commented 1 year ago

Thank you for your reply. @Carohere The other two idle SPs will join in the next round In China, people will use email less frequently. I will contact SP and ask them to check the mailbox and reply.

Xingchi-Media commented 1 year ago

Dear Notary Public， @Carohere The SP that provided the mailbox contact information checked the mailbox and confirmed that it did not receive your mail (including checking the junk mailbox). Slack's SP also confirmed that it did not receive your information.

Can you contact again for confirmation?

Carohere commented 1 year ago

Two of them are on slack and I tried to reach out to one on Feb 1st, but five days later, still haven't received a full response...

I meant slack. For such a huge project, i expect sps to cooperate better than this. It doesn't seem they're ready or care enough. Btw I'm SLA1 notary, I don't have weeks to wait for a response... good luck finding other notaries.

image

cryptowhizzard commented 1 year ago

Discarded --

Request Proposed Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacedqiwn4gqrrdkvpcz2h2kbvzovgzedzlzhvh2b3dbulk3hmfzf4pa

Address

f1vnfbc3siofrens2inl66gjzevqrto5wlsray6gy

Datacap Allocated

100.00TiB

Signer Address

f1krmypm4uoxxf3g7okrwtrahlmpcph3y7rbqqgfa

Id

46c695bd-a721-47d6-b70d-72507ce28287

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedqiwn4gqrrdkvpcz2h2kbvzovgzedzlzhvh2b3dbulk3hmfzf4pa

large-datacap-requests[bot] commented 1 year ago

Looks like the bot was not able to retrieve the transaction on the lotus node. Please contact governance team. The message cid: bafy2bzacedqiwn4gqrrdkvpcz2h2kbvzovgzedzlzhvh2b3dbulk3hmfzf4pa

Please, contact the governance team.
large-datacap-requests[bot] commented 1 year ago

Looks like the bot was not able to retrieve the transaction on the lotus node. Please contact governance team. The message cid: bafy2bzacedqiwn4gqrrdkvpcz2h2kbvzovgzedzlzhvh2b3dbulk3hmfzf4pa

Please, contact the governance team.
filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report[^1]

No application info found for this issue on https://filplus.d.interplanetary.one/clients.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

Tom-OriginStorage commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacecjof3jxc4jkfv7jocyuskkozeqizv53tc7oidrpiz4g6botqj4pe

Address

f1vnfbc3siofrens2inl66gjzevqrto5wlsray6gy

Datacap Allocated

100.00TiB

Signer Address

f1q6bpjlqia6iemqbrdaxr2uehrhpvoju3qh4lpga

Id

46c695bd-a721-47d6-b70d-72507ce28287

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecjof3jxc4jkfv7jocyuskkozeqizv53tc7oidrpiz4g6botqj4pe

Normalnoise commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report[^1]

No application info found for this issue on https://filplus.d.interplanetary.one/clients.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

Normalnoise commented 1 year ago

There are so many dd for the application, I hope you @Xingchi-Media can send deals to the SPs who are support fast retrieval, in the first round, I am willing to support it.

DaYouGroup commented 1 year ago

The client contacted us and through an evaluation of previous records, we were willing to support.

DaYouGroup commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaced3c2rauco4mnzq4fzkp7n3kwnc6nty5m3kwi5r2a7v3yqvmlh45m

Address

f1vnfbc3siofrens2inl66gjzevqrto5wlsray6gy

Datacap Allocated

100.00TiB

Signer Address

f1nwjsd2mc6hu4qrwnmd6ukrfkuu4h5fhs7u3exii

Id

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaced3c2rauco4mnzq4fzkp7n3kwnc6nty5m3kwi5r2a7v3yqvmlh45m

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report[^1]

No application info found for this issue on https://filplus.d.interplanetary.one/clients.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

Xingchi-Media commented 1 year ago

Thanks, @DaYouGroup @Tom-OriginStorage we are in the process of copying the data to SP. Loading of data to Filecoin is expected to start within a week

kevzak commented 1 year ago

@Xingchi-Media if possible please change the client address in the top section. This is the same address being used as in 1059 and will cause problems with the bot assigning allocations. It already has actually.

Xingchi-Media commented 1 year ago

Thanks for the reminder that 1051 and 1059 are two different addresses @kevzak

Xingchi-Media commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report[^1]

No active deals found for this client.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

sxxfuture-official commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacedp2gtsy5brdh3rlgjcfxbkxioeqzcklchjxjufmzt3bwxqyasoay

Address

f1vnfbc3siofrens2inl66gjzevqrto5wlsray6gy

Datacap Allocated

100.00TiB

Signer Address

f1foiomqlmoshpuxm6aie4xysffqezkjnokgwcecq

Id

46c695bd-a721-47d6-b70d-72507ce28287

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedp2gtsy5brdh3rlgjcfxbkxioeqzcklchjxjufmzt3bwxqyasoay

Xingchi-Media commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report[^1]

No active deals found for this client.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

Xingchi-Media commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

⚠️ All retrieval success ratios are below 1%.

Storage Provider Distribution

⚠️ 1 storage providers sealed more than 90% of total datacap - f01777777: 100.00%

⚠️ All storage providers are located in the same region.

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 2 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval report.

Xingchi-Media commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

⚠️ All retrieval success ratios are below 1%.

Storage Provider Distribution

⚠️ 1 storage providers sealed more than 90% of total datacap - f01777777: 100.00%

⚠️ All storage providers are located in the same region.

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 2 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval report.

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 3

Multisig Notary address

f02049625

Client address

f1vnfbc3siofrens2inl66gjzevqrto5wlsray6gy

DataCap allocation requested

400TiB

Id

45616ed4-01ec-4fe0-9968-7c8a1122beb0

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f02049625

Client address

f1vnfbc3siofrens2inl66gjzevqrto5wlsray6gy

Rule to calculate the allocation request amount

200% of weekly dc amount requested

DataCap allocation requested

400TiB

Total DataCap granted for client so far

90949.5YiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

90949.5YiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
4520 2 100TiB 99.78 15TiB
Xingchi-Media commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

⚠️ All retrieval success ratios are below 1%.

Storage Provider Distribution

⚠️ 1 storage providers sealed more than 70% of total datacap - f01656666: 99.72%

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 3 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval report.

Xingchi-Media commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

⚠️ All retrieval success ratios are below 1%.

Storage Provider Distribution

⚠️ 1 storage providers sealed more than 70% of total datacap - f01656666: 99.92%

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 3 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval report.

Xingchi-Media commented 1 year ago

Dear Notary and RG, @raghavrmadya We have encountered some obstacles in finding the notary's signature, I hope the clarification of some abnormal issues will help us move forward to the next step.

Regarding the issue of retrieval being 1%, Because the sectors have only recently been sealed, the BOT's database has not updated the data yet. We have inquired with Xinan XU, this situation is normal and we need to wait a few days for the BOT to have data.

We require all our partner SPs to store the Unseal file and support retrieval. For now, the notary can retrieve normally through the command line './lotus client retrieve --provider......' using the Payload CID that can be found at https://filecoin.tools/f01982219.

All retrieval success ratios are below 1%.

Overall Graphsync retrieval success rate: Overall HTTP retrieval success rate: 0.00% Overall Bitswap retrieval success rate: 0.00%

Regarding the explanation of SP dispersion, Since the quota for DC was limited in the early stages, we only performed storage packaging on one node, and other SPs we are in contact with are on their way. We promise that we will certainly proceed according to the rules of Filecoin Plus, and soon new SPs will join.

Storage Provider Distribution ⚠️ 1 storage providers sealed more than 70% of total datacap - f01656666: 99.92%

Deal Data Replication ⚠️ 100.00% of deals are for data replicated across less than 3 storage providers.

Tom-OriginStorage commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

⚠️ 1 storage providers sealed more than 70% of total datacap - f01656666: 99.95%

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 3 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval report.

Xingchi-Media commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

⚠️ 1 storage providers sealed more than 70% of total datacap - f01656666: 99.95%

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 3 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval report.

Xingchi-Media commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

⚠️ 1 storage providers sealed more than 70% of total datacap - f01656666: 99.95%

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 3 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval report.

Xingchi-Media commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

⚠️ 1 storage providers sealed more than 70% of total datacap - f01656666: 99.95%

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 3 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval report.

ipollo00 commented 1 year ago

Regarding the explanation of SP dispersion, Since the quota for DC was limited in the early stages, we only performed storage packaging on one node, and other SPs we are in contact with are on their way. We promise that we will certainly proceed according to the rules of Filecoin Plus, and soon new SPs will join. How many sps you have connected with? Will there be at least four sps for the next allocation? Which region will be? @Xingchi-Media

Xingchi-Media commented 1 year ago

Dear Notary, @ipollo00 Thank you for replying to us. Many thanks. Yes, SP will increase to 4 in the next round, and there will be more in the future. Two of the SPs are located in Singapore, Two SPs are located in Guangdong Province, China

In addition, regarding Retrieval Statistics, we are also making more adjustments and improvements to SP. However, due to the delay in the data acquisition of the BOT, it has not seen much improvement. But in fact, SP store the Unseal of all Car files, and all files will support retrieval.

We are also communicating with SP to support Http retrieval. They said that they will deploy programs that support Http later.

Overall Graphsync retrieval success rate: 6.06% Overall HTTP retrieval success rate: 0.00% Overall Bitswap retrieval success rate: 0.00%

⚠️ All retrieval success ratios are below 1%. Overall Graphsync retrieval success rate: Overall HTTP retrieval success rate: Overall Bitswap retrieval success rate:

SuperChaiChai commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacec726nbf3nm6e2br5xgqumi7ab6gxdsdrj2qw7cqldiaonxzradqo

Address

f1vnfbc3siofrens2inl66gjzevqrto5wlsray6gy

Datacap Allocated

400.00TiB

Signer Address

f12mckci3omexgzoeosjvstcfxfe4vqw7owdia3da

Id

45616ed4-01ec-4fe0-9968-7c8a1122beb0

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacec726nbf3nm6e2br5xgqumi7ab6gxdsdrj2qw7cqldiaonxzradqo

Xingchi-Media commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

⚠️ 1 storage providers sealed more than 70% of total datacap - f01656666: 99.95%

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 3 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval report.

ipollo00 commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceb5niluqt23g7fum4zbtd6tsnrcx22heo2x4436nr2t7ppr32uko6

Address

f1vnfbc3siofrens2inl66gjzevqrto5wlsray6gy

Datacap Allocated

400.00TiB

Signer Address

f1n5wlrrhoxpkgwij25xrtt7w7g2k3fhbthmdn6ri

Id

45616ed4-01ec-4fe0-9968-7c8a1122beb0

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceb5niluqt23g7fum4zbtd6tsnrcx22heo2x4436nr2t7ppr32uko6

cryptowhizzard commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

⚠️ 1 storage providers sealed more than 70% of total datacap - f01656666: 83.61%

Deal Data Replication

⚠️ 79.86% of deals are for data replicated across less than 3 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval report.

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 4

Multisig Notary address

f02049625

Client address

f1vnfbc3siofrens2inl66gjzevqrto5wlsray6gy

DataCap allocation requested

800TiB

Id

4f681229-ba56-4856-9733-e5400e5a151d