search

filecoin-project / filecoin-plus-large-datasets

Hub for client applications for DataCap at a large scale
110 stars 62 forks source link

[DataCap Application] <Xingchi-Media> - [ 2 / 10 ] #1052

Closed Xingchi-Media closed 1 year ago

Xingchi-Media commented 1 year ago

Large Dataset Notary Application

To apply for DataCap to onboard your dataset to Filecoin, please fill out the following.

Core Information

Please respond to the questions below by replacing the text saying "Please answer here". Include as much detail as you can in your answer.

Project details

Share a brief history of your project and organization.

Founded in 2013, it is a full process content production service company for program development and production. The core creative team has more than 10 years of experience in the industry, and has many in-depth project cooperation with Korean, British, American and other program producers. It provides content planning, model development, director, screenwriter, post production and other services for more than 30 domestic top variety shows every year. In 2019, the business income will exceed 200 million yuan, and the number of production personnel will exceed 200.
Founded in 2016, Xingchi College is a training and education institution for film and television post production professionals,
With rich post production experience, massive original program materials, and elaborate curriculum system design,
To provide students with a professional and practical film and television production education system,
At present, it has delivered more than 800 professional film and television production personnel to major satellite TV and TV program production companies.
image image image image

What is the primary source of funding for this project?

Own enterprise funds.

What other projects/ecosystem stakeholders is this project associated with?

No.

Use-case details

Describe the data being stored onto Filecoin

Dataset from
More than 200 TV variety shows produced by us since 2013.
Mainly various variety show video materials produced by us under commercial authorization.

Where was the data in this dataset sourced from?

More than 200 TV variety shows produced by us since 2013.
Including 115 cooperation projects with TV stations and 87 cooperation projects with network platforms
Including: variety show post production; Stage multimedia design; Logo design; Production of variety show special effects; Variety program title and ending design; Program packaging design materials, etc
image image image image image image image image image image image

Can you share a sample of the data? A link to a file, an image, a table, etc., are good ways to do this. 

Project Dataset
Data sets of 150 variety show projects completed by us since 2013。
https://docs.google.com/spreadsheets/d/1G22bmWv5rKlx83OQIIG2pcTJEnG2EUsFi28xZ1WQvnU/edit?usp=sharing

Confirm that this is a public dataset that can be retrieved by anyone on the Network (i.e., no specific permissions or access rights are required to view the data).

Yes, the dataset is open worldwide.

What is the expected retrieval frequency for this data?

Once a year, mainly for disaster recovery.

For how long do you plan to keep this dataset stored on Filecoin?

Want permanent storage.

DataCap allocation plan

In which geographies (countries, regions) do you plan on making storage deals?

There is no regional restriction.

How will you be distributing your data to storage providers? Is there an offline data transfer process?

Offline transmission
Because the dataset is very large, we only support offline transmission.

How do you plan on choosing the storage providers with whom you will be making deals? This should include a plan to ensure the data is retrievable in the future both by you and others.

The technical service providers we are currently communicating with are:
“New web group” 
“Chuangshi IPFS”
“SXX”
“Great heat”
“F3”
“FrogHub”
“Chain up Cloud”
“Tianji studio”
“FireflyHZ”
“Zhongshang Cloud”
“NDLabs”
“Proton Cloud”
“Waterdrop Cloud”

In addition, I also contacted Jack fan of BigD exchange, hoping to find more SPs through BDE to provide us with storage.
If any storage service provider wants to provide us with storage data, you can send an email to xingyuzhu@xcmedia.cn
Please attach your location, node number and the capacity you want to store.

How will you be distributing deals across storage providers?

No more than 5% of the total limit per SP.

Do you have the resources/funding to start making deals as soon as you receive DataCap? What support from the community would help you onboard onto Filecoin?

Yes, we already prepared enough funding for making deals.
In addition, the Filecoin Foundation will give us some help.
large-datacap-requests[bot] commented 1 year ago

Thanks for your request!

Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!
large-datacap-requests[bot] commented 1 year ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

large-datacap-requests[bot] commented 1 year ago

Thanks for your request!

Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!
large-datacap-requests[bot] commented 1 year ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

simonkim0515 commented 1 year ago

Datacap Request Trigger

Total DataCap requested

5PiB

Expected weekly DataCap usage rate

200TiB

Client address

f1iiri7wc44j4bq6crfaidoelosdplkpbuttt3flq

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Multisig Notary address

f02049625

Client address

f1iiri7wc44j4bq6crfaidoelosdplkpbuttt3flq

DataCap allocation requested

100TiB

Id

b9da854c-3544-4efa-9109-89655c6ee302

Tom-OriginStorage commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacebhv2rxx6fmxligwv6rhz64ulun3g5yovmorhqgx5z27nl2axkd7o

Address

f1iiri7wc44j4bq6crfaidoelosdplkpbuttt3flq

Datacap Allocated

100.00TiB

Signer Address

f1q6bpjlqia6iemqbrdaxr2uehrhpvoju3qh4lpga

Id

b9da854c-3544-4efa-9109-89655c6ee302

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebhv2rxx6fmxligwv6rhz64ulun3g5yovmorhqgx5z27nl2axkd7o

Normalnoise commented 1 year ago

https://github.com/filecoin-project/filecoin-plus-large-datasets/issues/1051#issuecomment-1508149600

DaYouGroup commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacebtykiafyu5bbmxsa27owbrjuzdbsrxfrwqdlsf5n3sxz6zri7rs2

Address

f1iiri7wc44j4bq6crfaidoelosdplkpbuttt3flq

Datacap Allocated

100.00TiB

Signer Address

f1nwjsd2mc6hu4qrwnmd6ukrfkuu4h5fhs7u3exii

Id

b9da854c-3544-4efa-9109-89655c6ee302

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebtykiafyu5bbmxsa27owbrjuzdbsrxfrwqdlsf5n3sxz6zri7rs2

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 2

Multisig Notary address

f02049625

Client address

f1iiri7wc44j4bq6crfaidoelosdplkpbuttt3flq

DataCap allocation requested

200TiB

Id

da89025c-1db3-467d-a82f-f0f91284c642

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f02049625

Client address

f1iiri7wc44j4bq6crfaidoelosdplkpbuttt3flq

Rule to calculate the allocation request amount

100% of weekly dc amount requested

DataCap allocation requested

200TiB

Total DataCap granted for client so far

100TiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

4.90PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
1401 1 100TiB 100 12.5TiB
Xingchi-Media commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

⚠️ 1 storage providers sealed more than 70% of total datacap - f01656666: 100.00%

⚠️ All storage providers are located in the same region.

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 3 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval report.

Xingchi-Media commented 1 year ago

Regarding the explanation of SP dispersion, Since the quota for DC was limited in the early stages, we only performed storage packaging on two nodes, and other SPs we are in contact with are on their way. We promise that we will certainly proceed according to the rules of Filecoin Plus, and soon new SPs will join.

The next round of SP will increase to at least 4

a1991car commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacebcwcziefy6qssae3xp52ujygjtptlwolyqi7zlh5khu76o3wpvhk

Address

f1iiri7wc44j4bq6crfaidoelosdplkpbuttt3flq

Datacap Allocated

200.00TiB

Signer Address

f1qnumecdypgrbaebtkdfjnwt5ndacadcuas3deiq

Id

da89025c-1db3-467d-a82f-f0f91284c642

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebcwcziefy6qssae3xp52ujygjtptlwolyqi7zlh5khu76o3wpvhk

a1991car commented 1 year ago

Retrieval looks good, temporarily supported

ipollo00 commented 1 year ago

https://github.com/filecoin-project/filecoin-plus-large-datasets/issues/1051#issuecomment-1617454124 Attached. Willing support.

ipollo00 commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceb66vp4z3gbcowap77pdblo363xcfigiy3z35wuehl3cmpcmhnofa

Address

f1iiri7wc44j4bq6crfaidoelosdplkpbuttt3flq

Datacap Allocated

200.00TiB

Signer Address

f1n5wlrrhoxpkgwij25xrtt7w7g2k3fhbthmdn6ri

Id

da89025c-1db3-467d-a82f-f0f91284c642

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceb66vp4z3gbcowap77pdblo363xcfigiy3z35wuehl3cmpcmhnofa

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 3

Multisig Notary address

f02049625

Client address

f1iiri7wc44j4bq6crfaidoelosdplkpbuttt3flq

DataCap allocation requested

400TiB

Id

43c3f13b-9707-4a88-8801-7d94b5597499

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f02049625

Client address

f1iiri7wc44j4bq6crfaidoelosdplkpbuttt3flq

Rule to calculate the allocation request amount

200% of weekly dc amount requested

DataCap allocation requested

400TiB

Total DataCap granted for client so far

181898.9YiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

181898.9YiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
2800 2 200TiB 50.04 37.5TiB
Xingchi-Media commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

⚠️ 1 storage providers sealed more than 50% of total datacap - f01656666: 54.49%

⚠️ All storage providers are located in the same region.

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval report.

Xingchi-Media commented 1 year ago

There is some delay in BOT data, and we are adding more SPs

Storage Provider Distribution ⚠️ 1 storage providers sealed more than 50% of total datacap - f01656666: 54.49%

⚠️ All storage providers are located in the same region.

Deal Data Replication ⚠️ 100.00% of deals are for data replicated across less than 4 storage providers.

image
OpenGate01 commented 1 year ago

Hope the later encapsulation can optimize the distribution ratio.

maxvint commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

⚠️ 1 storage providers sealed more than 50% of total datacap - f01656666: 54.49%

⚠️ All storage providers are located in the same region.

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval report.

maxvint commented 1 year ago

Retrieval looks good, distribution ratio and region should be improved in the next round, willing to support this round.

OpenGate01 commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacec2dcviopvl4mmtzdfdei2gcqqlniescccybh7ichmlixu72higyq

Address

f1iiri7wc44j4bq6crfaidoelosdplkpbuttt3flq

Datacap Allocated

400.00TiB

Signer Address

f1im4hmtbfzqnx7ir74kdaiu4ynjhgqh3sdi2snla

Id

43c3f13b-9707-4a88-8801-7d94b5597499

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacec2dcviopvl4mmtzdfdei2gcqqlniescccybh7ichmlixu72higyq

maxvint commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacecdtbimqsueqde3i5u5px3ux4kuomrfjio355dbvuhtjdilopr3p2

Address

f1iiri7wc44j4bq6crfaidoelosdplkpbuttt3flq

Datacap Allocated

400.00TiB

Signer Address

f1ui5iy4mmkxjbw7752omiwp2ols2fzv4thrayagi

Id

43c3f13b-9707-4a88-8801-7d94b5597499

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecdtbimqsueqde3i5u5px3ux4kuomrfjio355dbvuhtjdilopr3p2

cryptowhizzard commented 1 year ago

I would kindly ask other notary's to stop signing as I am opening a dispute for these LDN's.

See #1051

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 4

Multisig Notary address

f02049625

Client address

f1iiri7wc44j4bq6crfaidoelosdplkpbuttt3flq

DataCap allocation requested

800TiB

Id

798125e5-5fb2-4b00-ac53-29f9599f7ae8

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f02049625

Client address

f1iiri7wc44j4bq6crfaidoelosdplkpbuttt3flq

Rule to calculate the allocation request amount

400% of weekly dc amount requested

DataCap allocation requested

800TiB

Total DataCap granted for client so far

363797880709171445760.0YiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

363797880709171445760.0YiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
22400 7 400TiB 31.25 0B
Joss-Hua commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

⚠️ 1 storage providers sealed more than 30% of total datacap - f01656666: 32.36%

Deal Data Replication

⚠️ 66.60% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval report.

Joss-Hua commented 1 year ago

Same as #1051

Joss-Hua commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacebzwsmsx663tizkns6wjo4y2kizqhtla6ai3r6e7yiplgol62mvyg

Address

f1iiri7wc44j4bq6crfaidoelosdplkpbuttt3flq

Datacap Allocated

800.00TiB

Signer Address

f1tfg54zzscugttejv336vivknmsnzzmyudp3t7wi

Id

798125e5-5fb2-4b00-ac53-29f9599f7ae8

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebzwsmsx663tizkns6wjo4y2kizqhtla6ai3r6e7yiplgol62mvyg

NiwanDao commented 1 year ago

Please make sure you distribute more copies of the same data in the next round.

NiwanDao commented 1 year ago

Please make sure you distribute more copies of the same data in the next round.

NiwanDao commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceddgpkskhsb33eglpz6rtvhmm6fkhdgkejx5s6phjjw32ignmx2ya

Address

f1iiri7wc44j4bq6crfaidoelosdplkpbuttt3flq

Datacap Allocated

800.00TiB

Signer Address

f1a2lia2cwwekeubwo4nppt4v4vebxs2frozarz3q

Id

798125e5-5fb2-4b00-ac53-29f9599f7ae8

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceddgpkskhsb33eglpz6rtvhmm6fkhdgkejx5s6phjjw32ignmx2ya

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 5

Multisig Notary address

f02049625

Client address

f1iiri7wc44j4bq6crfaidoelosdplkpbuttt3flq

DataCap allocation requested

800TiB

Id

ef6a7083-b027-4e8b-978f-883847c16f75

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f02049625

Client address

f1iiri7wc44j4bq6crfaidoelosdplkpbuttt3flq

Rule to calculate the allocation request amount

400% of weekly dc amount requested

DataCap allocation requested

800TiB

Total DataCap granted for client so far

7.275957614183429e+35YiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

7.275957614183429e+35YiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
38701 7 800TiB 28.94 234.34TiB
Xingchi-Media commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 56.45% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

cryptowhizzard commented 1 year ago

Can you please fix your retrieval?

At this moment it is not working:

ERROR: offer error: retrieval query offer errored: failed to fetch piece to retrieve from: getting pieces for cid bafybeieklcn4fej75ktsubyw6sd3e6omwht53ggbpcdkcz55pike5hvjh4: getting pieces containing block bafybeieklcn4fej75ktsubyw6sd3e6omwht53ggbpcdkcz55pike5hvjh4: failed to lookup index for mh 12208a589bc2913feaa72a0716f487b279ccb1e7dd98c17886a167bd7a144e9ea93f, err: datastore: key not found

Xingchi-Media commented 1 year ago

Hey @cryptowhizzard We have communicated with the SP;

Recently encapsulated data is waiting to be repaired and rebuilt, The corresponding repair and reconstruction work is expected to be completed by the end of this week.

The earlier data from a week ago have been repaired and reconstructed, and all of them can support retrieval.

Xingchi-Media commented 1 year ago

https://github.com/filecoin-project/filecoin-plus-large-datasets/issues/1051#issuecomment-1654869370

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

Xingchi-Media commented 1 year ago

Hope to stay open.

igoovo commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 50.65% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.