filecoin-project / filecoin-plus-large-datasets

Hub for client applications for DataCap at a large scale
109 stars 62 forks source link

Niwan Dao / CabrinaHuang - ChiSheng Digital Human #2140

Open NiwanDao opened 11 months ago

NiwanDao commented 11 months ago

Data Owner Name

ChiSheng Digital Human

What is your role related to the dataset

Data onramp entity that provides data onboarding services to multiple clients

Data Owner Country/Region

China

Data Owner Industry

IT & Technology Services

Website

https://www.anyimeta.com/

Social Media

https://dstorage.cabrina.xyz/

Total amount of DataCap being requested

15PiB

Expected size of single dataset (one copy)

1P

Number of replicas to store

10

Weekly allocation of DataCap requested

500TiB

On-chain address for first allocation

f1tuf6hs6jjigjodjiir5dxbn7rxjn6kaavjatura

Data Type of Application

Public, Open Commercial/Enterprise

Custom multisig

Identifier

No response

Share a brief history of your project and organization

As an active participant in the Slingshot project since 2021, I have gained extensive experience and knowledge every single point in the flow of data preparation, deal-making, deal sealing and retrieval. Throughout my involvement, I have established fruitful relationships with fellow community members and successfully conducted numerous deal-making, primarily focused on open-source scientific data, with over 100 SPs globally.

By combining the mission of Filecoin to store humanity's most important data with the rapid advancements in the era of artificial intelligence, I have engaged with and explored various companies in the AIGC domain over the past few months. Based on my comprehensive research, I firmly believe that storing the vast amounts of data generated by artificial intelligence on a decentralized network is an inevitable choice.

To demonstrate compliance with the FIL Plus rules, I have showcased the datasets and SP partners I previously onboarded on the website https://dstorage.cabrina.xyz/, as a gesture of respect towards the regulations and guidelines imposed.

Is this project associated with other projects/ecosystem stakeholders?

No

If answered yes, what are the other projects/ecosystem stakeholders

No response

Describe the data being stored onto Filecoin

ChiSheng Digital human is an industry leading AIGC Digital Human Incubation Platform based in China. It creates engaging videos with AI-powered digital human. It provides human digital cloning service: simply shooting the model in front of green canvas studio and using the AI model, the model's meta human will create in hours. Video Generation Service: Simply type in your text and choose digital human and voice to create a professional video in minutes. 

ChiSheng Digital human will onboard the AI generated video and relative materials including pictures, video, text, and audio  in Filecoin.

Where was the data currently stored in this dataset sourced from

My Own Storage Infra

If you answered "Other" in the previous question, enter the details here

No response

If you are a data preparer. What is your location (City and Country)

Sichuan, China

If you are a data preparer, how will the data be prepared? Please include tooling used and technical details?

I will use Singularity to generate the CAR file. Additionally, I have developed my own software that incorporates features such as SP partner communication for deal agreement, deal distribution, deal status tracking, and deal-resend mechanism to ensure compliance with the FilPlus rule requirements.

If you are not preparing the data, who will prepare the data? (Provide name and business)

No response

Has this dataset been stored on the Filecoin network before? If so, please explain and make the case why you would like to store this dataset again to the network. Provide details on preparation and/or SP distribution.

This is the first time.

Please share a sample of the data

https://drive.google.com/file/d/1xpOitdo5rqHal1kgcNPf60WeDXN8_Ut0/view?usp=drive_link

I put a few video generated by ChiSheng Platform as sample.

Confirm that this is a public dataset that can be retrieved by anyone on the Network

If you chose not to confirm, what was the reason

No response

What is the expected retrieval frequency for this data

Monthly

For how long do you plan to keep this dataset stored on Filecoin

1 to 1.5 years

In which geographies do you plan on making storage deals

Greater China, Asia other than Greater China, North America

How will you be distributing your data to storage providers

HTTP or FTP server, Shipping hard drives

How do you plan to choose storage providers

Big Data Exchange, Partners

If you answered "Others" in the previous question, what is the tool or platform you plan to use

No response

If you already have a list of storage providers to work with, fill out their names and provider IDs below

I work with SP including but not limited to FL cloud, GreaterHeat, Ciic, Kinx. xingjiliangzi, Mayi,  

The partner I previously worked with are listed in https://dstorage.cabrina.xyz/sp/

How do you plan to make deals to your storage providers

Boost client

If you answered "Others/custom tool" in the previous question, enter the details here

No response

Can you confirm that you will follow the Fil+ guideline

Yes

large-datacap-requests[bot] commented 9 months ago

DataCap Allocation requested

Request number 5

Multisig Notary address

f02049625

Client address

f1tuf6hs6jjigjodjiir5dxbn7rxjn6kaavjatura

DataCap allocation requested

1.95PiB

Id

6c92777b-dd82-4755-8bf1-3614c5d38447

zcfil commented 9 months ago

checker:manualTrigger

laurarenpanda commented 9 months ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceah2254xgrhuyzyd7sx63wunxn6rudpd3devecrypqtw42jxthtya

Address

f1tuf6hs6jjigjodjiir5dxbn7rxjn6kaavjatura

Datacap Allocated

1.95PiB

Signer Address

f1bp3tzp536edm7dodldceekzbsx7zcy7hdfg6uzq

Id

6c92777b-dd82-4755-8bf1-3614c5d38447

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceah2254xgrhuyzyd7sx63wunxn6rudpd3devecrypqtw42jxthtya

filplus-checker-app[bot] commented 9 months ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

zcfil commented 9 months ago

Looking good, willing to support this round

zcfil commented 9 months ago

image Some SP retrieval rate is low, please contact to fix it

zcfil commented 9 months ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacecpvmintvx3o6nzhyisrnait7gxvtnitg5nsxioermx65fa4diryq

Address

f1tuf6hs6jjigjodjiir5dxbn7rxjn6kaavjatura

Datacap Allocated

1.95PiB

Signer Address

f1cjzbiy5xd4ehera4wmbz63pd5ku4oo7g52cldga

Id

6c92777b-dd82-4755-8bf1-3614c5d38447

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecpvmintvx3o6nzhyisrnait7gxvtnitg5nsxioermx65fa4diryq

large-datacap-requests[bot] commented 8 months ago

DataCap Allocation requested

Request number 6

Multisig Notary address

f02049625

Client address

f1tuf6hs6jjigjodjiir5dxbn7rxjn6kaavjatura

DataCap allocation requested

1.95PiB

Id

6ae79f33-2d81-4bdf-a589-26102cfd340e

1ane-1 commented 8 months ago

checker:manualTrigger

filplus-checker-app[bot] commented 8 months ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 30.21% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard.

1ane-1 commented 8 months ago

image Please pay attention to the data deal problem. Support for this round.

1ane-1 commented 8 months ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacea2k6vcrsdakmm37szz6kmavkovvmpqq6iy36njjewq3klkbh2qyu

Address

f1tuf6hs6jjigjodjiir5dxbn7rxjn6kaavjatura

Datacap Allocated

1.95PiB

Signer Address

f1mdk7s2vntzm6hu35yuo6vjubtrpfnb2awhgvrri

Id

6ae79f33-2d81-4bdf-a589-26102cfd340e

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacea2k6vcrsdakmm37szz6kmavkovvmpqq6iy36njjewq3klkbh2qyu

kernelogic commented 8 months ago

@NiwanDao what's your plan to increase replications?

NiwanDao commented 8 months ago

File transfer to other SPs like Enjoycloud and some individuals is in progress. Although the market condition affect the onboarding speed, most of the SPs I contacted with are still in good will to deal-making.

kernelogic commented 8 months ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceay4wy6lmbkax4zf3rpcytfrrtxr3syo5bbul4jpu6gat3sdjfmh6

Address

f1tuf6hs6jjigjodjiir5dxbn7rxjn6kaavjatura

Datacap Allocated

1.95PiB

Signer Address

f1yjhnsoga2ccnepb7t3p3ov5fzom3syhsuinxexa

Id

6ae79f33-2d81-4bdf-a589-26102cfd340e

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceay4wy6lmbkax4zf3rpcytfrrtxr3syo5bbul4jpu6gat3sdjfmh6

kevzak commented 8 months ago

SPs provided GREATERHEAT| Dallas | USA | f0** .... Mayi | Singapore| Singapore| f01808139 ... FL cloud |yangzhou| China| f0161916 ... TianJi Data| Hongkong| China| f02202943 ... Enjoycloud | guizhou| China | f02229279 xingjiliangzi | chongqing | china | f01845912

SPs taking deals f02346144 | Shenzhen, Guangdong, CNChina Unicom Guangdong IP network | 199.22 TiB | 6.74% | 199.22 TiB | 0.00% f02814843 | Chengdu, Sichuan, CNCHINANET-BACKBONE | 678.22 TiB | 22.95% | 678.22 TiB | 0.00% f01946104 | Chengdu, Sichuan, CNCHINANET-BACKBONE | 410.63 TiB | 13.89% | 410.63 TiB | 0.00% f01225783 | Chengdu, Sichuan, CNCHINANET-BACKBONE | 284.03 TiB | 9.61% | 284.03 TiB | 0.00% f02057486 | Chengdu, Sichuan, CNCHINANET-BACKBONE | 191.38 TiB | 6.48% | 191.38 TiB | 0.00% f02814850new | Xiamen, Fujian, CNCloud Computing Corporation | 349.66 TiB | 11.83% | 349.66 TiB | 0.00% f02368754 | Dallas, Texas, USFlexential Colorado Corp. | 290.91 TiB | 9.84% | 290.91 TiB | 0.00% f029585 | Dallas, Texas, USFlexential Colorado Corp. | 229.81 TiB | 7.78% | 229.81 TiB | 0.00% f02808764new | Shanghai, Shanghai, CNShenzhen Tencent Computer Systems Company Limited | 321.47 TiB | 10.88% | 321.47 TiB | 0.00%

@NiwanDao please explain SPs taking deals compared to original SP list provided. Who are the entities? Closing until updated.

NiwanDao commented 8 months ago

@kevzak Thanks for asking. Mayi and TianJi Data are still in the file transfer process and will start onboarding the deal within the coming month. I updated the SP with the organization below. Most of the SP organization remains unchanged. f02346144 | Shenzhen, Guangdong | KANG f02814843 | Chengdu, Sichuan |Enjoycloud f01946104 | Chengdu, Sichuan | SAI DAO f01225783 | Chengdu, Sichuan | YUAN f02057486 | Chengdu, Sichuan | FL cloud f02814850 | Xiamen, Fujian |Enjoycloud f02368754 | Dallas, Texas| GREATERHEAT f029585 | Dallas, Texas| GREATERHEAT

NiwanDao commented 8 months ago

checker:manualTrigger

filplus-checker-app[bot] commented 8 months ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard.

NiwanDao commented 8 months ago

@Sunnyiscoming @raghavrmadya can you please help to re-open this LDN?

large-datacap-requests[bot] commented 8 months ago

DataCap Allocation requested

Request number 7

Multisig Notary address

f02049625

Client address

f1tuf6hs6jjigjodjiir5dxbn7rxjn6kaavjatura

DataCap allocation requested

1.95PiB

Id

67b5d117-b14f-42f3-a199-b86b16eef631

nj-steve commented 8 months ago

checker:manualTrigger

filplus-checker-app[bot] commented 8 months ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard.

nj-steve commented 8 months ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacedc6j4nqrc4hvrkh7h6zqxdgu3doeiooxhllhsogypyidyplqn4ue

Address

f1tuf6hs6jjigjodjiir5dxbn7rxjn6kaavjatura

Datacap Allocated

1.95PiB

Signer Address

f1xx6555qijma7igpnjspyvdunc4vfxkawnpqy5ii

Id

67b5d117-b14f-42f3-a199-b86b16eef631

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedc6j4nqrc4hvrkh7h6zqxdgu3doeiooxhllhsogypyidyplqn4ue

nj-steve commented 8 months ago

Everything looks nice.

DirectionTechnology commented 8 months ago

Very willing to support such use cases.

DirectionTechnology commented 8 months ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceciiiyyejan4sdz5lic2a47tnefiqxxwxvet5aax4yk4fxikryu7m

Address

f1tuf6hs6jjigjodjiir5dxbn7rxjn6kaavjatura

Datacap Allocated

1.95PiB

Signer Address

f1inkdoatsbfumdvpctxbgcatscewr3rus5pxmsgi

Id

67b5d117-b14f-42f3-a199-b86b16eef631

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceciiiyyejan4sdz5lic2a47tnefiqxxwxvet5aax4yk4fxikryu7m

large-datacap-requests[bot] commented 8 months ago

DataCap Allocation requested

Request number 7

Multisig Notary address

f02049625

Client address

f1tuf6hs6jjigjodjiir5dxbn7rxjn6kaavjatura

DataCap allocation requested

1.95PiB

Id

5b5fe2b0-25fd-4ded-b3d5-d9e7daeb6ecb

NiwanDao commented 7 months ago

checker:manualTrigger

filplus-checker-app[bot] commented 7 months ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard.

NDLABS-Leo commented 7 months ago

Good report

NDLABS-Leo commented 7 months ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacebjcsbc5dtq36pidsj6y52lih2kvjkiqstutsjrgatpl6pclkogpw

Address

f1tuf6hs6jjigjodjiir5dxbn7rxjn6kaavjatura

Datacap Allocated

1.95PiB

Signer Address

f1yayfsv6whu3rheviucvventj3y6t542xfpb47ei

Id

5b5fe2b0-25fd-4ded-b3d5-d9e7daeb6ecb

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebjcsbc5dtq36pidsj6y52lih2kvjkiqstutsjrgatpl6pclkogpw

laurarenpanda commented 7 months ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceahh4gt5ie3yborysda6ehgvvsxm75uwy4lo3pbd3zsrey4jep5ky

Address

f1tuf6hs6jjigjodjiir5dxbn7rxjn6kaavjatura

Datacap Allocated

1.95PiB

Signer Address

f1bp3tzp536edm7dodldceekzbsx7zcy7hdfg6uzq

Id

5b5fe2b0-25fd-4ded-b3d5-d9e7daeb6ecb

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceahh4gt5ie3yborysda6ehgvvsxm75uwy4lo3pbd3zsrey4jep5ky

Sunnyiscoming commented 7 months ago

Sps in the table do not participated in. Some sps outside the form participated in. @NiwanDao Can you explain about that?

NiwanDao commented 7 months ago

Sps in the table do not participated in.

Some sps outside the form participated in.

@NiwanDao Can you explain about that?

Thanks for your asking. Plan is the plan, and change is a natural thing. Most of the SPs/organization are stable just a slight change in SP ID due to their own business model require SP ID adjustment to match their clients. Maybe I could submit a new version of partner SPs I worked with in this LDN somewhere. Feel free to drop a link!

herrehesse commented 7 months ago

@NiwanDao can you update the list you send deals to with SP, location, business, contact info?

github-actions[bot] commented 7 months ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

NiwanDao commented 7 months ago

WIP

ghost commented 7 months ago

Sps in the table do not participated in. Some sps outside the form participated in. @NiwanDao Can you explain about that?

Thanks for your asking. Plan is the plan, and change is a natural thing. Most of the SPs/organization are stable just a slight change in SP ID due to their own business model require SP ID adjustment to match their clients. Maybe I could submit a new version of partner SPs I worked with in this LDN somewhere. Feel free to drop a link!

https://www.jotform.com/231862753015656

Sunnyiscoming commented 7 months ago

SP List provided: [{"providerID": "f01808139", "City": "XYZ", "Country": "Singapore", "SPOrg","Mayi"}, {"providerID": "f0161916", "City": "yangzhou", "Country": "CN","SPOrg","FL cloud"}, {"providerID": "f02202943", "City": "Hongkong", "Country": "CN","SPOrg","TianJi Data"}, {"providerID": "f02229279", "City": "guizhou", "Country": "CN","SPOrg","Enjoycloud"}, {"providerID": "f01845912", "City": "chongqing", "Country": "CN","SPOrg","xingjiliangzi"},]

github-actions[bot] commented 6 months ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

large-datacap-requests[bot] commented 6 months ago

DataCap Allocation requested

Request number 9

Multisig Notary address

f02049625

Client address

f1tuf6hs6jjigjodjiir5dxbn7rxjn6kaavjatura

DataCap allocation requested

1.95PiB

Id

e43f8cde-3223-4d16-938c-0e458df895de

NiwanDao commented 6 months ago

WIP

SuperChaiChai commented 6 months ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacedhktwium6i4lp4y2u56mq3j7vfdl6jmiijchrrdvrycsvsj4vl3c

Address

f1tuf6hs6jjigjodjiir5dxbn7rxjn6kaavjatura

Datacap Allocated

1.95PiB

Signer Address

f12mckci3omexgzoeosjvstcfxfe4vqw7owdia3da

Id

e43f8cde-3223-4d16-938c-0e458df895de

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedhktwium6i4lp4y2u56mq3j7vfdl6jmiijchrrdvrycsvsj4vl3c

SuperChaiChai commented 6 months ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacea6tmfn2hjxccz3hs4r3fplnpni5lk34ssaf27m5qry5nrb7x7nok

Address

f1tuf6hs6jjigjodjiir5dxbn7rxjn6kaavjatura

Datacap Allocated

1.95PiB

Signer Address

f12mckci3omexgzoeosjvstcfxfe4vqw7owdia3da

Id

e43f8cde-3223-4d16-938c-0e458df895de

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacea6tmfn2hjxccz3hs4r3fplnpni5lk34ssaf27m5qry5nrb7x7nok

sxxfuture-official commented 6 months ago

checker:manualTrigger

filplus-checker-app[bot] commented 6 months ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard.

SuperChaiChai commented 6 months ago

BUG !!!again

sxxfuture-official commented 6 months ago

LGTM. support this round.

sxxfuture-official commented 6 months ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacedfh7gqyankyzdflelhfrz5sb3uut4rvj4yyz5o4f6s5gar7x6the

Address

f1tuf6hs6jjigjodjiir5dxbn7rxjn6kaavjatura

Datacap Allocated

1.95PiB

Signer Address

f1foiomqlmoshpuxm6aie4xysffqezkjnokgwcecq

Id

e43f8cde-3223-4d16-938c-0e458df895de

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedfh7gqyankyzdflelhfrz5sb3uut4rvj4yyz5o4f6s5gar7x6the