[DataCap Application] Mixed Elements - Picas.ai

PicasMix commented 1 year ago

Data Owner Name

Mixed Elements

Data Owner Country/Region

Singapore

Data Owner Industry

IT & Technology Services

Website

https://mixedet.com/

Social Media

https://mixedet.com/

Total amount of DataCap being requested

5PiB

Weekly allocation of DataCap requested

200TiB

On-chain address for first allocation

f1qfsi7n3fh5tsfy3rmj6jwxsxiubvz6only4npxa

Custom multisig

[ ] Use Custom Multisig

Identifier

No response

Share a brief history of your project and organization

Picas.ai is a popular but not yet generally available AI art generator, and has become one of the most popular AI art creation platforms in the world. Based on AI, we will expand human imagination and explore the art space of large-scale creation. We specialize in art design and artificial intelligence. Our mission is to enable the independent creator  to succeed in an increasingly competitive digital environment and make Picas.ai the best AI art creation platform for creators through the continuous optimization of our latent text-to-image diffusion model capable of generating photo-realistic images given any text input.

Is this project associated with other projects/ecosystem stakeholders?

No

If answered yes, what are the other projects/ecosystem stakeholders

No response

Describe the data being stored onto Filecoin

Data Generated by AI Platforms, including pictures, texts, models, videos, etc.

Where was the data currently stored in this dataset sourced from

My Own Storage Infra

If you answered "Other" in the previous question, enter the details here

No response

How do you plan to prepare the dataset

No response

If you answered "other/custom tool" in the previous question, enter the details here

No response

Please share a sample of the data

http://picas.ai:10580/#/fallsImgList

Confirm that this is a public dataset that can be retrieved by anyone on the Network

[X] I confirm

If you chose not to confirm, what was the reason

No response

What is the expected retrieval frequency for this data

Monthly

For how long do you plan to keep this dataset stored on Filecoin

More than 3 years

In which geographies do you plan on making storage deals

Asia other than Greater China, North America

How will you be distributing your data to storage providers

Cloud storage (i.e. S3), HTTP or FTP server, Lotus built-in data transfer

How do you plan to choose storage providers

Partners

If you answered "Others" in the previous question, what is the tool or platform you plan to use

No response

If you already have a list of storage providers to work with, fill out their names and provider IDs below

No response

How do you plan to make deals to your storage providers

No response

If you answered "Others/custom tool" in the previous question, enter the details here

No response

Can you confirm that you will follow the Fil+ guideline

Yes

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

PicasMix commented 1 year ago

Please increase retrieval rate before next tranche

We have notified SP to resolve the retrieval issue. Thanks.

spaceT9 commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

⚠️ All retrieval success ratios are below 1%.

Overall Graphsync retrieval success rate: 0.46%
Overall HTTP retrieval success rate: 0.00%
Overall Bitswap retrieval success rate: 0.00%

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 3 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

PicasMix commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Overall Graphsync retrieval success rate: 10.89%
Overall HTTP retrieval success rate: 0.00%
Overall Bitswap retrieval success rate: 0.00%

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 3 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

PicasMix commented 1 year ago

SPs have increased the retrieval success rate. Can you support and sign for us? @spaceT9

BlockMakeronline commented 1 year ago

Do these two sp support data retrieval?

cryptowhizzard commented 1 year ago

No, they don't support retrieval. The first part goes but after a while it breaks.

http://www.datasetcreators.com/downloadedcarfiles/logs/1561-f02130271-f02264066-47709950-baga6ea4seaqclq3cdrc63doyk44hfcj6grmwhqbqmfauqhhzw744sl3a2fnj2ai.log

ghost commented 1 year ago

Hello @PicasMix per the new guidelines https://github.com/filecoin-project/notary-governance/issues/922 for Open Dataset applicants, please complete the following Fil+ registration form to identify yourself as the applicant and also please add the contact information of the SP entities you are working with to store copies of the data.

This information will be reviewed by Fil+ Governance team to confirm validity toward the Fil+ guideline of a distributed storage plan and SPs posted in the comments here. Let us know if you have any questions.

PicasMix commented 1 year ago

Do these two sp support data retrieval?

They have fixed the retrieval function and now support retrieval. Thank you for your reminder.

PicasMix commented 1 year ago

Hello @PicasMix per the new guidelines filecoin-project/notary-governance#922 for Open Dataset applicants, please complete the following Fil+ registration form to identify yourself as the applicant and also please add the contact information of the SP entities you are working with to store copies of the data.

This information will be reviewed by Fil+ Governance team to confirm validity toward the Fil+ guideline of a distributed storage plan and SPs posted in the comments here. Let us know if you have any questions.

Dear @Filplus-govteam,

Thank you for your reply! We will adjust according to the new guidelines.

PicasMix commented 1 year ago

Dear @Filplus-govteam,

The form has been submitted. Looking forward to your reply.

Sunnyiscoming commented 1 year ago

f062982,f02366381 SA f062811,f02264066 SA f0220632,f02306912 TW f01923312,f02252755 SK f02030299 f02238449 JP

PicasMix commented 1 year ago

What do we need to do?

cryptowhizzard commented 1 year ago

What do we need to do?

Provide retrieval that works.

PicasMix commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Overall Graphsync retrieval success rate: 51.74%
Overall HTTP retrieval success rate: 0.00%
Overall Bitswap retrieval success rate: 0.00%

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 3 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

PicasMix commented 1 year ago

What do we need to do?

Provide retrieval that works.

I have checked all the SP retrieval functions and everything seems to be working properly.

f062982 - Data has not been distributed yet.

f02366381 - It works.

f062811 - It works.

f02264066 - It works.

f0220632 - It works.

f02306912 - It works.

f01923312 - Data has not been distributed yet.

f02252755 - It works.

f02030299 - It works.

f02238449 - It works.

cryptowhizzard commented 1 year ago

Dear PicasMix,

As notary I am doing due diligence on your LDN. I could not get retrieval to work. Can you please upload the car file of CID baga6ea4seaqlujx7cgpplcxzm3ikbsn7assoqoq2d5qqaan4hutjyl4es4figoa ?

You can use our upload system at http://send.datasetcreators.com. Please select 7 days for the system to keep the file and post the link you received here so I (and other notaries) can download your content.

cryptowhizzard commented 1 year ago

Please upload this CID so we can see your data. Retrieval is still not working here ( just tested )

PicasMix commented 1 year ago

Dear PicasMix,

As notary I am doing due diligence on your LDN. I could not get retrieval to work. Can you please upload the car file of CID baga6ea4seaqlujx7cgpplcxzm3ikbsn7assoqoq2d5qqaan4hutjyl4es4figoa ?

You can use our upload system at http://send.datasetcreators.com. Please select 7 days for the system to keep the file and post the link you received here so I (and other notaries) can download your content.

https://send.datasetcreators.com/download/369df51579aeb496/#R6mkqXLYgiPYB3sGxgjDHQ

PicasMix commented 1 year ago

Please upload this CID so we can see your data. Retrieval is still not working here ( just tested )

This is my test command. ./lotus client retrieve --provider f02030299 --pieceCid=baga6ea4seaqlujx7cgpplcxzm3ikbsn7assoqoq2d5qqaan4hutjyl4es4figoa bafybeib6kdn4wlkfqb3ulvyebqr6fnt3ozd2k3hg54qfudabggctfea36m dest_f02030299_1

What is your complete test command?

PicasMix commented 1 year ago

@cryptowhizzard Let us know if you have any questions.

cryptowhizzard commented 1 year ago

I downloaded your file and unzipped it. However , this is the raw data.

I want to see the .car file matching the CID that you stored to prove that you actually stored this data.

PicasMix commented 1 year ago

I downloaded your file and unzipped it. However , this is the raw data.

I want to see the .car file matching the CID that you stored to prove that you actually stored this data.

Hi @cryptowhizzard, Please check the file. https://send.datasetcreators.com/download/30d80f25a145e2e6/#rn2NsoPJDQhijK0zkFc9OA

PicasMix commented 1 year ago

I downloaded your file and unzipped it. However , this is the raw data.

I want to see the .car file matching the CID that you stored to prove that you actually stored this data.

SP f02030299 also uploaded unsealed file.

unsealed/s-t02030299-1 https://send.datasetcreators.com/download/9703690c9d3196d7/#yzIHA-KFb7h-8bioyAGI2g

cryptowhizzard commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceahrz5utmhm3mpvkpz46dmeie3zoj3a3xiynwusu5xxh4twhditgq

Address

f1qfsi7n3fh5tsfy3rmj6jwxsxiubvz6only4npxa

Datacap Allocated

200.00TiB

Signer Address

f1krmypm4uoxxf3g7okrwtrahlmpcph3y7rbqqgfa

Id

39569b02-9c51-4664-b2f7-99563f123421

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceahrz5utmhm3mpvkpz46dmeie3zoj3a3xiynwusu5xxh4twhditgq

cryptowhizzard commented 1 year ago

Data verified

See : http://datasetcreators.com/downloadedcarfiles/1561-picasmix/

Thanks for your help @PicasMix . Sorry for the hassle caused. I hope you can get your SP's to provide steady retrievals so this won't be neseccary in the future.

PicasMix commented 1 year ago

Data verified

See : http://datasetcreators.com/downloadedcarfiles/1561-picasmix/

Thanks for your help @PicasMix . Sorry for the hassle caused. I hope you can get your SP's to provide steady retrievals so this won't be neseccary in the future.

@cryptowhizzard Thank you for your support, we have asked SP's to provide steady retrievals.

zcfil commented 12 months ago

checker:manualTrigger

filplus-checker-app[bot] commented 12 months ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Overall Graphsync retrieval success rate: 60.23%
Overall HTTP retrieval success rate: 0.00%
Overall Bitswap retrieval success rate: 0.00%

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 3 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

PicasMix commented 12 months ago

Hi @zcfil ,

Thank you for your attention. I hope you can support me again. Tell me what I need to do?

joshua-ne commented 12 months ago

Everything looks okay to me, except that the number of replicas is not ideal. I would support this round. Do expect to see more SPs to store your data.

joshua-ne commented 12 months ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacea54lsosfbingsawh66jemjougglnlv6qdm2w5kljt5a5fcczsz7g

Address

f1qfsi7n3fh5tsfy3rmj6jwxsxiubvz6only4npxa

Datacap Allocated

200.00TiB

Signer Address

f1xzff5xup63o5sygr2swp4zvcajg54lotliimdty

Id

39569b02-9c51-4664-b2f7-99563f123421

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacea54lsosfbingsawh66jemjougglnlv6qdm2w5kljt5a5fcczsz7g

PicasMix commented 12 months ago

Everything looks okay to me, except that the number of replicas is not ideal. I would support this round. Do expect to see more SPs to store your data.

@junyaoren Thank you for your support. This round will fix data replication.

dannyob commented 11 months ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacebewqtredied2srxuaaf7qdlse352tvws7py3eeosag6jiemnmq5g

Address

f1qfsi7n3fh5tsfy3rmj6jwxsxiubvz6only4npxa

Datacap Allocated

200.00TiB

Signer Address

f1k6wwevxvp466ybil7y2scqlhtnrz5atjkkyvm4a

Id

39569b02-9c51-4664-b2f7-99563f123421

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebewqtredied2srxuaaf7qdlse352tvws7py3eeosag6jiemnmq5g

dannyob commented 11 months ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceclgks7u3ct6ovvbv6sfndeyuq4o4cr6fvjz4wccmdq4cbeiitdma

Address

f1qfsi7n3fh5tsfy3rmj6jwxsxiubvz6only4npxa

Datacap Allocated

200.00TiB

Signer Address

f1k6wwevxvp466ybil7y2scqlhtnrz5atjkkyvm4a

Id

39569b02-9c51-4664-b2f7-99563f123421

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceclgks7u3ct6ovvbv6sfndeyuq4o4cr6fvjz4wccmdq4cbeiitdma

PicasMix commented 11 months ago

@dannyob Thank you for your support.

PicasMix commented 11 months ago

checker:manualTrigger

filplus-checker-app[bot] commented 11 months ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Overall Graphsync retrieval success rate: 61.70%
Overall HTTP retrieval success rate: 0.00%
Overall Bitswap retrieval success rate: 0.00%

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

PicasMix commented 11 months ago

Why didn't it automatically trigger <Request number 3>?

github-actions[bot] commented 11 months ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

PicasMix commented 11 months ago

Keep it open.

PicasMix commented 11 months ago

Hello @fabriziogianni7 ,

Can u help us manually fix it?

large-datacap-requests[bot] commented 11 months ago

DataCap Allocation requested

Request number 3

Multisig Notary address

f02049625

Client address

f1qfsi7n3fh5tsfy3rmj6jwxsxiubvz6only4npxa

DataCap allocation requested

400TiB

Id

0701112b-2093-4a58-9cd1-e800a87dfa51

PicasMix commented 11 months ago

@dannyob @spaceT9 @zcfil @liyunzhi-666 @BlockMakeronline @junyaoren @cryptowhizzard Could you help me sign it again?

liyunzhi-666 commented 11 months ago

checker:manualTrigger

filplus-checker-app[bot] commented 11 months ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Overall Graphsync retrieval success rate: 64.20%
Overall HTTP retrieval success rate: 0.00%
Overall Bitswap retrieval success rate: 0.00%

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

liyunzhi-666 commented 11 months ago

The report looks good and I can support this round.

filecoin-project / filecoin-plus-large-datasets