filecoin-project / filecoin-plus-large-datasets

Hub for client applications for DataCap at a large scale
110 stars 62 forks source link

[DataCap Application] 315XY #1045

Closed Saeed116 closed 1 year ago

Saeed116 commented 2 years ago

Large Dataset Notary Application

To apply for DataCap to onboard your dataset to Filecoin, please fill out the following.

Core Information

Please respond to the questions below by replacing the text saying "Please answer here". Include as much detail as you can in your answer.

Project details

Share a brief history of your project and organization.

The members of Studio BuZheng are a group of elites from various fields, including composers, singers, professional musicians, professional sound control technicians and experienced marketing planners, with rich experience in live show and activity planning, providing one line service from off-stage to on-stage, from hardware to program, as a long-term cooperation team for well-known enterprises.

What is the primary source of funding for this project?

It is from our company revenue.

What other projects/ecosystem stakeholders is this project associated with?

No.

Use-case details

Describe the data being stored onto Filecoin

We have 600TiB data now. And we need 10 copies.The data we want to store are videos and images of the activities we have participated in.

Where was the data in this dataset sourced from?

It was from live shows. We recorded every show which  we participated.

Can you share a sample of the data? A link to a file, an image, a table, etc., are good ways to do this. 

Yes, I put some data into google drive.
https://drive.google.com/drive/folders/1-TcB7lcBU_empsW_SgFWxbipuzosW3br?usp=sharing

         Confirm that this is a public dataset that can be retrieved by anyone on the Network (i.e., no specific permissions or access rights are required to view the data).

Yes, I confirm it is a public dataset.

What is the expected retrieval frequency for this data?

We may retrieve the data once half a year because we'll do a review half a year.

For how long do you plan to keep this dataset stored on Filecoin?

3-5 years.

DataCap allocation plan

In which geographies (countries, regions) do you plan on making storage deals?

Now we are connecting with Sps in North America, Korea, Holland. We plan on making deals in more regions for data security.

How will you be distributing your data to storage providers? Is there an offline data transfer process?

We will choose offline data transfer because we think it is a stable way for us to use. If it is viable, we may also choose online data transfer.

How do you plan on choosing the storage providers with whom you will be making deals? This should include a plan to ensure the data is retrievable in the future both by you and others.

We'll ensure distributed storage so we'll choose diiferent regions to make deals.
We welcome more Sp to cooperate with us.

How will you be distributing deals across storage providers?

We will distribute no more than 30% deals to every sp.

Do you have the resources/funding to start making deals as soon as you receive DataCap? What support from the community would help you onboard onto Filecoin?

Yes, we've already prepared resource we need.
Bennyyangpu commented 1 year ago

Please keep the allocation in line with Filplus guidlines.

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 7

Multisig Notary address

f02049625

Client address

f1jxcq5lm4du5ktt5szlc5wye4udzivaqvswhm6kq

DataCap allocation requested

800TiB

Id

8c222d29-f1fc-450e-8e5e-505787ce8258

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f02049625

Client address

f1jxcq5lm4du5ktt5szlc5wye4udzivaqvswhm6kq

Rule to calculate the allocation request amount

400% of weekly dc amount requested

DataCap allocation requested

800TiB

Total DataCap granted for client so far

1.4528632164001476e+66YiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

1.4528632164001476e+66YiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
73724 26 1.56PiB 9.99 402.87TiB
github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

Suyanj commented 1 year ago

checker:manualTrigger

Suyanj commented 1 year ago

image

Suyanj commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacecepaejiuaahihwauhm3mxrnvoxmy7q5rwnwtrpojbfmgcu6g3wsa

Address

f1jxcq5lm4du5ktt5szlc5wye4udzivaqvswhm6kq

Datacap Allocated

800.00TiB

Signer Address

f1ihv7gz3vn3xqvikpt4rwryecgisl7745lodx3yi

Id

8c222d29-f1fc-450e-8e5e-505787ce8258

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecepaejiuaahihwauhm3mxrnvoxmy7q5rwnwtrpojbfmgcu6g3wsa

cryptowhizzard commented 1 year ago

http retrieval statistics are unreliable at the moment.

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

⚠️ 1 storage providers sealed too much duplicate data - f01289416: 34.24%

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

cryptowhizzard commented 1 year ago

@filplus-govteam

This application is signed with the need governance label present. Secondly no graphsync retrievals possible

cryptowhizzard commented 1 year ago

Scherm­afbeelding 2023-07-31 om 08 24 34

Saeed116 commented 1 year ago

I’ve changed some words from my application last week. After that, my application was put label governance review needed by bot automatically. Isn't it the error of bot? Why did you think that my application has problem or can not be sign? @cryptowhizzard @filplus-govteam

cryptowhizzard commented 1 year ago

The reason i disputed is because the SP's you work with have been flagged overal the Fil+ system for abuse/CID sharing and non-retrievability. Both are against Fil+ rules and guidelines.

You got a notary signature where you should not have had one, reason i filed a dispute.

Scherm­afbeelding 2023-08-03 om 13 57 13

Saeed116 commented 1 year ago

@cryptowhizzard

CID sharing is completely out of control for SPs, and it is something that belongs to DPs or Clients whose applications have problem to review.

I will take responsibility for my application and if you don't see CID Sharing in my report, please don't post misleading comments.

cryptowhizzard commented 1 year ago

@cryptowhizzard

CID sharing is completely out of control for SPs, and it is something that belongs to DPs or Clients whose applications have problem to review.

I will take responsibility for my application and if you don't see CID Sharing in my report, please don't post misleading comments.

Well, if it were to be one SP i could give you credit, or perhaps 2. Not a dozen?

You are responsible for selecting SP's who support retrieval according to your declaration in the top of the LDN where you state what everyone is able to retrieve this data. These SP's do not support retrieval apart from the abuse.

Saeed116 commented 1 year ago

image @Carohere Can you please help me with the same problem as Janice? I'm the one who sent you message in slack.

cryptowhizzard commented 1 year ago

@Saeed116

May i suggest that you help yourself first before asking another notary. Contact your SP's and make sure they enable retrieval. When that is proper your application can continue?

Saeed116 commented 1 year ago

@cryptowhizzard

The SPs do support retrieval.

image

Carohere commented 1 year ago

@Saeed116 If there are no problem in your application, it is no need to respond to those irrelevant. I can sign for you since your application's report seems good.

cryptowhizzard commented 1 year ago

Here find the log file of the retrieval attempt. After a while the retrieval stops ( aborted on the SP side ) and then restarts. This is a typical way of circumventing the retrieval bot while still nothing can be downloaded to do due diligence on.

1045.log.zip

@Carohere appreciate you won't respond, however this application is under dispute until retrieval is proper.

@Saeed116 I am willing to revoke the dispute if you can provide me with pieceCID baga6ea4seaqira2newcpfkoqxnjfyubq6zu6jdsdk3e2zcceh4ilr27x4wciaei and make it available on a link where i can download it + unpack your data to review the content.

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 14 days, so for now it is being closed. Please feel free to contact the Fil+ Gov team to re-open the application if it is still being processed. Thank you!

large-datacap-requests[bot] commented 7 months ago

RootKeyHolders have approved multisig account. You can now request first datacap release

large-datacap-requests[bot] commented 4 months ago

RootKeyHolders have approved multisig account. You can now request first datacap release