filecoin-project / filecoin-plus-large-datasets

Hub for client applications for DataCap at a large scale
109 stars 62 forks source link

[DataCap Application] Prelinger Archives LLC #2031

Closed brianeggert closed 1 year ago

brianeggert commented 1 year ago

Data Owner Name

Prelinger Archives LLC

What is your role related to the dataset

Dataset Owner

Data Owner Country/Region

United States

Data Owner Industry

Information, Media & Telecommunications

Website

prelingerarchives.online

Social Media

@prelingerarchives (Twitter)

Total amount of DataCap being requested

50 PiB

Expected size of single dataset (one copy)

12.5 PiB

Number of replicas to store

4

Weekly allocation of DataCap requested

50 TiB

On-chain address for first allocation

f1i2reokfclrqls5mkgtbqk5esvj6it7nykv7c57y

Data Type of Application

Public, Open Dataset (Research/Non-Profit)

Custom multisig

Identifier

efil

Share a brief history of your project and organization

Prelinger Archives operates open access film archives with a collection of over 40,000 films. We are currently collaborating with Internet Archive and Filecoin Foundation for the Decentralized Web to make thousands of historical films accessible through the DWeb.

Is this project associated with other projects/ecosystem stakeholders?

Yes

If answered yes, what are the other projects/ecosystem stakeholders

Internet Archive FFDW

Describe the data being stored onto Filecoin

Archival video scanned from historical film

Where was the data currently stored in this dataset sourced from

My own storage infra

If you answered "Other" in the previous question, enter the details here

n/a

How do you plan to prepare the dataset

others/custom tool

If you answered "other/custom tool" in the previous question, enter the details here

n/a

Please share a sample of the data

Dataset preparation: https://github.com/anjor/go-fil-dataprep

Data sample: https://archive.org/details/200333_Panama-Pacific_International_Exposition_Opening_Parade

Data transfer and dealmaking using spade.

Confirm that this is a public dataset that can be retrieved by anyone on the Network

Yes

If you chose not to confirm, what was the reason

n/a

What is the expected retrieval frequency for this data

Daily

For how long do you plan to keep this dataset stored on Filecoin

Permanently

In which geographies do you plan on making storage deals

North America, Australia (continent), Europe, Asia other than Greater China, Africa, South America

How will you be distributing your data to storage providers

Others

How do you plan to choose SP

Partners

If you answered "Others" in the previous question, what is the tool or platform you plan to use

n/a

If you already have a list of storage providers to work with, fill out their names and provider IDs below

Seal Storage Telnyx CES Group Inc PiKNiK filcollins Replikate LLC W3i VOT Group Distributed Storage Solutions Limited DIGITAL INCOME FUND PTY LTD

How do you plan to make deals to your storage providers

Others/custom tool

If you answered "Others/custom tool" in the previous question, enter the details here

n/a

Can you confirm that you will follow the Fil+ guideline

Yes

Application created via filplus.storage

data-programs commented 1 year ago

This application requests a total of 10 PiB, so it’s labeled very large application

large-datacap-requests[bot] commented 1 year ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

Sankara-Jefferson commented 1 year ago

Through the social Impact team at the filecoin foundation, I have been working closely with the Prelinger Archive team and they have legitimate data - thousands of short films - that they are preparing to upload to the filecoin storage network.

kevzak commented 1 year ago

Filecoin Foundation has confirmed this dataset and client. The E-Fil+ requirements complete.

Also, one thing to note for notaries: This project is using SPADE to make deals and store with verified Storage Providers. See details of the project here: https://ecosystem-wg.notion.site/Spade-efficient-data-onboarding-to-the-Filecoin-network-8e5dc48fd7c54e0e9385e445543a305a

kevzak commented 1 year ago

Datacap Request Trigger

Total DataCap requested

50PiB

Expected weekly DataCap usage rate

50TiB

Client address

f1i2reokfclrqls5mkgtbqk5esvj6it7nykv7c57y

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Multisig Notary address

f01940930

Client address

f1i2reokfclrqls5mkgtbqk5esvj6it7nykv7c57y

DataCap allocation requested

25TiB

Id

ffe0897b-255a-4581-8c94-88dc79083a19

laurarenpanda commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceakowrl5jeeana4lkdycljdnrko6a75ywogxwdaoggjqggrms2qt6

Address

f1i2reokfclrqls5mkgtbqk5esvj6it7nykv7c57y

Datacap Allocated

25.00TiB

Signer Address

f1bp3tzp536edm7dodldceekzbsx7zcy7hdfg6uzq

Id

ffe0897b-255a-4581-8c94-88dc79083a19

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceakowrl5jeeana4lkdycljdnrko6a75ywogxwdaoggjqggrms2qt6

liyunzhi-666 commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacebvzx32sgz2sswyajrcvzukf4a4drixjolox2quapifjrtctksw4w

Address

f1i2reokfclrqls5mkgtbqk5esvj6it7nykv7c57y

Datacap Allocated

25.00TiB

Signer Address

f1pszcrsciyixyuxxukkvtazcokexbn54amf7gvoq

Id

ffe0897b-255a-4581-8c94-88dc79083a19

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebvzx32sgz2sswyajrcvzukf4a4drixjolox2quapifjrtctksw4w

Sunnyiscoming commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report[^1]

No active deals found for this client.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

kevzak commented 1 year ago

Hello @brianeggert - there is now one additional step as part of E-Fil+ application process: To validate your applicant GitHub ID, we ask you to complete the KYC check (a third party ID verification process).

Steps:

Also note:

Let me know if you have any issues or questions.

brianeggert commented 1 year ago

@kevzak I completed the process and received confirmation on my phone but an error message in my browser. Can you take a look to see which is true? I no longer have a verification option on filplus.storage, which leads me to believe it worked.

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

kevzak commented 1 year ago

@kevzak I completed the process and received confirmation on my phone but an error message in my browser. Can you take a look to see which is true? I no longer have a verification option on filplus.storage, which leads me to believe it worked.

Hi @brianeggert actually the check did not go through. You'll see a KYC verified on your application and account. We were in a testing phase the past few weeks, it should work now and give you an error if there is an issue. Can you try again when you get a chance? Thanks for the support.

data-programs commented 1 year ago
KYC

This user’s identity has been verified through filplus.storage

brianeggert commented 1 year ago
KYC

This user’s identity has been verified through filplus.storage

@kevzak I was able to complete this this morning on the first try. It seems like there was an update. I tried about five times on Monday with Safari on both devices, and mostly it would show a "Continue on PC" message on mobile but hang on "Continue on mobile" in the desktop browser with a loading spinner. One time it showed a success message on mobile but did not show any updates on the desktop site or filplus.storage. If you able to give feedback on KYC, the "Continue on PC" message in the event of an error is misleading and should be replaced with an error message and reopen the camera app because once directed to continue on PC which is stuck on "Continue on mobile", refreshing the desktop site reloads the QR code to repeat all the steps on mobile. Whether or not it works, there are no additional steps to continue on PC.

kevzak commented 1 year ago

thank you for this feedback @brianeggert. We rolled this product out to a small group of E-Fil clients first. You are all set.

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

herrehesse commented 1 year ago

checker:manualTrigger

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

brianeggert commented 1 year ago

comment for stale bot

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

brianeggert commented 1 year ago

^We're making lots of progress

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 14 days, so for now it is being closed. Please feel free to contact the Fil+ Gov team to re-open the application if it is still being processed. Thank you!

clriesco commented 1 year ago

Removed stale label and reopened issue :)

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 2

Multisig Notary address

f01940930

Client address

f1i2reokfclrqls5mkgtbqk5esvj6it7nykv7c57y

DataCap allocation requested

50TiB

Id

5f3871df-4526-4c85-b00e-74dbaeecf62b

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01940930

Client address

f1i2reokfclrqls5mkgtbqk5esvj6it7nykv7c57y

Rule to calculate the allocation request amount

100% of weekly dc amount requested

DataCap allocation requested

50TiB

Total DataCap granted for client so far

25TiB

Datacap to be granted to reach the total amount requested by the client (50 PiB)

49.97PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
179 2 25TiB 60.16 19.65TiB
github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

cryptowhizzard commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaced3shrkr4p24avcdclld4do2q4n4c675vfwwwsfjci46egj6ek3jm

Address

f1i2reokfclrqls5mkgtbqk5esvj6it7nykv7c57y

Datacap Allocated

50.00TiB

Signer Address

f1krmypm4uoxxf3g7okrwtrahlmpcph3y7rbqqgfa

Id

5f3871df-4526-4c85-b00e-74dbaeecf62b

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaced3shrkr4p24avcdclld4do2q4n4c675vfwwwsfjci46egj6ek3jm

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 14 days, so for now it is being closed. Please feel free to contact the Fil+ Gov team to re-open the application if it is still being processed. Thank you!

-- Commented by Stale Bot.