search

filecoin-project / filecoin-plus-large-datasets

Hub for client applications for DataCap at a large scale
109 stars 62 forks source link

[DataCap Application] <The New Ads> #464

Closed Gonzalo1987 closed 11 months ago

Gonzalo1987 commented 2 years ago

Large Dataset Notary Application

To apply for DataCap to onboard your dataset to Filecoin, please fill out the following.

Core Information

Project details

Share a brief history of your project and organization

The New Ads is an advertising agency specializing in digital signage, app development, social media, and audiovisual content creation.

What is the primary source of funding for this project?

Our revenue flows are the services provided to our clients.

What other projects/ecosystem stakeholders is this project associated with?

The New Ads is part of the Workanda Group. Workanda is made up of a group of companies from La Rioja, Spain, to offer a comprehensive service through IT services and 360º Communication. Custom programming and software, web development and training, audiovisual and design services.

Use-case details

Describe the data being stored onto Filecoin

The dataset provided consists of different forms of data (mainly video) from our client list which extends to more than 1,400. From the Spanish football team Barca F.C, Deutsche Bank, Volkswagen, and Opel, to The Parliament of “La Rioja” which is a public institution in Spain.

Where was the data in this dataset sourced from?

Own Servers.

Can you share a sample of the data? A link to file would work.

http://gofile.me/3XZGR/lZ79X3MRp
http://gofile.me/3XZGR/Qft0AGwzU
http://gofile.me/3XZGR/qLrjekXYk
http://gofile.me/3XZGR/0gbiaYqRW
http://gofile.me/3XZGR/qYXd5MWX5

Confirm that this is a public dataset that can be retrieved by anyone on the Network (i.e., no specific permissions or access rights are required to view the data).

Yes, since the dataset will be encrypted.

What is the expected retrieval frequency for this data?

There will not be much retrieval frequency of the data. Only if needed to do a revision of a given file.

For how long do you plan to keep this dataset stored on Filecoin?

One and a half years with possible renewal.

DataCap allocation plan

In which geographies (countries, regions) do you plan on making storage deals?

US and other countries as well

How will you be distributing your data to storage providers? Is there an offline data transfer process?

Files will be hosted online and able to be pulled by storage providers over the internet.

How do you plan on choosing the storage providers with whom you will be making deals? This should include a plan to ensure the data is retrievable in the future both by you and others.

Choosing reputable providers in the community via Filecoin slack or ranking sites. Also looking for SPs that are able to comply with GDPR.


How will you be distributing deals across storage providers?

Hosted online (like the sample links provided) for the SPs to download


Do you have the resources/funding to start making deals as soon as you receive DataCap? What support from the community would help you onboard onto Filecoin?

We have adequate resources and support.

jamerduhgamer commented 1 year ago

@simonkim0515, @raghavrmadya, not sure if you two are the exact people to tag on this but looks like we only got approved for 100 TiBs of datacap when it should have been the next tranche of 400 TiB.

lotus filplus check-client-datacap f1tza7y76ta5zogx5hdifsfdlyjh354xzb2awr33y 109968342646784

cryptowhizzard commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacebdp6rpcnualdydhhcyll3ug4gfvxcu55p43wckco3r27sqpy22k4

Address

f1tza7y76ta5zogx5hdifsfdlyjh354xzb2awr33y

Datacap Allocated

800.00TiB

Signer Address

f1krmypm4uoxxf3g7okrwtrahlmpcph3y7rbqqgfa

Id

aff503cb-ea88-403f-93d2-a0d396a19830

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebdp6rpcnualdydhhcyll3ug4gfvxcu55p43wckco3r27sqpy22k4

xinaxu commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacea2ft7vkvpiddkuqlxngkpq752cv274qua6x4fnynu2c4inlzjppi

Address

f1tza7y76ta5zogx5hdifsfdlyjh354xzb2awr33y

Datacap Allocated

800.00TiB

Signer Address

f1k3ysofkrrmqcot6fkx4wnezpczlltpirmrpsgui

Id

aff503cb-ea88-403f-93d2-a0d396a19830

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacea2ft7vkvpiddkuqlxngkpq752cv274qua6x4fnynu2c4inlzjppi

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 6

Multisig Notary address

f01924186

Client address

f1tza7y76ta5zogx5hdifsfdlyjh354xzb2awr33y

DataCap allocation requested

400TiB

Id

cdfa39a5-ec88-413c-a45b-f08f2ddb7128

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01924186

Client address

f1tza7y76ta5zogx5hdifsfdlyjh354xzb2awr33y

Rule to calculate the allocation request amount

400% of weekly dc amount requested

DataCap allocation requested

400TiB

Total DataCap granted for client so far

7.275957614183427e+49YiB

Datacap to be granted to reach the total amount requested by the client (5 PiB)

7.275957614183427e+49YiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
29257 10 800TiB 19.24 199.70TiB
github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 14 days, so for now it is being closed. Please feel free to contact the Fil+ Gov team to re-open the application if it is still being processed. Thank you!

jamerduhgamer commented 1 year ago

Hi @galen-mcandrew, @raghavrmadya, can we get this LDN re-opened? We took some time to resume sealing and just ran out of datacap again recently.

NiwanDao commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 68.95% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

NiwanDao commented 1 year ago

The report looks good, and I will support this tranche.

NiwanDao commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceazgbx2wfifmlobvnmtjfg6dlhlhpm4swqkkdfaxukj64cdf5jnq4

Address

f1tza7y76ta5zogx5hdifsfdlyjh354xzb2awr33y

Datacap Allocated

400.00TiB

Signer Address

f1a2lia2cwwekeubwo4nppt4v4vebxs2frozarz3q

Id

cdfa39a5-ec88-413c-a45b-f08f2ddb7128

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceazgbx2wfifmlobvnmtjfg6dlhlhpm4swqkkdfaxukj64cdf5jnq4

PluskitOfficial commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 68.95% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

PluskitOfficial commented 1 year ago

Deal Data ReplicationOverall HTTP retrieval success rate: 0.52% Overall Bitswap retrieval success rate: 0.79%

Hi, @Gonzalo1987 could you please explain why these two parts have such a low success rate?

jamerduhgamer commented 1 year ago

Hi @PluskitOfficial, I took a look at all of the miner IDs to see what the retrieval issues were.

f01998317 - Reached out to the SP, they are looking into it. f0763337 - Had an issue with its peer ID on-chain, I reached out to the SP and I believe this has been resolved. f01857342 - Has decent success rate f01900409 - SP is no longer active

f01165233, f01154023 and f01165179 all belong to one SP that is no longer sealing and have their Boost nodes turned off.

For f01927134, f01884351 and f02022254, I see in the retrieval report that the main error is "protocol not supported", any idea what could be the main cause for these errors so I can relate that to the SPs?

jamerduhgamer commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 68.95% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

jamerduhgamer commented 1 year ago

Hello! Still looking for notaries to sign datacap.

cryptowhizzard commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacea4rasrqds4qprk34y5v33ewir2n22d7doqzos5ehsojeyzuc57pw

Address

f1tza7y76ta5zogx5hdifsfdlyjh354xzb2awr33y

Datacap Allocated

400.00TiB

Signer Address

f1krmypm4uoxxf3g7okrwtrahlmpcph3y7rbqqgfa

Id

cdfa39a5-ec88-413c-a45b-f08f2ddb7128

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacea4rasrqds4qprk34y5v33ewir2n22d7doqzos5ehsojeyzuc57pw

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

jamerduhgamer commented 1 year ago

Comment to keep LDN open. Sealing has been on-going.

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

jamerduhgamer commented 1 year ago

Comment to keep LDN open. Sealing has been on-going.

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

jamerduhgamer commented 1 year ago

Comment to keep LDN open.

Sunnyiscoming commented 1 year ago

Hello, @Gonzalo1987 per the https://github.com/filecoin-project/notary-governance/issues/922 for Open, Public Dataset applicants, please complete the following Fil+ registration form to identify yourself as the applicant and also please add the contact information of the SP entities you are working with to store copies of the data.

This information will be reviewed by Fil+ Governance team to confirm validity and then the application will be allowed to move forward for additional notary review.

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

jamerduhgamer commented 1 year ago

Comment to keep LDN open.

github-actions[bot] commented 11 months ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

github-actions[bot] commented 11 months ago

This application has not seen any responses in the last 14 days, so for now it is being closed. Please feel free to contact the Fil+ Gov team to re-open the application if it is still being processed. Thank you!

-- Commented by Stale Bot.

jamerduhgamer commented 9 months ago

Hello @dkkapur, can we get this LDN re-opened?

jamerduhgamer commented 9 months ago

@simonkim0515 or @Kevin-FF-USA, are you also able to help with getting this LDN re-opened?