Closed Gonzalo1987 closed 11 months ago
Thanks for your request! Everything looks good. :ok_hand:
A Governance Team member will review the information provided and contact you back pretty soon.
@Gonzalo1987 : This is very cool and thanks for your interest in the Filecoin network. You say that your company is part of a group of companies from Spain. However, your request mentions storing in the United States among "other countries". I would like to confirm that this is intentional and without sovereignty restrictions. Thanks.
Hello @Kevin-PikNik! We confirm that our intention is to store the data across different places without sovereignty restrictions. In our opinion, one of the main advantages of the Filecoin Network is to diversify risk choosing differents regions and countries. Thanks.
@Gonzalo1987 Cool idea and I've taken a look at your application. There's one thing I'd like to figure out. You confirmed that it's a public dataset since it's encrypted. How can encrypted data be public?
We can support the application. Just curious, if the data is already encrypted on your side, is it necessary for SPs to comply with GDPR?
@Gonzalo1987 Cool idea and I've taken a look at your application. There's one thing I'd like to figure out. You confirmed that it's a public dataset since it's encrypted. How can encrypted data be public?
Hello @Kakkouii! We should've been clearer. What we mean is that the data is publicly retrievable but encrypted. By storing on the Filecoin network, it is inherently public for anyone to retrieve but will be encrypted in order to comply with our company's privacy requirements and GDPR.
We can support the application. Just curious, if the data is already encrypted on your side, is it necessary for SPs to comply with GDPR?
Hi @Fenbushi-Filecoin! Yes, every organization (SPs in this case) that stores data from European institutions or individuals will need to comply with GDPR. But encryption is called out in Article 32 as an “appropriate technical and organizational measure” of security. For this reason, we will keep the keys for the encrypted data. This means the SPs does not need to be too concerned with GDPR compliance as we will have control of the data. Here is a link for more info! https://gdpr.eu/faq/.
Hello @galen-mcandrew! What are the next steps now that we have support from one notary (@Fenbushi-Filecoin)?
Hi, @Gonzalo1987 Hi, As Deep mentioned filecoin-project/notary-governance#514, you will need to find notaries that can support your application since it includes private enterprise data.
You will need to follow a process similar to filecoin-project/notary-governance#489. This means:
Find notaries that can support your application. You can do this best in Slack, #fil-plus or #fil-plus-application-review Once you have them, make an issue in the Notary Governance repo, similar to filecoin-project/notary-governance#489, stating your plan and the notaries that can support your request FIL+ governance can then set up a custom LDN for this with those notaries and proceed from there These additional steps are required to ensure that notaries can establish a relationship with you and back you as a trustworthy client, since the usual deal data will be encrypted and not open to access for the community to validate your actions on chain after DataCap has been used.
any updates?
any updates?
Yes! Yesterday we posted the following message on the notary governance issue:
https://github.com/filecoin-project/notary-governance/issues/573#issuecomment-1217757614
We got the notaries backing our application, and a data distribution plan complying with geographic diversification.
@Gonzalo1987, thanks. We will go ahead and create a custom multisig between the notaries listed in #573.
@Gonzalo1987, thanks. We will go ahead and create a custom multisig between the notaries listed in #573.
Hello @raghavrmadya. I see that the issue has the CustomLDN label. What are the next steps to keep moving forward in the process?
Hello @raghavrmadya @sunnyiscoming @galen-mcandrew! Any updates on the creation of the custom multisig? Is there anything that we can do to accelerate the process?
Hi @Gonzalo1987, I understand the need to encrypt data for client privacy. But as @kernelogic mentioned in your proposal, it's hard to verify their willingness if it's already impossible to get them each authorized for data samples. Is there any way you can prove that the companies in your client list authorized New Ads to store their data here?
Hi @Carohere, I believe a few of the notaries besides Kernelogic have actually met with the client themselves to perform the KYC process as mentioned in the corresponding proposal https://github.com/filecoin-project/notary-governance/issues/573.
@jamerduhgamer yes james. i'm aware that the project has already gotten support from five notaries. my point here is whether the applicant needs to address queries from other community members after that. cc @Kevin-FF-USA, could you help me on this? thanks.
Hello @carohere! Totally willing to address queries from the Filecoin community. As you must know, The New Ads is not a data-storage company, it’s an advertisement company with more than 1,400 clients looking to store their whole dataset in the cheapest and most reliable way. We must comply with GDPR and european regulation as mentioned in https://github.com/filecoin-project/notary-governance/issues/573 , and that’s the only requisite while storing our data and the motive for encryption. Therefore, our clients do not have to approve where we are storing our data as long as we comply with european regulation. Each notary made their proper KYC (we had several meetings with them) and we prove our case that we are authorized to store this dataset in Filecoin.
Thanks for your request! Everything looks good. :ok_hand:
A Governance Team member will review the information provided and contact you back pretty soon.
5 PiB
Expected weekly DataCap usage rate
100 TiB
Client address
f1tza7y76ta5zogx5hdifsfdlyjh354xzb2awr33y
f01924186
f1tza7y76ta5zogx5hdifsfdlyjh354xzb2awr33y
50TiB
Your Datacap Allocation Request has been proposed by the Notary
bafy2bzaceam3qq3lw5byvorsjfazc5443vsrkoy32oyssbsky4ukrfqbb2kjw
Address
f1tza7y76ta5zogx5hdifsfdlyjh354xzb2awr33y
Datacap Allocated
50.00TiB
Signer Address
f1k3ysofkrrmqcot6fkx4wnezpczlltpirmrpsgui
You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceam3qq3lw5byvorsjfazc5443vsrkoy32oyssbsky4ukrfqbb2kjw
Your Datacap Allocation Request has been approved by the Notary
bafy2bzacect47i5zh424qshhhzig5tpxxdf2hkswcwlhuxatuomd3flkjto6q
Address
f1tza7y76ta5zogx5hdifsfdlyjh354xzb2awr33y
Datacap Allocated
50.00TiB
Signer Address
f1a2lia2cwwekeubwo4nppt4v4vebxs2frozarz3q
You can check the status of the message here: https://filfox.info/en/message/bafy2bzacect47i5zh424qshhhzig5tpxxdf2hkswcwlhuxatuomd3flkjto6q
Hi @gonzalo1987, appreciate your time. I absolutely get the point of encryption.
From the Spanish football team Barca F.C, Deutsche Bank, Volkswagen, and Opel, to The Parliament of “La Rioja” which is a public institution in Spain.
My other concern is the relationship between the 1400 clients and your organization. Is there any way you can provide the partnership between those companies and New ads? Btw about La Rioja, do you mean La Rioja 25?
Hi @Carohere! In our application we have provided 5 sample links where you will be able to find files from Volkswagen, Barcelona FC, Opel, Deutsche Bank and the Parlament of La Rioja. I can’t imagine a better proof than that. It’s important to remember that they are not our partners, they are our clients.
La Rioja is an autonomous community within Spain, like an state in the US. Each autonomous community has its Parlament and Public Institutions, and The New Ads have done several project with them. We don’t know anything about the link you are mentioning.
@Gonzalo1987 fair enough. Oftentimes, many applicants are unable to prove their connection to the data entity which is why I asked the question in the first place. Although I still think it is not enough that encrypted data only needs the support of five notaries. But it looks like that's the current consensus until the criteria for encrypted data review is strengthened. Sorry for the inconvenience and thanks for your time.
f01924186
f1tza7y76ta5zogx5hdifsfdlyjh354xzb2awr33y
100TiB
c5ee8d5b-f1fe-48ef-a9cb-646ecb830fe4
f01924186
f1tza7y76ta5zogx5hdifsfdlyjh354xzb2awr33y
xingjitansuo & xinaxu
100% of weekly dc amount requested
100TiB
not found
not found
Number of deals | Number of storage providers | Previous DC Allocated | Top provider | Remaining DC |
---|---|---|---|---|
not found | not found | 50TiB | not found | 11.81TiB |
Your Datacap Allocation Request has been proposed by the Notary
bafy2bzacedpolxpfvpxdbzp4ecxm5jc6f733cpsbspefuzlydp2bwwextoeqs
Address
f1tza7y76ta5zogx5hdifsfdlyjh354xzb2awr33y
Datacap Allocated
100.00TiB
Signer Address
f1jqk7xok5kautet2knhwlg74jvcfbrqlj47kbp2i
Id
c5ee8d5b-f1fe-48ef-a9cb-646ecb830fe4
You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedpolxpfvpxdbzp4ecxm5jc6f733cpsbspefuzlydp2bwwextoeqs
Your Datacap Allocation Request has been approved by the Notary
bafy2bzacedan47fdetovzzmpgvc5uy5ktqhtsk7ochir4cwci3sblgbvdlylc
Address
f1tza7y76ta5zogx5hdifsfdlyjh354xzb2awr33y
Datacap Allocated
100.00TiB
Signer Address
f1yqydpmqb5en262jpottko2kd65msajax7fi4rmq
Id
c5ee8d5b-f1fe-48ef-a9cb-646ecb830fe4
You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedan47fdetovzzmpgvc5uy5ktqhtsk7ochir4cwci3sblgbvdlylc
@Gonzalo1987 Hi! Great to see you have gotten approval for DataCap. If you are looking for storage providers to store these data or have any questions, please visit #bigdata-exchange on Filecoin Slack or reply here.
We have strong demand from a diverse group of SPs, who are actively looking to onboard more data.
f01924186
f1tza7y76ta5zogx5hdifsfdlyjh354xzb2awr33y
200TiB
e7ea47cb-c071-4faf-932b-5e62f06a993a
f01924186
f1tza7y76ta5zogx5hdifsfdlyjh354xzb2awr33y
Fenbushi-Filecoin & bmcnabb25
200% of weekly dc amount requested
200TiB
not found
not found
Number of deals | Number of storage providers | Previous DC Allocated | Top provider | Remaining DC |
---|---|---|---|---|
not found | not found | 100TiB | not found | 24.56TiB |
Your Datacap Allocation Request has been proposed by the Notary
bafy2bzacedsadp4qm4mdn423baxfboks7aaygvfprbsmyz2cua3dajwofhxde
Address
f1tza7y76ta5zogx5hdifsfdlyjh354xzb2awr33y
Datacap Allocated
200.00TiB
Signer Address
f1k3ysofkrrmqcot6fkx4wnezpczlltpirmrpsgui
Id
e7ea47cb-c071-4faf-932b-5e62f06a993a
You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedsadp4qm4mdn423baxfboks7aaygvfprbsmyz2cua3dajwofhxde
Your Datacap Allocation Request has been approved by the Notary
bafy2bzacecrvqulbucafsbaqm2ra3g6q3yyciswcnjupnm3xvdl3a67yttx76
Address
f1tza7y76ta5zogx5hdifsfdlyjh354xzb2awr33y
Datacap Allocated
200.00TiB
Signer Address
f1a2lia2cwwekeubwo4nppt4v4vebxs2frozarz3q
Id
e7ea47cb-c071-4faf-932b-5e62f06a993a
You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecrvqulbucafsbaqm2ra3g6q3yyciswcnjupnm3xvdl3a67yttx76
The New Ads
f1tza7y76ta5zogx5hdifsfdlyjh354xzb2awr33y
The below table shows the distribution of storage providers that have stored data for this client.
If this is the first time a provider takes verified deal, it will be marked as new
.
For most of the datacap application, below restrictions should apply.
⚠️ f01927134 has sealed 50.90% of total datacap.
⚠️ f01900409 has sealed 48.37% of total datacap.
Provider | Location | Total Deals Sealed | Percentage | Unique Data | Duplicate Deals |
---|---|---|---|---|---|
f01927134 | Las Vegas, Nevada, US | 91.42 TiB | 50.90% | 90.48 TiB | 1.03% |
f01900409new |
San Diego, California, US | 86.89 TiB | 48.37% | 86.02 TiB | 1.01% |
f01884351new |
Dallas, Texas, US | 768.00 GiB | 0.42% | 768.00 GiB | 0.00% |
f01857342new |
Detroit, Michigan, US | 544.00 GiB | 0.30% | 544.00 GiB | 0.00% |
f01154023 | Sydney, New South Wales, AU | 32.00 GiB | 0.02% | 32.00 GiB | 0.00% |
The below table shows how each many unique data are replicated across storage providers.
⚠️ 100.00% of deals are for data replicated across less than 4 storage providers.
Unique Data Size | Total Deals Made | Number of Providers | Deal Percentage |
---|---|---|---|
23.63 TiB | 23.72 TiB | 1 | 13.20% |
75.92 TiB | 153.53 TiB | 2 | 85.47% |
800.00 GiB | 2.38 TiB | 3 | 1.32% |
The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.
✔️ No CID sharing has been observed.
[^1]: To manually trigger this report, add a comment with text checker:manualTrigger
f01924186
f1tza7y76ta5zogx5hdifsfdlyjh354xzb2awr33y
400TiB
7f778267-a7f5-4dc9-b335-0389403fe1c9
f01924186
f1tza7y76ta5zogx5hdifsfdlyjh354xzb2awr33y
xingjitansuo & xinaxu
400% of weekly dc amount requested
400TiB
350TiB
4.65PiB
Number of deals | Number of storage providers | Previous DC Allocated | Top provider | Remaining DC |
---|---|---|---|---|
5391 | 4 | 200TiB | 44.64 | 48.28TiB |
The New Ads
f1tza7y76ta5zogx5hdifsfdlyjh354xzb2awr33y
1
bmcnabb251
Fenbushi-Filecoin2
xinaxu2
xingjitansuo
The below table shows the distribution of storage providers that have stored data for this client.
If this is the first time a provider takes verified deal, it will be marked as new
.
For most of the datacap application, below restrictions should apply.
⚠️ f01927134 has sealed 46.94% of total datacap.
⚠️ f01900409 has sealed 31.65% of total datacap.
Provider | Location | Total Deals Sealed | Percentage | Unique Data | Duplicate Deals |
---|---|---|---|---|---|
f01857342new |
Detroit, Michigan, US123.Net, Inc. |
1.47 TiB | 0.54% | 1.47 TiB | 0.00% |
f01154023 | Sydney, New South Wales, AUAnycast Global Backbone |
32.00 GiB | 0.01% | 32.00 GiB | 0.00% |
f01884351new |
Dallas, Texas, USPacket Host, Inc. |
768.00 GiB | 0.27% | 768.00 GiB | 0.00% |
f01927134 | Las Vegas, Nevada, USPiKNiK & Company Inc. |
128.80 TiB | 46.94% | 127.86 TiB | 0.73% |
f01900409new |
San Diego, California, USPiKNiK & Company Inc. |
86.86 TiB | 31.65% | 85.98 TiB | 1.01% |
f01998317 | Las Vegas, Nevada, USPiKNiK & Company Inc. |
56.50 TiB | 20.59% | 56.50 TiB | 0.00% |
The below table shows how each many unique data are replicated across storage providers.
⚠️ 100.00% of deals are for data replicated across less than 4 storage providers.
Unique Data Size | Total Deals Made | Number of Providers | Deal Percentage |
---|---|---|---|
119.03 TiB | 119.13 TiB | 1 | 43.41% |
75.61 TiB | 152.91 TiB | 2 | 55.72% |
800.00 GiB | 2.38 TiB | 3 | 0.87% |
The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.
However, this could be possible if all below clients use same software to prepare for the exact same dataset or they belong to a series of LDN applications for the same dataset.
✔️ No CID sharing has been observed.
[^1]: To manually trigger this report, add a comment with text checker:manualTrigger
Just a heads up that we are currently working on getting more SPs to seal the replicas of this dataset, you can see this in the filplus-checker-apps comment with the "new" miner IDs.
Your Datacap Allocation Request has been proposed by the Notary
bafy2bzacedbzrrbdls2jpaolabts5rokcfgk62docuzcshqljzvdqrorgf7hk
Address
f1tza7y76ta5zogx5hdifsfdlyjh354xzb2awr33y
Datacap Allocated
100.00TiB
Signer Address
f1yqydpmqb5en262jpottko2kd65msajax7fi4rmq
Id
7f778267-a7f5-4dc9-b335-0389403fe1c9
You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedbzrrbdls2jpaolabts5rokcfgk62docuzcshqljzvdqrorgf7hk
Just a heads up that we are currently working on getting more SPs to seal the replicas of this dataset, you can see this in the filplus-checker-apps comment with the "new" miner IDs.
Hi James,
Can you please consider storing some of the data on a second continent? Europe / Australia / Asia ...... If so, then i am open for signing on this one.
checker:manualTrigger
The New Ads
f1tza7y76ta5zogx5hdifsfdlyjh354xzb2awr33y
1
bmcnabb252
Fenbushi-Filecoin2
xinaxu2
xingjitansuo
The below table shows the distribution of storage providers that have stored data for this client.
If this is the first time a provider takes verified deal, it will be marked as new
.
For most of the datacap application, below restrictions should apply.
⚠️ f01927134 has sealed 42.15% of total datacap.
Provider | Location | Total Deals Sealed | Percentage | Unique Data | Duplicate Deals |
---|---|---|---|---|---|
f01857342new |
Detroit, Michigan, US123.Net, Inc. |
2.94 TiB | 0.96% | 2.84 TiB | 3.19% |
f01154023 | Melbourne, Victoria, AUAnycast Global Backbone |
2.72 TiB | 0.89% | 2.72 TiB | 0.00% |
f01884351new |
Dallas, Texas, USPacket Host, Inc. |
18.41 TiB | 6.02% | 18.41 TiB | 0.00% |
f01927134 | Las Vegas, Nevada, USPiKNiK & Company Inc. |
128.95 TiB | 42.15% | 128.02 TiB | 0.73% |
f01900409new |
San Diego, California, USPiKNiK & Company Inc. |
91.02 TiB | 29.75% | 90.14 TiB | 0.96% |
f01998317 | Las Vegas, Nevada, USPiKNiK & Company Inc. |
61.88 TiB | 20.23% | 61.88 TiB | 0.00% |
The below table shows how each many unique data are replicated across storage providers.
⚠️ 96.40% of deals are for data replicated across less than 4 storage providers.
Unique Data Size | Total Deals Made | Number of Providers | Deal Percentage |
---|---|---|---|
121.34 TiB | 121.53 TiB | 1 | 39.73% |
62.55 TiB | 125.56 TiB | 2 | 41.05% |
15.56 TiB | 47.81 TiB | 3 | 15.63% |
2.72 TiB | 11.00 TiB | 4 | 3.60% |
The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.
However, this could be possible if all below clients use same software to prepare for the exact same dataset or they belong to a series of LDN applications for the same dataset.
✔️ No CID sharing has been observed.
[^1]: To manually trigger this report, add a comment with text checker:manualTrigger
Hi @cryptowhizzard, yes we have plans on storing a replica with the Holon team in Australia! I believe they just finish setting up an SP and will start receiving deals in the next datacap tranche!
Curious why the bot says it should be a 400 TiB tranche this time but Fenbushi's proposal was only for 100 TiBs.
Hi @cryptowhizzard, yes we have plans on storing a replica with the Holon team in Australia! I believe they just finish setting up an SP and will start receiving deals in the next datacap tranche!
Sounds good then. Thanks for the info!
Your Datacap Allocation Request has been approved by the Notary
bafy2bzaceczukmykazdigfebl6bivn73w7ietvgg36siduomfvlbfbg5b2x44
Address
f1tza7y76ta5zogx5hdifsfdlyjh354xzb2awr33y
Datacap Allocated
100.00TiB
Signer Address
f1krmypm4uoxxf3g7okrwtrahlmpcph3y7rbqqgfa
Id
You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceczukmykazdigfebl6bivn73w7ietvgg36siduomfvlbfbg5b2x44
f01924186
f1tza7y76ta5zogx5hdifsfdlyjh354xzb2awr33y
800TiB
aff503cb-ea88-403f-93d2-a0d396a19830
f01924186
f1tza7y76ta5zogx5hdifsfdlyjh354xzb2awr33y
cryptowhizzard & Fenbushi-Filecoin
800% of weekly dc amount requested
800TiB
350TiB
4.65PiB
Number of deals | Number of storage providers | Previous DC Allocated | Top provider | Remaining DC |
---|---|---|---|---|
7032 | 6 | 400TiB | 34.22 | 16GiB |
The New Ads
f1tza7y76ta5zogx5hdifsfdlyjh354xzb2awr33y
1
bmcnabb251
cryptowhizzard2
Fenbushi-Filecoin2
xinaxu2
xingjitansuo
The below table shows the distribution of storage providers that have stored data for this client.
If this is the first time a provider takes verified deal, it will be marked as new
.
For most of the datacap application, below restrictions should apply.
⚠️ f01927134 has sealed 42.15% of total datacap.
Provider | Location | Total Deals Sealed | Percentage | Unique Data | Duplicate Deals |
---|---|---|---|---|---|
f01857342new |
Detroit, Michigan, US123.Net, Inc. |
2.94 TiB | 0.96% | 2.84 TiB | 3.19% |
f01154023 | Melbourne, Victoria, AUAnycast Global Backbone |
2.72 TiB | 0.89% | 2.72 TiB | 0.00% |
f01884351new |
Dallas, Texas, USPacket Host, Inc. |
18.41 TiB | 6.02% | 18.41 TiB | 0.00% |
f01927134 | Las Vegas, Nevada, USPiKNiK & Company Inc. |
128.95 TiB | 42.15% | 128.02 TiB | 0.73% |
f01900409new |
San Diego, California, USPiKNiK & Company Inc. |
91.02 TiB | 29.75% | 90.14 TiB | 0.96% |
f01998317 | Las Vegas, Nevada, USPiKNiK & Company Inc. |
61.88 TiB | 20.23% | 61.88 TiB | 0.00% |
The below table shows how each many unique data are replicated across storage providers.
⚠️ 96.40% of deals are for data replicated across less than 4 storage providers.
Unique Data Size | Total Deals Made | Number of Providers | Deal Percentage |
---|---|---|---|
121.34 TiB | 121.53 TiB | 1 | 39.73% |
62.55 TiB | 125.56 TiB | 2 | 41.05% |
15.56 TiB | 47.81 TiB | 3 | 15.63% |
2.72 TiB | 11.00 TiB | 4 | 3.60% |
The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.
However, this could be possible if all below clients use same software to prepare for the exact same dataset or they belong to a series of LDN applications for the same dataset.
✔️ No CID sharing has been observed.
[^1]: To manually trigger this report, add a comment with text checker:manualTrigger
Large Dataset Notary Application
To apply for DataCap to onboard your dataset to Filecoin, please fill out the following.
Core Information
Project details
Share a brief history of your project and organization
What is the primary source of funding for this project?
What other projects/ecosystem stakeholders is this project associated with?
Use-case details
Describe the data being stored onto Filecoin
Where was the data in this dataset sourced from?
Can you share a sample of the data? A link to file would work.
Confirm that this is a public dataset that can be retrieved by anyone on the Network (i.e., no specific permissions or access rights are required to view the data).
What is the expected retrieval frequency for this data?
For how long do you plan to keep this dataset stored on Filecoin?
DataCap allocation plan
In which geographies (countries, regions) do you plan on making storage deals?
How will you be distributing your data to storage providers? Is there an offline data transfer process?
How do you plan on choosing the storage providers with whom you will be making deals? This should include a plan to ensure the data is retrievable in the future both by you and others.
Choosing reputable providers in the community via Filecoin slack or ranking sites. Also looking for SPs that are able to comply with GDPR.
Hosted online (like the sample links provided) for the SPs to download
We have adequate resources and support.