Closed salstorage closed 1 year ago
Thanks for your request!
Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!
Thanks for your request! Everything looks good. :ok_hand:
A Governance Team member will review the information provided and contact you back pretty soon.
As per @dkkapur @galen-mcandrew @simonkim0515 request, original LDN #325 has been deprecated due to inactivity. Delay to #325 was due to internal 'deal API application' Seal Storage Technology is currently developing for this project to share with other SP's assigned to this project. Project is ready, we had already sealed 50TiB DC allocation as per application #325 Seal Storage Technology has been asked to resubmit the LDN in a new application
Thanks for your request!
Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!
Thanks for your request! Everything looks good. :ok_hand:
A Governance Team member will review the information provided and contact you back pretty soon.
Paging @raghavrmadya The DC allocation Request has been approved. Checking DC on wallet ID f1rovtu5m3gq7q5vu4kfh4oiiif643gqq7voi4ida has status: unverified How do we get this resolved?
Seeing exit code 16 here: https://filfox.info/en/message/bafy2bzacea7konkezsnvvqezyu5mtbfgwfxbl7khr6uiamcxd4ilamtx6ztcu
I think that means the notary (in this case the v3 msig) does not have the amount of DataCap available to fill the proposal, even though the proposal was correctly approved by a second signature. The RKH are working to approve more DataCap the to v3 notary. Until that happens, proposals and approvals over the remaining notary balance will fail, and after the v3 gets more DataCap it will require two new notary messages (there's no way currently to point at these above messages and say "please accept those now")
@salstorage , looks like there was some confusion here. As the data is private, we would need you fill out the LDN exceptions template here - https://github.com/filecoin-project/notary-governance/issues/new/choose
Once it's up, we will create a Custom multisig with the supporting notaries and get this rolling based on past reputation and precedence
Custom LDN to be created by Gov team
Thanks for your request!
Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!
Thanks for your request! Everything looks good. :ok_hand:
A Governance Team member will review the information provided and contact you back pretty soon.
Total DataCap requested
2PiB
Expected weekly DataCap usage rate
400TiB
Client address
f1rovtu5m3gq7q5vu4kfh4oiiif643gqq7voi4ida
f01940930
f1rovtu5m3gq7q5vu4kfh4oiiif643gqq7voi4ida
102.39TiB
a8aed019-c936-4c48-aa34-7a396ccf585f
Hello @jamerduhgamer - @Fenbushi-Filecoin , please sign the datacap request
Total DataCap requested
2PiB
Expected weekly DataCap usage rate
400TiB
Client address
f1rovtu5m3gq7q5vu4kfh4oiiif643gqq7voi4ida
f01940930
f1rovtu5m3gq7q5vu4kfh4oiiif643gqq7voi4ida
102.39TiB
b1fd85bb-5327-4989-b2ce-824bb8bcfbed
Hello @MatrixStorage - @swatchliu , please sign the datacap request
Hello - I can confirm a request from the Trust and Transparency WG https://filecoinproject.slack.com/archives/C0405HANNBT/p1670015428087609 that we are adding this application to the E-Fil+ Pilot. Notaries have been tagged. Please review the application and exceptions template for approval. Thank you.
Thanks for the trigger KZ. If community members and notaries have concerns, please post them as a comment on the application.
Total DataCap requested
2PiB
Expected weekly DataCap usage rate
400TiB
Client address
f1rovtu5m3gq7q5vu4kfh4oiiif643gqq7voi4ida
f01940930
f1rovtu5m3gq7q5vu4kfh4oiiif643gqq7voi4ida
102.39TiB
af1d4e7c-8e19-43e2-92cc-0fce0b26aa5e
Hello @Fenbushi-Filecoin - @swatchliu , please sign the datacap request
Your Datacap Allocation Request has been proposed by the Notary
bafy2bzaceappxtau2ecxvwhdcy74gbkmwxxq4qeja3dbfn3og55acfcyfq2ji
Address
f1rovtu5m3gq7q5vu4kfh4oiiif643gqq7voi4ida
Datacap Allocated
102.39TiB
Signer Address
f1krmypm4uoxxf3g7okrwtrahlmpcph3y7rbqqgfa
Id
af1d4e7c-8e19-43e2-92cc-0fce0b26aa5e
You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceappxtau2ecxvwhdcy74gbkmwxxq4qeja3dbfn3og55acfcyfq2ji
Your Datacap Allocation Request has been approved by the Notary
bafy2bzaced4d6jqekag4dhkspxw5z4you25z7nub32btjy5vaf6uy4w4pcqsg
Address
f1rovtu5m3gq7q5vu4kfh4oiiif643gqq7voi4ida
Datacap Allocated
102.39TiB
Signer Address
f1yqydpmqb5en262jpottko2kd65msajax7fi4rmq
Id
af1d4e7c-8e19-43e2-92cc-0fce0b26aa5e
You can check the status of the message here: https://filfox.info/en/message/bafy2bzaced4d6jqekag4dhkspxw5z4you25z7nub32btjy5vaf6uy4w4pcqsg
Seal Storage Technology
f1rovtu5m3gq7q5vu4kfh4oiiif643gqq7voi4ida
The below table shows the distribution of storage providers that have stored data for this client.
If this is the first time a provider takes verified deal, it will be marked as new
.
For most of the datacap application, below restrictions should apply.
⚠️ f01392893 has sealed 52.33% of total datacap.
⚠️ f01886710 has sealed 35.67% of total datacap.
⚠️ f01886710 has unknown IP location.
Provider | Location | Total Deals Sealed | Percentage | Unique Data | Duplicate Deals |
---|---|---|---|---|---|
f01392893 | Amsterdam, North Holland, NL | 4.70 TiB | 52.33% | 4.70 TiB | 0.00% |
f01886710 | Unknown | 3.20 TiB | 35.67% | 3.20 TiB | 0.00% |
f01154023 | Sydney, New South Wales, AU | 1.08 TiB | 12.01% | 1.08 TiB | 0.00% |
The below table shows how each many unique data are replicated across storage providers.
⚠️ 100.00% of deals are for data replicated across less than 4 storage providers.
Unique Data Size | Total Deals Made | Number of Providers | Deal Percentage |
---|---|---|---|
6.61 TiB | 6.61 TiB | 1 | 73.55% |
1.14 TiB | 2.28 TiB | 2 | 25.40% |
32.00 GiB | 96.00 GiB | 3 | 1.04% |
The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.
⚠️ CID sharing has been observed.
Other Client | Application | Total Deals Affected | Unique CIDs | Verifier |
---|---|---|---|---|
f1usscfxtogr5v4jmi32uzkckeql2mgvun72q37ga | Seal Storage Technology | 13.43 TiB | 190 | LDN # 325 |
[^1]: To manually trigger this report, add a comment with text checker:manualTrigger
f01940930
f1rovtu5m3gq7q5vu4kfh4oiiif643gqq7voi4ida
819.19TiB
b7465293-b348-4f58-b269-bb64a7f9cef1
Hello @IPFSUnion - @flyworker , please sign the datacap request
f01940930
f1rovtu5m3gq7q5vu4kfh4oiiif643gqq7voi4ida
Fenbushi-Filecoin & cryptowhizzard
40% of total dc amount requested
819.19TiB
102.38TiB
1.90PiB
Number of deals | Number of storage providers | Previous DC Allocated | Top provider | Remaining DC |
---|---|---|---|---|
2496 | 6 | 102.39TiB | 31.16 | 22.56TiB |
Seal Storage Technology
f1rovtu5m3gq7q5vu4kfh4oiiif643gqq7voi4ida
1
cryptowhizzard1
Fenbushi-Filecoin
The below table shows the distribution of storage providers that have stored data for this client.
If this is the first time a provider takes verified deal, it will be marked as new
.
For most of the datacap application, below restrictions should apply.
⚠️ f01345523 has sealed 31.31% of total datacap.
⚠️ f01392893 has sealed 30.61% of total datacap.
⚠️ f01886710 has unknown IP location.
⚠️ f01923554 has unknown IP location.
Provider | Location | Total Deals Sealed | Percentage | Unique Data | Duplicate Deals |
---|---|---|---|---|---|
f01345523 | Antwerpen, Flanders, BECogent Communications |
23.21 TiB | 31.31% | 23.21 TiB | 0.00% |
f01392893 | Amsterdam, North Holland, NLFusix Networks B.V. |
22.68 TiB | 30.61% | 22.68 TiB | 0.00% |
f01886710 | UnknownUnknown |
14.58 TiB | 19.67% | 13.86 TiB | 4.93% |
f01154023 | Sydney, New South Wales, AUAnycast Global Backbone |
3.23 TiB | 4.36% | 3.23 TiB | 0.00% |
f01873432 | Las Vegas, Nevada, USPiKNiK & Company Inc. |
9.30 TiB | 12.54% | 9.30 TiB | 0.00% |
f01923554 | UnknownUnknown |
1.11 TiB | 1.50% | 1.11 TiB | 0.00% |
The below table shows how each many unique data are replicated across storage providers.
⚠️ 99.66% of deals are for data replicated across less than 4 storage providers.
Unique Data Size | Total Deals Made | Number of Providers | Deal Percentage |
---|---|---|---|
25.40 TiB | 25.43 TiB | 1 | 34.32% |
15.60 TiB | 31.60 TiB | 2 | 42.64% |
5.52 TiB | 16.83 TiB | 3 | 22.71% |
64.00 GiB | 256.00 GiB | 4 | 0.34% |
The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.
However, this could be possible if all below clients use same software to prepare for the exact same dataset or they belong to a series of LDN applications for the same dataset.
⚠️ CID sharing has been observed.
Other Client | Application | Total Deals Affected | Unique CIDs | Approvers |
---|---|---|---|---|
f1usscfxtogr5v4jmi32uzkckeql2mgvun72q37ga | Seal Storage Technology | 31.32 TiB | 495 | 1 dannyob1 TimWilliams00 |
[^1]: To manually trigger this report, add a comment with text checker:manualTrigger
i have difficulties reading the DataCap and CID Checker Report Will there be some guidelines for that? e.g. standards for Fil+ E vs Fil+
CID Checker info is standard for any application, public or private
For most of the datacap application, below restrictions should apply.
Please explain why ⚠️ f01392893 has sealed 52.33% of total datacap.
⚠️ f01886710 has sealed 35.67% of total datacap.
Notes from slack converation: Charles Cao - FilSwan because i think some FIL+ E is allowed for store less than 3 nodes
Charles Cao - FilSwan For most of the datacap application, below restrictions should apply. Storage provider should not exceed 30% of total datacap. Storage provider should not be storing duplicate data for more than 20%. Storage provider should have published its public IP address. All storage providers should be located in different regions.
Charles Cao - FilSwan
if the standard is the same, this request is violated
Kevin Z No, it's not different. However, I do agree with you that E-Fil will generally have 3-5 SPs storing and each node will store one copy before the next. So you might see only one SP until a full copy is completed.
Kevin Z
You will likely not see >30% distribution until all copies are completed, this will be something to take note of (edited)
Kevin Z
Feel free to ask the client applicant if you have questions about their storage plan. It should be stated clearly
Kevin Z From the application: Holon, 400 TiB ElioVP, 400 TiB PikNik, 400 TiB Seal, 800 TiB Seal will also be keeping a hot copy (400 TB) for the Customer available for access. The data ingestion will follow this approximate schedule: 55 TB right away by the end of year 1: 5 TB by end of year 2: 50 TB by end of year 3: 290 TB
For most of the datacap application, below restrictions should apply.
- Storage provider should not exceed 30% of total datacap.
- Storage provider should not be storing duplicate data for more than 20%.
- Storage provider should have published its public IP address.
- All storage providers should be located in different regions.
Please explain why ⚠️ f01392893 has sealed 52.33% of total datacap.
⚠️ f01886710 has sealed 35.67% of total datacap.
@salstorage can you explain current storage status stats and why its not currently split as recommended? Thanks
@flyworker the numbers according to latest stats the breakdown is as follows:
f01345523 | Antwerpen, Flanders, BECogent Communications | 23.21 TiB | 31.31% f01392893 | Amsterdam, North Holland, NLFusix Networks B.V. | 22.68 TiB | 30.61% f01886710 | UnknownUnknown | 14.58 TiB | 19.67% f01154023 | Sydney, New South Wales, AUAnycast Global Backbone | 3.23 TiB | 4.36% f01873432 | Las Vegas, Nevada, USPiKNiK & Company Inc. | 9.30 TiB | 12.54% f01923554 | UnknownUnknown | 1.11 TiB | 1.50%
As a general explanation, we are using a deal distribution API for SP's to ensure Deals are within 30% of total DC. During December/NewYear 2023 break, some SP noted they we taking miners offline (maintenance etc) and this likely caused the the 30% breach.
Thanks @salstorage and actually @flyworker I think you were looking at an older CID Checker report from last month. The most recent is here reflecting sal's stats: https://github.com/filecoin-project/filecoin-plus-large-datasets/issues/1212#issuecomment-1374905000
@kevzak
Paging @IPFSUnion - @flyworker , please sign the datacap request
i am waiting for the fil plus website available
I can load the registry app and see this request, but I'm not sure if the error hits when attempting to sign.
Could you explain why these two nodes cannot be connected? f01923554 and f01886710
Your Datacap Allocation Request has been proposed by the Notary
bafy2bzacebrpjdiirn7mp2jscmrzl4pt4b2ur3jhngaygln33w6bnas3gsms6
Address
f1rovtu5m3gq7q5vu4kfh4oiiif643gqq7voi4ida
Datacap Allocated
819.19TiB
Signer Address
f1hlubjsdkv4wmsdadihloxgwrz3j3ernf6i3cbpy
Id
b7465293-b348-4f58-b269-bb64a7f9cef1
You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebrpjdiirn7mp2jscmrzl4pt4b2ur3jhngaygln33w6bnas3gsms6
Could you explain why these two nodes cannot be connected? f01923554 and f01886710
@salstorage can you reply to @UnionLabs2020?
checker:manualTrigger
Seal Storage Technology
f1rovtu5m3gq7q5vu4kfh4oiiif643gqq7voi4ida
1
cryptowhizzard1
Fenbushi-Filecoin1
flyworker
The below table shows the distribution of storage providers that have stored data for this client.
If this is the first time a provider takes verified deal, it will be marked as new
.
For most of the datacap application, below restrictions should apply.
⚠️ f01886710 has sealed 35.80% of total datacap.
⚠️ f01886710 has unknown IP location.
⚠️ f01923554 has unknown IP location.
Provider | Location | Total Deals Sealed | Percentage | Unique Data | Duplicate Deals |
---|---|---|---|---|---|
f01886710 | UnknownUnknown |
33.25 TiB | 35.80% | 32.53 TiB | 2.16% |
f01154023 | Melbourne, Victoria, AUAnycast Global Backbone |
3.23 TiB | 3.48% | 3.23 TiB | 0.00% |
f01345523 | Antwerpen, Flanders, BECogent Communications |
23.21 TiB | 24.99% | 23.21 TiB | 0.00% |
f01392893 | Amsterdam, North Holland, NLFusix Networks B.V. |
22.78 TiB | 24.52% | 22.78 TiB | 0.00% |
f01873432 | Las Vegas, Nevada, USPiKNiK & Company Inc. |
9.30 TiB | 10.01% | 9.30 TiB | 0.00% |
f01923554 | UnknownUnknown |
1.11 TiB | 1.19% | 1.11 TiB | 0.00% |
The below table shows how each many unique data are replicated across storage providers.
⚠️ 99.73% of deals are for data replicated across less than 4 storage providers.
Unique Data Size | Total Deals Made | Number of Providers | Deal Percentage |
---|---|---|---|
8.59 TiB | 8.62 TiB | 1 | 9.28% |
30.74 TiB | 61.88 TiB | 2 | 66.63% |
7.28 TiB | 22.13 TiB | 3 | 23.82% |
64.00 GiB | 256.00 GiB | 4 | 0.27% |
The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.
However, this could be possible if all below clients use same software to prepare for the exact same dataset or they belong to a series of LDN applications for the same dataset.
⚠️ CID sharing has been observed.
Other Client | Application | Total Deals Affected | Unique CIDs | Approvers |
---|---|---|---|---|
f1usscfxtogr5v4jmi32uzkckeql2mgvun72q37ga | Seal Storage Technology | 31.32 TiB | 495 | 1 dannyob1 TimWilliams00 |
[^1]: To manually trigger this report, add a comment with text checker:manualTrigger
checker:manualTrigger
Seal Storage Technology
f1rovtu5m3gq7q5vu4kfh4oiiif643gqq7voi4ida
1
cryptowhizzard1
Fenbushi-Filecoin1
flyworker
The below table shows the distribution of storage providers that have stored data for this client.
If this is the first time a provider takes verified deal, it will be marked as new
.
For most of the datacap application, below restrictions should apply.
⚠️ f01886710 has sealed 35.80% of total datacap.
⚠️ f01923554 has unknown IP location.
Provider | Location | Total Deals Sealed | Percentage | Unique Data | Duplicate Deals |
---|---|---|---|---|---|
f01154023 | Melbourne, Victoria, AUAnycast Global Backbone |
3.23 TiB | 3.48% | 3.23 TiB | 0.00% |
f01345523 | Antwerpen, Flanders, BECogent Communications |
23.21 TiB | 24.99% | 23.21 TiB | 0.00% |
f01392893 | Amsterdam, North Holland, NLFusix Networks B.V. |
22.78 TiB | 24.52% | 22.78 TiB | 0.00% |
f01886710 | Las Vegas, Nevada, USGTT Communications Inc. |
33.25 TiB | 35.80% | 32.53 TiB | 2.16% |
f01873432 | Las Vegas, Nevada, USPiKNiK & Company Inc. |
9.30 TiB | 10.01% | 9.30 TiB | 0.00% |
f01923554 | UnknownUnknown |
1.11 TiB | 1.19% | 1.11 TiB | 0.00% |
The below table shows how each many unique data are replicated across storage providers.
⚠️ 99.73% of deals are for data replicated across less than 4 storage providers.
Unique Data Size | Total Deals Made | Number of Providers | Deal Percentage |
---|---|---|---|
8.59 TiB | 8.62 TiB | 1 | 9.28% |
30.74 TiB | 61.88 TiB | 2 | 66.63% |
7.28 TiB | 22.13 TiB | 3 | 23.82% |
64.00 GiB | 256.00 GiB | 4 | 0.27% |
The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.
However, this could be possible if all below clients use same software to prepare for the exact same dataset or they belong to a series of LDN applications for the same dataset.
⚠️ CID sharing has been observed.
Other Client | Application | Total Deals Affected | Unique CIDs | Approvers |
---|---|---|---|---|
f1usscfxtogr5v4jmi32uzkckeql2mgvun72q37ga | Seal Storage Technology | 31.32 TiB | 495 | 1 dannyob1 TimWilliams00 |
[^1]: To manually trigger this report, add a comment with text checker:manualTrigger
checker:manualTrigger
Seal Storage Technology
f1rovtu5m3gq7q5vu4kfh4oiiif643gqq7voi4ida
1
cryptowhizzard1
Fenbushi-Filecoin1
flyworker
The below table shows the distribution of storage providers that have stored data for this client.
If this is the first time a provider takes verified deal, it will be marked as new
.
For most of the datacap application, below restrictions should apply.
⚠️ f01886710 has sealed 35.80% of total datacap.
Provider | Location | Total Deals Sealed | Percentage | Unique Data | Duplicate Deals |
---|---|---|---|---|---|
f01154023 | Melbourne, Victoria, AUAnycast Global Backbone |
3.23 TiB | 3.48% | 3.23 TiB | 0.00% |
f01345523 | Antwerpen, Flanders, BECogent Communications |
23.21 TiB | 24.99% | 23.21 TiB | 0.00% |
f01392893 | Amsterdam, North Holland, NLFusix Networks B.V. |
22.78 TiB | 24.52% | 22.78 TiB | 0.00% |
f01886710 | Las Vegas, Nevada, USGTT Communications Inc. |
33.25 TiB | 35.80% | 32.53 TiB | 2.16% |
f01923554 | Las Vegas, Nevada, USGTT Communications Inc. |
1.11 TiB | 1.19% | 1.11 TiB | 0.00% |
f01873432 | Las Vegas, Nevada, USPiKNiK & Company Inc. |
9.30 TiB | 10.01% | 9.30 TiB | 0.00% |
The below table shows how each many unique data are replicated across storage providers.
⚠️ 99.73% of deals are for data replicated across less than 4 storage providers.
Unique Data Size | Total Deals Made | Number of Providers | Deal Percentage |
---|---|---|---|
8.59 TiB | 8.62 TiB | 1 | 9.28% |
30.74 TiB | 61.88 TiB | 2 | 66.63% |
7.28 TiB | 22.13 TiB | 3 | 23.82% |
64.00 GiB | 256.00 GiB | 4 | 0.27% |
The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.
However, this could be possible if all below clients use same software to prepare for the exact same dataset or they belong to a series of LDN applications for the same dataset.
⚠️ CID sharing has been observed.
Other Client | Application | Total Deals Affected | Unique CIDs | Approvers |
---|---|---|---|---|
f1usscfxtogr5v4jmi32uzkckeql2mgvun72q37ga | Seal Storage Technology | 31.32 TiB | 495 | 1 dannyob1 TimWilliams00 |
[^1]: To manually trigger this report, add a comment with text checker:manualTrigger
Could you explain why these two nodes cannot be connected? f01923554 and f01886710
@salstorage can you reply to @UnionLabs2020?
@UnionLabs2020 @Kevin-FF-USA
We have resolved the location ID's, we believe it was a bug in Lotus and we had to run actor set-addrs on miner to fix it Can we please get this signed?
Large Dataset Notary Application
To apply for DataCap to onboard your dataset to Filecoin, please fill out the following.
Core Information
Please respond to the questions below by replacing the text saying "Please answer here". Include as much detail as you can in your answer.
Project details
Share a brief history of your project and organization.
What is the primary source of funding for this project?
What other projects/ecosystem stakeholders is this project associated with?
Use-case details
Describe the data being stored onto Filecoin
Where was the data in this dataset sourced from?
Can you share a sample of the data? A link to a file, an image, a table, etc., are good ways to do this.
Confirm that this is a public dataset that can be retrieved by anyone on the Network (i.e., no specific permissions or access rights are required to view the data).
What is the expected retrieval frequency for this data?
For how long do you plan to keep this dataset stored on Filecoin?
DataCap allocation plan
In which geographies (countries, regions) do you plan on making storage deals?
How will you be distributing your data to storage providers? Is there an offline data transfer process?
How do you plan on choosing the storage providers with whom you will be making deals? This should include a plan to ensure the data is retrievable in the future both by you and others.
How will you be distributing deals across storage providers?
Do you have the resources/funding to start making deals as soon as you receive DataCap? What support from the community would help you onboard onto Filecoin?