Closed JackRipper1888 closed 1 year ago
Thanks for your request!
Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!
Thanks for your request! Everything looks good. :ok_hand:
A Governance Team member will review the information provided and contact you back pretty soon.
@JackRipper1888 , what is your relationship with the client?
Thanks for your question. I am applying on behalf of organization and we would like to join filecoin to reduce our costs. If you need, I can use the official mailbox of the company domain name to send the certification information
We have sent a verification email to filplus@fil.org . Hope to get feedback, we want to join Filecoin. Thank you @raghavrmadya
Can you explain your data composition? And to provide more data samples related with data you will store to prove that you have 5 PB already. How many copies will you store? Can you provide more detailed information about other storage providers participated in this program, such as you can list SPs you have contacted with at present? Could you send an email to filplus-app-review@fil.org with your official domain in order to confirm your identity? Email name should includes the issue id #916.
Any update here?
Hello, the data consists of: desensitized medical image data and desensitized archival data. We store data to multiple storage providers and store 4-5 backups to ensure reliable data storage. Also, we are preparing new sample data, which will be published later. We sent a verification email:
@Sunnyiscoming @raghavrmadya We have added sample data: https://drive.google.com/drive/folders/1P6sPZOPMh3EiKzpEDExqraR04Cv-8Q0W. Hope to make progress, thanks
@raghavrmadya @Sunnyiscoming Hi, is there an update? looking forward to being approved, thanks
@JackRipper1888 Sorry for delaying. Email received. Can you provide more detailed information about other storage providers participated in this program, such as you can list SPs you have contacted with at present?
@Sunnyiscoming Hi, thanks for your reply. We have only communicated with f01851482 f01852325 f01915287 f01907545 so far. And we are still looking for SP, our allocation strategy will fully meet the requirements of the community, thanks again, looking forward to progress!
Total DataCap requested
5PiB
Expected weekly DataCap usage rate
400TiB
Client address
f1s72ymkzujzb5hnxfaqkgekn37nbisu4pc26eh3i
f01858410
f1s72ymkzujzb5hnxfaqkgekn37nbisu4pc26eh3i
200TiB
e612bb9f-86df-49a6-98d2-04a4ecef1e87
@JackRipper1888 what regions are these SPs that you listed? And can you specify how you meet the requirements of the community?
@kernelogic Hello, we plan to store data in Hong Kong/Singapore/Korea, etc., we have contacted the following SP: f01852023, f01964002, f01852664, f01967473, f01851482, we will cooperate further. For our data security and according to community rules, we evenly distribute our data to multiple SPs. thanks
Your Datacap Allocation Request has been proposed by the Notary
bafy2bzaceaprtymgdgmn4wnhzsax2kmlgbq2ewtxbfg7fpsuazw5egbr4lpmw
Address
f1s72ymkzujzb5hnxfaqkgekn37nbisu4pc26eh3i
Datacap Allocated
200.00TiB
Signer Address
f1yjhnsoga2ccnepb7t3p3ov5fzom3syhsuinxexa
Id
e612bb9f-86df-49a6-98d2-04a4ecef1e87
You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceaprtymgdgmn4wnhzsax2kmlgbq2ewtxbfg7fpsuazw5egbr4lpmw
it looks good i will sign him
Your Datacap Allocation Request has been approved by the Notary
bafy2bzacededesv6uyrgsstptbtomoj6jffcoz35f6a52a4yrga2nt5v7uzli
Address
f1s72ymkzujzb5hnxfaqkgekn37nbisu4pc26eh3i
Datacap Allocated
200.00TiB
Signer Address
f1q6bpjlqia6iemqbrdaxr2uehrhpvoju3qh4lpga
Id
e612bb9f-86df-49a6-98d2-04a4ecef1e87
You can check the status of the message here: https://filfox.info/en/message/bafy2bzacededesv6uyrgsstptbtomoj6jffcoz35f6a52a4yrga2nt5v7uzli
Is there any problem with using datacap?
We are preparing data, and communicating with SPs, I think it will start soon, thank you for your attention @Sunnyiscoming
f01858410
f1s72ymkzujzb5hnxfaqkgekn37nbisu4pc26eh3i
400TiB
e797fcac-eebd-4507-b203-4650e7641790
f01858410
f1s72ymkzujzb5hnxfaqkgekn37nbisu4pc26eh3i
llifezou & kernelogic
100% of weekly dc amount requested
400TiB
200TiB
4.80PiB
Number of deals | Number of storage providers | Previous DC Allocated | Top provider | Remaining DC |
---|---|---|---|---|
400 | 5 | 200TiB | 22.5 | 5.71TiB |
IINDA
f1s72ymkzujzb5hnxfaqkgekn37nbisu4pc26eh3i
1
kernelogic1
Tom-OriginStorage
The below table shows the distribution of storage providers that have stored data for this client.
If this is the first time a provider takes verified deal, it will be marked as new
.
For most of the datacap application, below restrictions should apply.
Since this is the 3rd allocation, the following restrictions have been relaxed:
✔️ Storage provider distribution looks healthy.
Provider | Location | Total Deals Sealed | Percentage | Unique Data | Duplicate Deals |
---|---|---|---|---|---|
f02006841 | Petaling Jaya, Selangor, MYCelcom Axiata Berhad |
24.00 TiB | 22.17% | 24.00 TiB | 0.00% |
f01914268 | Frankfurt am Main, Hesse, DEQUANTIL NETWORKS INC |
22.78 TiB | 21.05% | 22.78 TiB | 0.00% |
f01896036 | New York City, New York, USQUANTIL NETWORKS INC |
17.56 TiB | 16.22% | 17.56 TiB | 0.00% |
f02024315 | Bangkok, Bangkok, THSBN-IIG/AWN-IIG transit provider |
24.41 TiB | 22.55% | 24.41 TiB | 0.00% |
f02013434 | Hanoi, Hanoi, VNVIETNAM POSTS AND TELECOMMUNICATIONS GROUP |
19.50 TiB | 18.01% | 19.50 TiB | 0.00% |
The below table shows how each many unique data are replicated across storage providers.
Since this is the 3rd allocation, the following restrictions have been relaxed:
✔️ Data replication looks healthy.
Unique Data Size | Total Deals Made | Number of Providers | Deal Percentage |
---|---|---|---|
1.41 TiB | 1.41 TiB | 1 | 1.30% |
1.09 TiB | 2.19 TiB | 2 | 2.02% |
2.19 TiB | 6.56 TiB | 3 | 6.06% |
6.44 TiB | 25.75 TiB | 4 | 23.79% |
14.47 TiB | 72.34 TiB | 5 | 66.83% |
The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.
However, this could be possible if all below clients use same software to prepare for the exact same dataset or they belong to a series of LDN applications for the same dataset.
✔️ No CID sharing has been observed.
[^1]: To manually trigger this report, add a comment with text checker:manualTrigger
CID report looks good, i will suport it
CID report looks good, i will suport it
Retrieval?
The following request has been canceled by the notary, thus should not be considered as valid anymore.
bafy2bzaceckgys7qumkjiwl4mevze5ysqu6zyeenbok6ogujkn7tj3cikez3o
Address
f1s72ymkzujzb5hnxfaqkgekn37nbisu4pc26eh3i
Datacap Allocated
400.00TiB
Signer Address
f1mdk7s2vntzm6hu35yuo6vjubtrpfnb2awhgvrri
You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceckgys7qumkjiwl4mevze5ysqu6zyeenbok6ogujkn7tj3cikez3o
@1ane-1
Did you test retrieval?
@1ane-1
I tested retrieval for you. This SP's don't support it.
Feb 7 07:35:04 proposals dealscanner-f01980914-f01970716: Recv 0 B, Paid 0 FIL, Open (New), 0s [1675554614710751788|0] Feb 7 07:35:04 proposals dealscanner-f01980914-f01970716: Recv 0 B, Paid 0 FIL, DealProposed (WaitForAcceptance), 3ms [1675554614710751788|0] Feb 7 07:35:04 proposals dealscanner-f01980914-f01128320: Recv 0 B, Paid 0 FIL, Open (New), 0s [1675554614710751789|0] Feb 7 07:35:04 proposals dealscanner-f01980914-f01128320: Recv 0 B, Paid 0 FIL, DealProposed (WaitForAcceptance), 3ms [1675554614710751789|0] Feb 7 07:35:05 proposals dealscanner-f01980914-f01970716: Recv 0 B, Paid 0 FIL, DealAccepted (Accepted), 632ms [1675554614710751788|0] Feb 7 07:35:05 proposals dealscanner-f01980914-f01970716: Recv 0 B, Paid 0 FIL, PaymentChannelSkip (Ongoing), 633ms [1675554614710751788|0] Feb 7 07:35:07 proposals dealscanner-f01980914-f01970716: Recv 0 B, Paid 0 FIL, ProviderCancelled (Cancelling), 3.142s [1675554614710751788|0] Feb 7 07:35:07 proposals dealscanner-f01980914-f01970716: Recv 0 B, Paid 0 FIL, CancelComplete (Cancelled), 3.143s [1675554614710751788|0]
@cryptowhizzard I cancel the signature for further confirmation. Firstly i did the retrieval. Now it need to confirm again.
I have no problem using lotus to retrieve data. What tool or CID are you using
Your cid data is wrong. It doesn't belong to our project
Cleaned up my comments. Indeed there was a bug in the retrieval script. Sorry for that. I fixed it and am re-testing as we speak.
Thanks for checking, are you a notary? Can you sign it for me?
Thanks for checking, are you a notary? Can you sign it for me?
Yes i am a notary. When i finished checking i will make my decision.
Hi,
f01896036 -> ERROR: failed to find offer satisfying maxPrice: 0 FIL. Try increasing maxPrice
I have contacted this SP to make adjustments and can try again
I did so, however the retrieval is painfully slow. It will take 72 hours to download the carfile. When i have it i will evaluate it.
hi cryptowhizzard I confirmed to SPs that their searches are normal, if you have time, please help me approve @cryptowhizzard
Received dm from this client. Has done review, SPs are normal.
Your Datacap Allocation Request has been proposed by the Notary
bafy2bzaceahxm6yh7k3plvox7yquio7urz7tkfehp7eui2esrirrrr6pccody
Address
f1s72ymkzujzb5hnxfaqkgekn37nbisu4pc26eh3i
Datacap Allocated
400.00TiB
Signer Address
f1yayfsv6whu3rheviucvventj3y6t542xfpb47ei
Id
e797fcac-eebd-4507-b203-4650e7641790
You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceahxm6yh7k3plvox7yquio7urz7tkfehp7eui2esrirrrr6pccody
@NDLABS-OFFICE As stated during multiple governance calls you were asked not to sign any applications, and first do your due diligence on 50 new applications. I am surprised to see you signing this application and would kindly suggest to revert your signature.
Due diligence is not what you performed and your statement "Has done review, SPs are normal." is not sufficient.
For transparency tagging: @cryptowhizzard @raghavrmadya @dkkapur @galen-mcandrew @Sunnyiscoming
@herrehesse Hi, as I said to Hid, we are also in the meeting, we can review and sign as normal. In addition, about collecting sp information during due diligence, today we will ask questions at the notary meeting, and we can communicate with the governance team at the notary meeting.
This is not correct. You were asked not to sign and do due diligence on 50 applications.
This is a huge violation and should not be taken lightly.
@herrehesse There may be some misunderstanding here, I hope the results will be discussed at the notary meeting today. And is your slack account Wijnand Schouten this?
@NDLABS-OFFICE No misunderstanding, we had this talk privately and you know that @raghavrmadya asked to hold off with signing any applications and do your due diligence on 50 applications.
I suggest to remove your signature from this application.
@herrehesse I have repeatedly confirmed that we can review and sign normally. RG proposed in slack that we should review the LDN more, but it did not explicitly say that we cannot sign. In addition, what doubts do you have about the current LDN?
This application is so clearly abusive I can't even......
They state "Hongkong" as their only storage region, and hence we can see global distribution.
All of which is achieved by VPN.
@cryptowhizzard stated to be evaluating the data, and you quickly sign before he could get back with results.
Did you ask any question about who the SP's are and what businesses they run?
Do I need to continue?
@herrehesse As I mentioned just now, each notary will have its own review method. The governance team also said that notaries need to conduct review according to their own original rules. You can have your own review method, and so can we. In addition, this issue can be discussed in depth and concluded tonight. You can also ask this question at the meeting. Thanks.
Retrieval + data verified.
Large Dataset Notary Application
To apply for DataCap to onboard your dataset to Filecoin, please fill out the following.
Core Information
Please respond to the questions below by replacing the text saying "Please answer here". Include as much detail as you can in your answer.
Project details
Share a brief history of your project and organization.
What is the primary source of funding for this project?
What other projects/ecosystem stakeholders is this project associated with?
Use-case details
Describe the data being stored onto Filecoin
Where was the data in this dataset sourced from?
Can you share a sample of the data? A link to a file, an image, a table, etc., are good ways to do this.
Confirm that this is a public dataset that can be retrieved by anyone on the Network (i.e., no specific permissions or access rights are required to view the data).
What is the expected retrieval frequency for this data?
For how long do you plan to keep this dataset stored on Filecoin?
DataCap allocation plan
In which geographies (countries, regions) do you plan on making storage deals?
How will you be distributing your data to storage providers? Is there an offline data transfer process?
How do you plan on choosing the storage providers with whom you will be making deals? This should include a plan to ensure the data is retrievable in the future both by you and others.
How will you be distributing deals across storage providers?
Do you have the resources/funding to start making deals as soon as you receive DataCap? What support from the community would help you onboard onto Filecoin?