Closed NDLABS-Leo closed 11 months ago
Thanks for your request! Everything looks good. :ok_hand:
A Governance Team member will review the information provided and contact you back pretty soon.
As a longstanding member of the community, we strive to strictly adhere to community guidelines.
The European Space Agency Science Data Center project is an independent and open initiative, with its data content being publicly accessible and holding value for humanity.
Therefore, we aim to take a leadership role as an SP in storing and backing up this data. We will reach out to at least five or more retrieval-supporting SPs in different regions, all of whom have been previously validated for retrieval in other projects.
Additionally, we will gradually shift the focus of retrieval proportions towards HTTP retrieval. Furthermore, we are committed to strictly prohibiting the use of VPN. We hope to gain the support of the community members and notary nodes in this endeavor.
@NDLABS-OFFICE If the data is authentic, the storage providers are distributed, known and trustworthy actors, and the ability to retrieve information is ensured, I can't find any reason why I shouldn't support you and use this LDN as a model for others to follow.
@Sunnyiscoming Please help us to review.
Best practice for storing large datasets includes ideally, storing it in 3 or more regions, with 4 or more storage provider operators or owners. You should list Miner ID, Business Entity, Location of sps you will cooperate with.
@Sunnyiscoming Hi,Sun.
Thanks for the reply. The rules of fil+ we understand, so we also contacted a lot of great sp to work with, here is their information:
f02216271 Hong Kong, Central and Western, HK ANLIAN NETWORK TECHNOLOGY CO., LIMITED
f02194766 Chengdu, Sichuan, CN CHINA UNICOM China169 Backbone
f0433690 Beijing, Beijing, CN CHINA UNICOM China169 Backbone
f02201020 Shenzhen, Guangdong, CN CHINANET-BACKBONE
f02037700 Seoul, Seoul, KR Korea Telecom
f02115125 Seoul, Seoul, KR Korea Telecom
f01834291 Los Angeles, California, US Zenlayer Inc
f01834253 Los Angeles, California, US Zenlayer Inc
f01854772 Los Angeles, California, US Zenlayer Inc
f01854080 Los Angeles, California, US Zenlayer Inc
- Have you prepared enough token for sector pledge?
- Are you a data preparer? What is your previous experience as a data-preparer? List previous applications and client IDs
- How will the data be prepared? Please include tooling used and technical details
- If you are not preparing the data, who will prepare the data? (Name and Business)
- Has this dataset been stored on Filecoin before? If so, why are you choosing to store it again?
@Sunnyiscoming
Hello @NDLABS-Leo per the new guidelines https://github.com/filecoin-project/notary-governance/issues/922 for Open Dataset applicants, please complete the following Fil+ registration form to identify yourself as the applicant and also please add the contact information of the SP entities you are working with to store copies of the data.
This information will be reviewed by Fil+ Governance team to confirm validity toward the Fil+ guideline of a distributed storage plan and then the application will be triggered for notary review. Let us know if you have any questions.
@Filplus-govteam Thanks for your work, the form I have submitted.
Hi @NDLABS-Leo - haven't seen any form submission from your side.
But because you are a known actor in Fil+, perhaps we can just ask here that you share more detail about the SP entities you are working with.
I see the list above https://github.com/filecoin-project/filecoin-plus-large-datasets/issues/2084#issuecomment-1633509267
But for example, Zenlayer Inc is a VPN service name and I'm assuming that SP is not located in Los Angeles.
Can you share actual entities names and locations showing distribution? That is the core of what we're asking. Thank you.
@Filplus-govteam I confirm that I have submitted the form. Are there any systemic issues?
Furthermore, I must express my disagreement with the term "a known actor in Fil+." As an official auditor, we hold the utmost respect for you, and we hope you will handle the matter with fairness, transparency, and impartiality, without any bias.
Below are the SP nodes, geographical locations, and institutional names we are planning to collaborate with: Furthermore, we do not use VPN. You can conduct VPN testing to verify this.
[f02224274 Hong Kong, Central and Western, HK The Nine
f02148382 Nanjing, Jiangsu, CN Dako Technical
f01853077 Singapore, Singapore, SG Alpha100
f0433690 Nanjing, Jiangsu, CN polka dot
f01854772 Los Angeles, California, US Fiset]
@NDLABS-Leo - sorry for any confusion. We only meant to say that you are a known identity in the Fil+ community. You've been a notary, been on calls, been at events. And because of this fact, it essentially checks the box for KYC for your GitHub handle.
With that said, it looks like you also shared SP entity information. That is all that is asked. Notaries can now use this information to complete due diligence. Thank you!
Total DataCap requested
15PiB
Expected weekly DataCap usage rate
1PiB
Client address
f1al3yt24a3gp6slrc52jfdcrtb7bmvsspttqsnmq
f02049625
f1al3yt24a3gp6slrc52jfdcrtb7bmvsspttqsnmq
512TiB
6e7f5c3e-c4be-4dff-87a8-e4b630a114b5
@Filplus-govteam Thank you for your work, and we want to express our respect to you.
https://github.com/filecoin-project/filecoin-plus-large-datasets/issues/2084#issuecomment-1633509267
great plan, the first round I am willing to support it. The fast-retrieval will be available? @NDLABS-Leo
@Normalnoise Yes, we store an index of the data, which helps us find the data quickly. And we support http search.
Your Datacap Allocation Request has been proposed by the Notary
bafy2bzaced7togp5t747n4i423ni34hy6idfkz76mkzcf2bkkfm6yyrmlz27w
Address
f1al3yt24a3gp6slrc52jfdcrtb7bmvsspttqsnmq
Datacap Allocated
512.00TiB
Signer Address
f1cjzbiy5xd4ehera4wmbz63pd5ku4oo7g52cldga
Id
6e7f5c3e-c4be-4dff-87a8-e4b630a114b5
You can check the status of the message here: https://filfox.info/en/message/bafy2bzaced7togp5t747n4i423ni34hy6idfkz76mkzcf2bkkfm6yyrmlz27w
Your Datacap Allocation Request has been approved by the Notary
bafy2bzaceddflgjlpx2yupvh67hjllmrp7qlskjwmr7zclke2ztqvc7om5vua
Address
f1al3yt24a3gp6slrc52jfdcrtb7bmvsspttqsnmq
Datacap Allocated
512.00TiB
Signer Address
f1ui5iy4mmkxjbw7752omiwp2ols2fzv4thrayagi
Id
6e7f5c3e-c4be-4dff-87a8-e4b630a114b5
You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceddflgjlpx2yupvh67hjllmrp7qlskjwmr7zclke2ztqvc7om5vua
Hello I want to make one point. Just using a quick search we can see that f01854772 was involved in 12+ applications storing duplicate deal data in the past, here are some examples: https://github.com/filecoin-project/filecoin-plus-large-datasets/issues/767 https://github.com/filecoin-project/filecoin-plus-large-datasets/issues/882 https://github.com/filecoin-project/filecoin-plus-large-datasets/issues/1469
f01854772 the same thing
@NDLABS-Leo please confirm you are working with SPs that will store data properly and make retrievable. We will be looking to review first allocations to confirm this.
For the record:
f01854772 is flagged in my system on #962
Just to re-confirm the process here @NDLABS-Leo - after storage is complete we will ask notaries to:
@cryptowhizzard @Filplus-govteam
Thanks for the reminder that the f01854772 node, since it is controversial, we will not be working with it.
Just to re-confirm the process here @NDLABS-Leo - after storage is complete we will ask notaries to:
- Confirm SP IDs and locations match your plan
- Confirm data is retrievable and data sample matches said datasets
100 per cent agreement
checker:manualTrigger
✔️ Storage provider distribution looks healthy.
⚠️ 100.00% of deals are for data replicated across less than 2 storage providers.
✔️ No CID sharing has been observed.
[^1]: To manually trigger this report, add a comment with text checker:manualTrigger
[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger
[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...
Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.
f02049625
f1al3yt24a3gp6slrc52jfdcrtb7bmvsspttqsnmq
512TiB
078580f2-3edb-455b-bcbf-4719bca455c9
f02049625
f1al3yt24a3gp6slrc52jfdcrtb7bmvsspttqsnmq
100% weekly > 0.5PiB, requesting 0.5PiB
512TiB
512TiB
14.5PiB
Number of deals | Number of storage providers | Previous DC Allocated | Top provider | Remaining DC |
---|---|---|---|---|
9542 | 9 | 512TiB | 21.11 | 127.31TiB |
checker:manualTrigger
✔️ Storage provider distribution looks healthy.
✔️ Data replication looks healthy.
✔️ No CID sharing has been observed.
[^1]: To manually trigger this report, add a comment with text checker:manualTrigger
[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger
[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...
Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.
Judging from previous communication from this thread and the CID report, I am willing to support.
Your Datacap Allocation Request has been proposed by the Notary
bafy2bzaceb6ujdwfelnk44u3snnn3ej4w4s2myaziqn2aa72h4shzb5viahb4
Address
f1al3yt24a3gp6slrc52jfdcrtb7bmvsspttqsnmq
Datacap Allocated
512.00TiB
Signer Address
f1yjhnsoga2ccnepb7t3p3ov5fzom3syhsuinxexa
Id
078580f2-3edb-455b-bcbf-4719bca455c9
You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceb6ujdwfelnk44u3snnn3ej4w4s2myaziqn2aa72h4shzb5viahb4
"Overall HTTP retrieval success rate: 59.67%"
High retrieval success rate and Report looks good to me , Will support
Your Datacap Allocation Request has been approved by the Notary
bafy2bzaceaucacx6ey4xpe6xnkrj4noeomh2k4cp4g7kkjrmnqch6lmnvw5hg
Address
f1al3yt24a3gp6slrc52jfdcrtb7bmvsspttqsnmq
Datacap Allocated
512.00TiB
Signer Address
f12tk3adljauwnd3hjbigpfxb7b7gdlj63p6afwtq
Id
078580f2-3edb-455b-bcbf-4719bca455c9
You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceaucacx6ey4xpe6xnkrj4noeomh2k4cp4g7kkjrmnqch6lmnvw5hg
f02049625
f1al3yt24a3gp6slrc52jfdcrtb7bmvsspttqsnmq
1PiB
b512daf2-507d-4163-8be6-44fa741547e2
f02049625
f1al3yt24a3gp6slrc52jfdcrtb7bmvsspttqsnmq
200% weekly > 1PiB, requesting 1PiB
1PiB
465661.3YiB
465661.3YiB
Number of deals | Number of storage providers | Previous DC Allocated | Top provider | Remaining DC |
---|---|---|---|---|
26041 | 11 | 512TiB | 13.99 | 129.03TiB |
checker:manualTrigger
✔️ Storage provider distribution looks healthy.
✔️ Data replication looks healthy.
✔️ No CID sharing has been observed.
[^1]: To manually trigger this report, add a comment with text checker:manualTrigger
[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger
[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...
Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.
Looking at the report of this project, the distribution of SPs, the number of SPs and the HTTP retrieval rate are relatively good, and the number of data backups needs to be increased in the future. I will support this round.
Your Datacap Allocation Request has been proposed by the Notary
bafy2bzaceclaniv3yjfwbxi2ecufpqxli5fso53eiunipjevq7ypw73p4cysm
Address
f1al3yt24a3gp6slrc52jfdcrtb7bmvsspttqsnmq
Datacap Allocated
1.00PiB
Signer Address
f1foiomqlmoshpuxm6aie4xysffqezkjnokgwcecq
Id
b512daf2-507d-4163-8be6-44fa741547e2
You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceclaniv3yjfwbxi2ecufpqxli5fso53eiunipjevq7ypw73p4cysm
checker:manualTrigger
✔️ Storage provider distribution looks healthy.
✔️ Data replication looks healthy.
✔️ No CID sharing has been observed.
[^1]: To manually trigger this report, add a comment with text checker:manualTrigger
[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger
[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...
Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.
Project looks healthy, no problem with retrieval, willing to support this round.
Your Datacap Allocation Request has been approved by the Notary
bafy2bzaceapdmo6uaqxzacyvouenic7j2as5qurvokhn6sfmugdium25ew5ga
Address
f1al3yt24a3gp6slrc52jfdcrtb7bmvsspttqsnmq
Datacap Allocated
1.00PiB
Signer Address
f1nwjsd2mc6hu4qrwnmd6ukrfkuu4h5fhs7u3exii
Id
b512daf2-507d-4163-8be6-44fa741547e2
You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceapdmo6uaqxzacyvouenic7j2as5qurvokhn6sfmugdium25ew5ga
SP Entities submitted: f02224274 Hong Kong, Central and Western, HK The Nine f02148382 Nanjing, Jiangsu, CN Dako Technical f01853077 Singapore, Singapore, SG Alpha100 f0433690 Nanjing, Jiangsu, CN polka dot f01854772 Los Angeles, California, US Fiset (said they would not store with this SP)
CID REPORT ACTUAL SPs f02328179 | Chengdu, Sichuan, CNCHINA UNICOM China169 Backbone | 64.59 TiB | 8.18% | 64.59 TiB | 0.00% f0433690 | Nanjing, Jiangsu, CNCHINA UNICOM China169 Backbone | 21.50 TiB | 2.72% | 21.50 TiB | 0.00% f02274508 | Hong Kong, Central and Western, HKChina Unicom Global | 61.22 TiB | 7.75% | 61.22 TiB | 0.00% f02226892 | Shenzhen, Guangdong, CNCHINANET-BACKBONE | 66.75 TiB | 8.45% | 66.75 TiB | 0.00% f02037700 | Seoul, Seoul, KRKorea Telecom | 70.00 TiB | 8.86% | 70.00 TiB | 0.00% f02322031 | Los Angeles, California, USZenlayer Inc | 107.13 TiB | 13.56% | 107.13 TiB | 0.00% f02320270 | Los Angeles, California, USZenlayer Inc | 106.47 TiB | 13.48% | 106.47 TiB | 0.00% f02327534 | Los Angeles, California, USZenlayer Inc | 104.88 TiB | 13.28% | 104.88 TiB | 0.00% f02320312 | Los Angeles, California, USZenlayer Inc | 103.59 TiB | 13.12% | 103.59 TiB | 0.00% f02321504 | Los Angeles, California, USZenlayer Inc | 81.66 TiB | 10.34% | 81.66 TiB | 0.00% f01834291 | Los Angeles, California, USZenlayer Inc | 1.94 TiB | 0.25% | 1.94 TiB | 0.00%
Hello @NDLABS-Leo - in review I found one SP that matches who you said you would store with. Can you explain?
Who is the SP entity under VPN in Los Angeles making the majority of deals?
checker:manualTrigger
✔️ Storage provider distribution looks healthy.
✔️ Data replication looks healthy.
✔️ No CID sharing has been observed.
[^1]: To manually trigger this report, add a comment with text checker:manualTrigger
[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger
[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...
Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.
Hi,@kevzak Question 1: f01853077:They are addressing the network issues in the data center, and the adjustments have been completed. They will soon resume storage operations.(You will be able to see it in the check bot in the next round.)
f02224274 and f02148382:They are currently in a state of lacking pledged tokens and are preparing to acquire them. Once the fundraising is completed, they will proceed with storage operations.
Question 2: They belong to an organization named "Fiset." Due to the controversy surrounding this node, we have not collaborated with them for our storage plans.
Data Owner Name
NDLABS
What is your role related to the dataset
Data Preparer
Data Owner Country/Region
Singapore
Data Owner Industry
Environment
Website
https://www.ndlabs.io/#/
Social Media
Total amount of DataCap being requested
15PiB
Expected size of single dataset (one copy)
1200T
Number of replicas to store
10
Weekly allocation of DataCap requested
1PiB
On-chain address for first allocation
f1al3yt24a3gp6slrc52jfdcrtb7bmvsspttqsnmq
Data Type of Application
Public, Open Dataset (Research/Non-Profit)
Custom multisig
Identifier
No response
Share a brief history of your project and organization
Is this project associated with other projects/ecosystem stakeholders?
Yes
If answered yes, what are the other projects/ecosystem stakeholders
Describe the data being stored onto Filecoin
Where was the data currently stored in this dataset sourced from
My Own Storage Infra
If you answered "Other" in the previous question, enter the details here
No response
How do you plan to prepare the dataset
IPFS, lotus, singularity, graphsplit
If you answered "other/custom tool" in the previous question, enter the details here
Please share a sample of the data
Confirm that this is a public dataset that can be retrieved by anyone on the Network
If you chose not to confirm, what was the reason
No response
What is the expected retrieval frequency for this data
Yearly
For how long do you plan to keep this dataset stored on Filecoin
1 to 1.5 years
In which geographies do you plan on making storage deals
Greater China, Asia other than Greater China, North America
How will you be distributing your data to storage providers
HTTP or FTP server, IPFS, Shipping hard drives
How do you plan to choose storage providers
Slack, Big Data Exchange, Partners
If you answered "Others" in the previous question, what is the tool or platform you plan to use
If you already have a list of storage providers to work with, fill out their names and provider IDs below
How do you plan to make deals to your storage providers
Boost client, Lotus client
If you answered "Others/custom tool" in the previous question, enter the details here
Can you confirm that you will follow the Fil+ guideline
Yes