Closed Yhl0921 closed 8 months ago
Thanks for your request!
Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!
Thanks for your request! Everything looks good. :ok_hand:
A Governance Team member will review the information provided and contact you back pretty soon.
Dear Applicant,
Due to the increased amount of erroneous/wrong Filecoin+ data recently, on behalf of the entire community, we feel compelled to go deeper into datacap requests. Hereby to ensure that the overall value of the Filecoin network and Filecoin+ program increases and is not abused.
Please answer the questions below as comprehensively as possible.
Customer data
We expect that for the onboarding of customers with the scale of an LDN there would have been at least multiple email and perhaps several chat conversations preceding it. A single email with an agreement does not qualify here.
Did the customer specify the amount of data involved in this relevant correspondence?
Why does the customer in question want to use the Filecoin+ program?
Should this only be soley for acquiring datacap this is of course out of the question. The customer must have a legitimate reason for wanting to use the Filecoin+ program which is intended as a program to store useful and public datasets on the network.
(As an intermediate solution Filecoin offers the FIL-E program or the glif.io website for business datasets that do not meet the requirements for a Filecoin+ dataset)
Files and Processing
Hopefully you understand the caution the overall community has for onboarding the wrong data. We understand the increased need for Filecoin+, however, we must not allow the program to be misused. Everything depends on a valuable and useful network, let's do our best to make this happen. Together.
5PiB
200TiB
f13rci4xgel7bal6nwneosau2szuqsmixm3mjbkpy
f01858410
f13rci4xgel7bal6nwneosau2szuqsmixm3mjbkpy
100TiB
d0d7c281-0204-47d7-8d73-b35c50371797
There is no previous allocation for this issue.
[^1]: To manually trigger this report, add a comment with text checker:manualTrigger
@Yhl0921 You should send a confirmation email to filplus-app-review@fil.org using the email address of your company domain. And @Sunnyiscoming please help verify and confirm
@NDLABS-OFFICE OK, I have sent the confirmation email as shown below
@Sunnyiscoming please help verify and confirm , thanks!
@simonkim0515 @galen-mcandrew @raghavrmadya @Kevin-FF-USA Can you help me to complete the KYC email confirmation, I have been waiting for some days, thanks!
Hi @Yhl0921
Thanks for cooperating with us to get the LDN. I need to perform some KYC and due diligence in order to decide if i can support your LDN application as notary. Can you please fill out this form:
https://form.jotform.com/230232885049356
I will proces it asap.
I have received KYC email. You can ask approval from notaries through slack. https://app.slack.com/client/TEHTVS1L6/C036JKD8NVA/thread/C03BG1MNQ4T-1673888660.823499
@Sunnyiscoming can you share the information with us?
So to my understanding, the complete and whole KYC process is a single email from potentially the organization?
Op wo 25 jan. 2023 om 07:53 schreef Sunnyiscoming @.***>
[image: image] https://user-images.githubusercontent.com/105098820/214499225-f5703c01-b2f9-41c6-aa22-d7dddb7d2d65.png
— Reply to this email directly, view it on GitHub https://github.com/filecoin-project/filecoin-plus-large-datasets/issues/1496#issuecomment-1403172027, or unsubscribe https://github.com/notifications/unsubscribe-auth/AQXCI6LJJ3RHEM6OFFOQNR3WUDEXPANCNFSM6AAAAAATLZMLVY . You are receiving this because you commented.Message ID: <filecoin-project/filecoin-plus-large-datasets/issues/1496/1403172027@ github.com>
--
Dear applicant,
Thank you for applying for datacap. As Filecoin FIL+ notary i am screening your application and conducting due diligence.
Looking at your application i have some questions: As you are brand new on Github and have no history of past applications it seems to me that applying for 5PB of datacap is a lot. One needs comprehensive knowledge of Filecoin, packing of data, distribution of data and all it's requirements coming with it. Are you brand new in the Filecoin space or have you applied for datacap in the past on different Github account names?
Can you show us visible proof of the size of your data and the storage systems you have there?
As last question i would like you to fill out this form to provide us with the necessary information to make a educated decision on your LDN request if we would like to support it.
Thanks!
As a company that serves the financial industry and realizes big data analysis for customers, I didn't know much about filecoin before. This time, I chose to use FIL + for big data storage and learned about the advantages and future of WEB3 storage by participating in the activities organized by SPs. Therefore, we choose to embrace new ideas and technologies to achieve more efficient and secure data storage technology. As for the account number, we did apply for a brand-new account number to handle this work.
Due to China's domestic firewall, the form link cannot be accessed. If you want to know about our company, I have described it in the application information. In addition, you can visit our official website and customer service consultation, thank you.
Hi @Yhl0921
That is a bit unfortunate, but not a big problem.
Can you send an e-mail to kyc@dcent.nl then with the following information:
Information about the company Information about you ( Who you are and what your role is , a data preparer, client or SP)
The first 4 SP's you are going to use to store data with in your first allocation of datacap and their contact information.
RULES: In order to be eligible for the Filecoin+ incentive program, which provides 10x the power (QAP) for storing data on the Filecoin network, there are certain rules that must be followed:
Data must be stored with multiple independent service providers, not just one organization running multiple SPs. Data must be distributed across multiple regions. Using a VPN to fake presence is not allowed. Data must be publicly retrievable for verification that it is being stored as claimed. It is highly recommended to run boost. Data must align with the mission of FIL+, meaning it must be valuable for humanity, whether scientific or unique in some other way. Data must be open and not encrypted. If you wish to encrypt your data, consider applying for the FIL-E program instead. Note: As a data preparer, you are allowed to store one copy yourself for redundancy at the request of the client. However, if your copy is stored in the USA, the other organizations/SPs must be outside your region. Dcent encourages applications with a minimum spread of 2 continents and 3 different organizations.
Please confirm in the e-mail that you understand these.
@cryptowhizzard Please check the KYC email. Also ,we would like your help for the first round of signature. Thanks ~
Hello,
I am still missing this:
The first 4 SP's you are going to use to store data with in your first allocation of datacap and their contact information.
@cryptowhizzard I have been communicating with your colleague "Hidde Hoogland" for a long time this afternoon. I have sent him the information you want to add through slack. You can ask him share the information.
@Yhl0921 Correct. Miners shared:
Some of those entities are trustworthy, and no questionable miners shared, looking forward to the results of the next CID report! Good luck with the deals.
Your Datacap Allocation Request has been proposed by the Notary
bafy2bzaced6pvrutbctw5usobciqntewqggiftwufp4knjfg4wt2yscx7n47y
Address
f13rci4xgel7bal6nwneosau2szuqsmixm3mjbkpy
Datacap Allocated
100.00TiB
Signer Address
f1krmypm4uoxxf3g7okrwtrahlmpcph3y7rbqqgfa
Id
d0d7c281-0204-47d7-8d73-b35c50371797
You can check the status of the message here: https://filfox.info/en/message/bafy2bzaced6pvrutbctw5usobciqntewqggiftwufp4knjfg4wt2yscx7n47y
Hi, @Yhl0921 Can you show me a screenshot of the total amount of data you want to store in FIL+?
@psh0691 Daily data of Shanghai A shares
Daily data of Shenzhen A shares
MT4 Historical Data Center Currency-to-Foreign Exchange Transaction Data
Forex Historical Center Currency-to-Foreign Exchange Transaction Data
Lending Club Credit Default Data
Your Datacap Allocation Request has been approved by the Notary
bafy2bzacedvtlsi4oneqbxxtrz7gc6iwzjkqgqjfqpgmxmyt3f7jspnya6oxm
Address
f13rci4xgel7bal6nwneosau2szuqsmixm3mjbkpy
Datacap Allocated
100.00TiB
Signer Address
f1qdko4jg25vo35qmyvcrw4ak4fmuu3f5rif2kc7i
Id
You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedvtlsi4oneqbxxtrz7gc6iwzjkqgqjfqpgmxmyt3f7jspnya6oxm
checker:manualTrigger
There is no previous allocation for this issue.
[^1]: To manually trigger this report, add a comment with text checker:manualTrigger
Hello @dkkapur
I was tracking a client where i proposed datacap. It seems my tool provides more data then the Filplus checker. Can you take a look why it is lagging behind?
@cryptowhizzard Filplus checker is a statistical analysis tool, so the statistical samples must reach a certain amount to reflect the problem, and the results obtained are of reference value. If the project has just started and there are only 1-2 encapsulated nodes, then most of the rules of the checker tool may not be satisfied, and of course this is meaningless. I don't know if my answer can answer your doubts?
@Yhl0921
It was not a remark to indicate you did something wrong. It was a remark that it seems the CID checker is lagging behind (a bit) on some LDN's towards the governance team ( @dkkapur )
Hi, Is it possible that we can add a special tag for tools issue? so that such issue could handled ASAP @galen-mcandrew @dkkapur
checker:manualTrigger
✔️ Storage provider distribution looks healthy.
✔️ Data replication looks healthy.
✔️ No CID sharing has been observed.
[^1]: To manually trigger this report, add a comment with text checker:manualTrigger
[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger
[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...
Click here to view the full report.
@Yhl0921 can you explain to me how many copies do you intend to store and how stock market data can consist more than 1 PiB? It is rarely to see text files exceed 1 PiB.
@kernelogic The data are generated by using the financial information service system to realize big data analysis for customers, and the data generated by analyzing the predicted financial market, as well as the daily data of stocks and bonds, foreign exchange transaction data, and historical data of each currency to foreign exchange transaction data of each service platform.
Depending on the importance of the data, we will store 5-8 copies of the data and distribute them to SPs in different regions.
Your Datacap Allocation Request has been proposed by the Notary
bafy2bzacedrnohqe4zezcvfpmxdyfa44zwjn6dszfsbuh6r7zamh7p2dkxvea
Address
f13rci4xgel7bal6nwneosau2szuqsmixm3mjbkpy
Datacap Allocated
100.00TiB
Signer Address
f1yjhnsoga2ccnepb7t3p3ov5fzom3syhsuinxexa
Id
d0d7c281-0204-47d7-8d73-b35c50371797
You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedrnohqe4zezcvfpmxdyfa44zwjn6dszfsbuh6r7zamh7p2dkxvea
checker:manualTrigger
✔️ Storage provider distribution looks healthy.
✔️ Data replication looks healthy.
✔️ No CID sharing has been observed.
[^1]: To manually trigger this report, add a comment with text checker:manualTrigger
[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger
[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...
Click here to view the full report.
Receive the client's private message on slack and review it according to ND's review rules. Since there are only 4 nodes in this round, the first node doesn't work when I try to do a connectivity test. Hope you can contact this sp for rectification. If they support retrieval when the number of nodes is small, we are willing to support.
@NDLABS-OFFICE Ok, this may be a temporary network adjustment, I will contact the SP to solve the problem immediately, please wait a moment.
@NDLABS-OFFICE Resolved , pls try it again.
~$ lotus net connect f01986229
f01986229 -> {12D3KooWEfxT2rACPpBkwQJzfKJoJBWuaR9hY7kqMK6ZotG7ueqR: [/ip4/[119.36.32.147/tcp/7007](http://119.36.32.147/tcp/7007)]}
ERROR: failed to parse multiaddr "f01986229": must begin with /
~$ telnet [119.36.32.147](http://119.36.32.147/) 7007
Trying [119.36.32.147](http://119.36.32.147/)...
Connected to [119.36.32.147](http://119.36.32.147/).
Escape character is '^]'.
/multistream/1.0.0
None of the retrievals work.
Feb 24 16:52:31 proposals dealscanner-f02002177-f01986236: Recv 0 B, Paid 0 FIL, Open (New), 0s [1677227776938388544|0] Feb 24 16:52:31 proposals dealscanner-f02002177-f01986236: Recv 0 B, Paid 0 FIL, DealProposed (WaitForAcceptance), 3ms [1677227776938388544|0] Feb 24 16:52:31 proposals dealscanner-f02002177-f01964215: Error: Failed to retrieve content with candidate miner f01964215: data transfer failed: unconfirmed block transfer Feb 24 16:52:32 proposals dealscanner-f02002177-f01964215: Error: Failed to retrieve content with candidate miner f01964215: data transfer failed: unconfirmed block transfer Feb 24 16:52:33 proposals dealscanner-f02002177-f01876488-24829653: Recv 0 B, Paid 0 FIL, Open (New), 0s [1677178022565041145|0] Feb 24 16:52:33 proposals dealscanner-f02002177-f01876488-24829653: Recv 0 B, Paid 0 FIL, DealProposed (WaitForAcceptance), 9ms [1677178022565041145|0] Feb 24 16:52:37 proposals dealscanner-f02002177-f01986236-24211501: Recv 0 B, Paid 0 FIL, Open (New), 0s [1677178022565041146|0] Feb 24 16:52:37 proposals dealscanner-f02002177-f01986236-24211501: Recv 0 B, Paid 0 FIL, DealProposed (WaitForAcceptance), 9ms [1677178022565041146|0] Feb 24 16:52:37 proposals dealscanner-f02002177-f01986236: Recv 0 B, Paid 0 FIL, DealAccepted (Accepted), 5.99s [1677227776938388544|0] Feb 24 16:52:37 proposals dealscanner-f02002177-f01986236: Recv 0 B, Paid 0 FIL, PaymentChannelSkip (Ongoing), 5.991s [1677227776938388544|0] Feb 24 16:52:37 proposals dealscanner-f02002177-f01986236-24211501: Recv 0 B, Paid 0 FIL, Open (New), 0s [1677178022565041147|0] Feb 24 16:52:37 proposals dealscanner-f02002177-f01986236-24211501: Recv 0 B, Paid 0 FIL, DealProposed (WaitForAcceptance), 9ms [1677178022565041147|0] Feb 24 16:52:38 proposals dealscanner-f02002177-f01986236-24211501: Recv 0 B, Paid 0 FIL, Open (New), 0s [1677178022565041148|0] Feb 24 16:52:38 proposals dealscanner-f02002177-f01986236-24211501: Recv 0 B, Paid 0 FIL, DealProposed (WaitForAcceptance), 9ms [1677178022565041148|0] Feb 24 16:52:38 proposals dealscanner-f02002177-f01986236-24211501: Recv 0 B, Paid 0 FIL, Open (New), 0s [1677178022565041149|0] Feb 24 16:52:38 proposals dealscanner-f02002177-f01986236-24211501: Recv 0 B, Paid 0 FIL, DealProposed (WaitForAcceptance), 9ms [1677178022565041149|0] Feb 24 16:52:38 proposals dealscanner-f02002177-f01986236-24211501: Recv 0 B, Paid 0 FIL, Open (New), 0s [1677178022565041150|0] Feb 24 16:52:38 proposals dealscanner-f02002177-f01986236-24211501: Recv 0 B, Paid 0 FIL, DealProposed (WaitForAcceptance), 10ms [1677178022565041150|0]
From here everything is stuck. ( Probably did not save the unsealed sectors for transfer ).
@cryptowhizzard I tried one deal you marked above. It took 2-3 minutes to start downloading, but the speed was OK afterwards.
$ lotus state get-deal 24211501
{
"Proposal": {
"PieceCID": {
"/": "baga6ea4seaqpzki72urmcvsekuwktqofknefrwwa3ufxwbawpaew7ch66egjkba"
},
"PieceSize": 34359738368,
"VerifiedDeal": true,
"Client": "f02002177",
"Provider": "f01986236",
"Label": "uAXASIB1-skd3PW3_9jGLAlg7fQvdUS1oDhnZTyzzRxtRahHR",
"StartEpoch": 2595181,
"EndEpoch": 4138121,
"StoragePricePerEpoch": "0",
"ProviderCollateral": "10384501070311386",
"ClientCollateral": "0"
},
"State": {
"SectorStartEpoch": 2586222,
"LastUpdatedEpoch": 2637421,
"SlashEpoch": -1,
"VerifiedClaim": 6675204
}
}
$ lotus client retrieve --provider f01986236 uAXASIB1-skd3PW3_9jGLAlg7fQvdUS1oDhnZTyzzRxtRahHR f01986236-24211501.car
Recv 0 B, Paid 0 FIL, Open (New), 1ms
Recv 0 B, Paid 0 FIL, DealProposed (WaitForAcceptance), 5ms
Recv 0 B, Paid 0 FIL, DealAccepted (Accepted), 489ms
Recv 0 B, Paid 0 FIL, PaymentChannelSkip (Ongoing), 490ms
Recv 15.12 KiB, Paid 0 FIL, BlocksReceived (Ongoing), 1.201s
Recv 17.13 KiB, Paid 0 FIL, BlocksReceived (Ongoing), 1.264s
Recv 1.017 MiB, Paid 0 FIL, BlocksReceived (Ongoing), 38.466s
Recv 2.017 MiB, Paid 0 FIL, BlocksReceived (Ongoing), 1m13.709s
Recv 3.017 MiB, Paid 0 FIL, BlocksReceived (Ongoing), 2m1.102s
Recv 4.017 MiB, Paid 0 FIL, BlocksReceived (Ongoing), 2m28.375s
Recv 5.017 MiB, Paid 0 FIL, BlocksReceived (Ongoing), 2m28.387s
Recv 6.017 MiB, Paid 0 FIL, BlocksReceived (Ongoing), 2m28.399s
Recv 7.017 MiB, Paid 0 FIL, BlocksReceived (Ongoing), 2m28.406s
Recv 8.017 MiB, Paid 0 FIL, BlocksReceived (Ongoing), 2m28.417s
Recv 9.017 MiB, Paid 0 FIL, BlocksReceived (Ongoing), 2m28.427s
Recv 10.02 MiB, Paid 0 FIL, BlocksReceived (Ongoing), 2m28.439s
Recv 11.02 MiB, Paid 0 FIL, BlocksReceived (Ongoing), 2m28.451s
Recv 12.02 MiB, Paid 0 FIL, BlocksReceived (Ongoing), 2m28.462s
Recv 13.02 MiB, Paid 0 FIL, BlocksReceived (Ongoing), 2m28.475s
Recv 14.02 MiB, Paid 0 FIL, BlocksReceived (Ongoing), 2m28.486s
Recv 15.02 MiB, Paid 0 FIL, BlocksReceived (Ongoing), 2m28.499s
Recv 16.02 MiB, Paid 0 FIL, BlocksReceived (Ongoing), 2m28.511s
Recv 17.02 MiB, Paid 0 FIL, BlocksReceived (Ongoing), 2m28.523s
Recv 18.02 MiB, Paid 0 FIL, BlocksReceived (Ongoing), 2m28.535s
Recv 19.02 MiB, Paid 0 FIL, BlocksReceived (Ongoing), 2m28.547s
Recv 20.02 MiB, Paid 0 FIL, BlocksReceived (Ongoing), 2m28.56s
Recv 21.02 MiB, Paid 0 FIL, BlocksReceived (Ongoing), 2m28.572s
Recv 22.02 MiB, Paid 0 FIL, BlocksReceived (Ongoing), 2m28.583s
Recv 23.02 MiB, Paid 0 FIL, BlocksReceived (Ongoing), 2m28.595s
Recv 24.02 MiB, Paid 0 FIL, BlocksReceived (Ongoing), 2m28.602s
Recv 25.02 MiB, Paid 0 FIL, BlocksReceived (Ongoing), 2m28.613s
Recv 26.02 MiB, Paid 0 FIL, BlocksReceived (Ongoing), 2m28.62s
checker:manualTrigger
✔️ Storage provider distribution looks healthy.
✔️ Data replication looks healthy.
✔️ No CID sharing has been observed.
[^1]: To manually trigger this report, add a comment with text checker:manualTrigger
[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger
[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...
Click here to view the full report.
lotus client retrieve --provider f01986229 --pieceCid baga6ea4seaqam26pjm6dmoxhhsnpig5qtbcpg7i7qevkpjq4obqpwbysrpqiykq bafybeifequ6o6b2srhdqxl5thbxvasgqnki3w5reo5bgov6amucjxlguua /tmp/abc
BOT checks normally, retrieved a sector data can be accessed normally
Your Datacap Allocation Request has been approved by the Notary
bafy2bzacecfsnqh4xpkp5e6bdon2lcoreqkdjesjqh6jlucqmbwyo3l3t5eim
Address
f13rci4xgel7bal6nwneosau2szuqsmixm3mjbkpy
Datacap Allocated
100.00TiB
Signer Address
f1q6bpjlqia6iemqbrdaxr2uehrhpvoju3qh4lpga
Id
d0d7c281-0204-47d7-8d73-b35c50371797
You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecfsnqh4xpkp5e6bdon2lcoreqkdjesjqh6jlucqmbwyo3l3t5eim
Data Owner Name
Beijing Ruirong Technology Company Limited
Data Owner Country/Region
China
Data Owner Industry
Financial Services
Website
https://www.bjrrtx.com/
Social Media
Total amount of DataCap being requested
5PiB
Weekly allocation of DataCap requested
200TiB
On-chain address for first allocation
f13rci4xgel7bal6nwneosau2szuqsmixm3mjbkpy
Custom multisig
Identifier
No response
Share a brief history of your project and organization
Is this project associated with other projects/ecosystem stakeholders?
No
If answered yes, what are the other projects/ecosystem stakeholders
No response
Describe the data being stored onto Filecoin
Where was the data currently stored in this dataset sourced from
My Own Storage Infra
If you answered "Other" in the previous question, enter the details here
No response
How do you plan to prepare the dataset
lotus
If you answered "other/custom tool" in the previous question, enter the details here
No response
Please share a sample of the data
Confirm that this is a public dataset that can be retrieved by anyone on the Network
If you chose not to confirm, what was the reason
No response
What is the expected retrieval frequency for this data
Yearly
For how long do you plan to keep this dataset stored on Filecoin
More than 3 years
In which geographies do you plan on making storage deals
Greater China
How will you be distributing your data to storage providers
Shipping hard drives
How do you plan to choose storage providers
Slack, Partners
If you answered "Others" in the previous question, what is the tool or platform you plan to use
No response
If you already have a list of storage providers to work with, fill out their names and provider IDs below
How do you plan to make deals to your storage providers
Lotus client
If you answered "Others/custom tool" in the previous question, enter the details here
No response
Can you confirm that you will follow the Fil+ guideline
Yes