filecoin-project / Allocator-Governance

4 stars 7 forks source link

Application for DataCap Refilling from Genesis #64

Open Chuangshi1 opened 1 week ago

Chuangshi1 commented 1 week ago

Allocator Application: https://github.com/filecoin-project/notary-governance/issues/1019

  1. Since becoming an Allocator, we have received a total of 5PiB DataCap, At present , we have issued about 4.5 PiB. To better serve the Clients, we are submitting a refilling application.
  2. Our entire approval process manages customer applications based on the governance guidelines submitted in the V5 Allocator Application. We first check whether the customer's GitHub account registration days are greater than 180 days, and then review the customer's entity, data content, data demand, SP location, and CID retrieval success rate. If it meets the approval process, the initial approved DC will not exceed 100TiB, and the maximum DC in the entire process will not exceed 1PiB. The reasonable use of DC is ensured by controlling the maximum value of DC. Finally, the approval is completed based on the CID Checker Report.
  3. During our initial small-scale DC distribution, some customer applications failed to trigger the CID Checker Report. We also submitted a BUG issue for this. https://github.com/fidlabs/allocator-tooling/issues/61 Because it is still can't trigger the report, we stop approving DC to these applications temporary to keep transparency.
  4. Finally, in the process of acting as an allocator, we actively participated in every governance meeting, paid attention to community dynamics, and did a good job of strict control. At the same time, in order to avoid a one-size-fits-all approach to Spark retrieval issues, we adopted a flexible review method. We support multiple retrieval methods, such as graphsync, http, legacy lotus market vs. boost, etc. And support different systems such as Lotus/Venus/Curio, etc.
  5. In a word, we hope to refill the datacap through compliance review in order to better build and serve the filecoin ecosystem. There are 5 applications in my pathway. 1st Allocation Client:https://github.com/lidunhan The github account registered for more than 180 days. Application: https://github.com/Chuangshi1/Genesis/issues/30 Total Approved: 100TiB The application can't trigger the report. Stop approving DC to these applications temporary to keep transparency. https://github.com/fidlabs/allocator-tooling/issues/61 2nd Allocation Client:https://github.com/Finonaa The github account registered for more than 180 days. Application: https://github.com/Chuangshi1/Genesis/issues/20 Total Approved: 1st round 100TiB, 2nd round 500TiB, 3rd round 512TiB. CID Checker Report https://check.allocator.tech/report/Chuangshi1/Genesis/issues/20/1718700900895.md 5 SPs in the application and 3 match 3rd Allocation Client:https://github.com/Cloudyia The github account registered for more than 180 days. Application: https://github.com/Chuangshi1/Genesis/issues/6 Total Approved: 1st round 50TiB, 2nd round 500TiB, 3rd round 500TiB 4th round 1PiB The application can't trigger the report. Stop approving DC to these applications temporary to keep transparency. https://github.com/fidlabs/allocator-tooling/issues/61 But we ask client to post retrieval evidence。 4th Allocation Client:https://github.com/nike-mp The github account registered for more than 180 days. Application: https://github.com/Chuangshi1/Genesis/issues/14 Total Approved:100TiB CID Checker Report https://check.allocator.tech/report/Chuangshi1/Genesis/issues/14/1718590802412.md No one SP march, and no spark retrieval. So i stop approving DC temporarily. Waiting for explanation from client 5th Allocation Client:https://github.com/Tom88881025 The github account registered for more than 180 days. Application: https://github.com/Chuangshi1/Genesis/issues/8 Total Approved: 1st round 500TiB 2nd round 512TiB
    15 SPs offered and 7 SPs match CID Checker Report https://check.allocator.tech/report/Chuangshi1/Genesis/issues/8/1718591267400.md image We ask client to post retrieval evidence. And the Spark retrieval are improving gradually.
Chuangshi1 commented 1 week ago

Please let me know if you have any questions and i will try my best to answer . It will be the most direct way to help us became a great Allocator.

Chuangshi1 commented 4 days ago

@Kevin-FF-USA @galen-mcandrew When will we get response ?

filecoin-watchdog commented 3 days ago

First Example:

https://github.com/Chuangshi1/Genesis/issues/6

SPs provided HK f01730296
Guangdong f02825338 f02639675 SIchuan f0109903 Sichuan f02201915

SPs taking deals https://datacapstats.io/clients/f03069150/breakdown

f03074587 | 20.11% | 417.03 TiB f03074583 | 20.11% | 417.03 TiB f03074589 | 19.91% | 412.88 TiB f03074586 | 19.85% | 411.69 TiB f03074592 | 20.03% | 415.38 TiB

2PiBs given to SPs that do not match and have 0% retrievals

Also, same string of SPs taking equal distribution - flagging as one entity

filecoin-watchdog commented 3 days ago

Second example: https://github.com/Chuangshi1/Genesis/issues/30

SPs taking deals

Storage Provider ID | % of total client used DataCap | Total size f03126600 | 45.62% | 26.72 TiB f01660008 | 1.01% | 608 GiB f03098989 | 53.36% | 31.25 TiB

0 Retrievals https://github.com/Chuangshi1/Genesis/issues/30#issuecomment-2196790307

2 of 4 SPs match those listed.

f03096886 Guangdong province of China
f03098989 HK
f01660008 Jakarta, Indonesia
f02824216 Zhejiang province of China

filecoin-watchdog commented 2 days ago

Example 3: https://github.com/Chuangshi1/Genesis/issues/8

SPs declared up front: f03028310 Fly Tokyo f03028318 Seven Singapore f02062851 Mike USA f03028325 HK_Fil HK f02235190 WHR Shenzhen f03028326 HKblockchain US f03028315 Datastone Guangdong f039940 Cabrina China f02289399 Bailey HK

SPs taking deals Provider | Location | Total Deals Sealed | Percentage | Unique Data | Duplicate Deals | Mean Spark Retrieval Success Rate 7d f03074592 | Los Angeles, California, USCNSERVERS LLC | 93.75 TiB | 9.40% | 93.75 TiB | 0.00% | 0.00% f03028326 | Shenzhen, Guangdong, CNCTGNet | 576.00 GiB | 0.06% | 576.00 GiB | 0.00% | 0.00% f03074586 | Hong Kong, Hong Kong, HKHong Kong Beecloud System Technology Services Limited | 156.25 TiB | 15.66% | 156.25 TiB | 0.00% | 0.00% f03074589 | Hong Kong, Hong Kong, HKHong Kong Beecloud System Technology Services Limited | 93.75 TiB | 9.40% | 93.75 TiB | 0.00% | 0.00% f02953066 | Los Angeles, California, USIPTELECOM ASIA | 44.94 TiB | 4.50% | 44.94 TiB | 0.00% | 2.17% f02956073 | Singapore, Singapore, SGIPTELECOM Global | 93.63 TiB | 9.38% | 93.63 TiB | 0.00% | 47.84% f02837684 | Hong Kong, Hong Kong, HKIPTELECOM Global | 25.63 TiB | 2.57% | 25.63 TiB | 0.00% | 0.00% f03074587 | Seoul, Seoul, KRMOACK.Co.LTD | 53.13 TiB | 5.32% | 53.13 TiB | 0.00% | 0.00% f03074583 | Tokyo, Tokyo, JPNearoute Limited | 156.25 TiB | 15.66% | 156.25 TiB | 0.00% | 0.00% f02199999new | Singapore, Singapore, SGSimplerCloud Pte Ltd | 92.56 TiB | 9.28% | 92.56 TiB | 0.00% | - f03080852 | Toronto, Ontario, CAThe Constant Company, LLC | 93.66 TiB | 9.39% | 93.66 TiB | 0.00% | 56.04% f03080854 | Piscataway, New Jersey, USThe Constant Company, LLC | 93.66 TiB | 9.39% | 93.66 TiB | 0.00% | 69.14%

No SP matches from declared SPs. 3-4 SPs have retreivals

Several SPs from first example above also taking deals here - showing in varied locations but likely same entity in same location f03074583 f03074587 f03074589 f03074586 f03074592

filecoin-watchdog commented 2 days ago

Example 4 https://github.com/Chuangshi1/Genesis/issues/20

SPs provided: f01660008 India f03126600 CN f03010701 CN f03099903 HK f01730296 HK

SPs taking deals: Provider | Location | Total Deals Sealed | Percentage | Unique Data | Duplicate Deals | Mean Spark Retrieval Success Rate 7d f03099903 | Hong Kong, Hong Kong, HKANYUN INTERNET TECHNOLOGY (HK) CO.,LIMITED | 423.38 TiB | 39.43% | 423.38 TiB | 0.00% | - f03098989new | Shenzhen, Guangdong, CNChina Mobile communications corporation | 450.91 TiB | 41.99% | 450.91 TiB | 0.00% | - f03139960new | Chongqing, Chongqing, CNChina Mobile Communications Group Co., Ltd. | 1.25 TiB | 0.12% | 1.25 TiB | 0.00% | - f03096886 | Jiangmen, Guangdong, CNCHINANET-BACKBONE | 59.72 TiB | 5.56% | 59.72 TiB | 0.00% | 0.00% f02370792 | Shenzhen, Guangdong, CNCHINANET-BACKBONE | 45.63 TiB | 4.25% | 45.63 TiB | 0.00% | 0.00% f03126600 | Changsha, Hunan, CNCT-HuNan-Changsha-IDC | 92.91 TiB | 8.65% | 92.91 TiB | 0.00% | -

2 SPs match. 2 SPs sealing 85% of deals. No retrievals.

Chuangshi1 commented 2 days ago

I can't show you the screenshot by this account, so i will use another account. @1ane-1

1ane-1 commented 2 days ago
  1. About retrieval: we always ask our client to proof that.But about spark, wait the update from government. image image image image

If the client couldn’t offer these, it won’t get DC.

  1. About Chuangshi1/Genesis#6
    We already closed the application many days ago, because no checker report and reply. We pull the bug issue here:https://github.com/fidlabs/allocator-tooling/issues/61 Besides, we will ask the information of SP location to check if they are one entity. If it is, we will mark them and refuse to allocate DC to them. Location will be gathered and post here. 3 .About the SP match: Some client add more SPs gradually, and change their SPs if wait for a long time. image 4 .According to our rules, the first round is 50TiB and the next round gradually added but no more than 2PiB once. And we check every client github account if more 180 days. The report is the standard of our audit. We are asking the client to be retrieved by Spark. After participating in the governance meetings of the past two weeks, we requested clients to contact SPs and research the Spark retrieval principle. It can be seen that the Spark retrieval rate has improved, which is about to meet the governance team's requirement of 85%. image