filecoin-project / filecoin-plus-large-datasets

Hub for client applications for DataCap at a large scale
110 stars 62 forks source link

[DataCap Application] Slingshot Evergreen ( Protocol Labs ) #293

Closed ribasushi closed 1 year ago

ribasushi commented 2 years ago

Large Dataset Notary Application

To apply for DataCap to onboard your dataset to Filecoin, please fill out the following.

Core Information

Please respond to the questions below by replacing the text saying "Please answer here". Include as much detail as you can in your answer.

Project details

Share a brief history of your project and organization.

Slingshot is a community competition for storage clients and developers that rewards the storage of real, valuable, and usable data on the Filecoin network. Slingshot v2 kicked off at the end of 2020, through which ~35 PiB of 61+ public open datasets have been onboarded to the Filecoin network. The Slingshot competition has effectively served as one of the largest data onboarding funnels in the Filecoin network, and has resulted in several learnings around deal making at scale, retrievals, data indexing and documentation of onboarded data. 

Protocol Labs has supported the Slingshot competition and will be the primary owner of the Slingshot Evergreen engine. Protocol Labs is an OSS R&D Lab, and was founded in 2014. Software developed by PL includes IPFS, Filecoin (lotus implementation), libp2p, drand, IPLD and more. 

What is the primary source of funding for this project?

PL will be funding the development and operations of the Slingshot Evergreen engine.

What other projects/ecosystem stakeholders is this project associated with?

This project is primarily associated with participants of the Slingshot community, and those with a vested interested in permanent archival of data on Filecoin (which could include key Filecoin stakeholders like developers of implementations, those working on the FVM, the Filecoin Foundation, and Storage Provider entities). Additionally, in some cases, owners of Slingshot datasets that we’ve collaborated with will also benefit from a permanent mirror of their datasets on the decentralized web. 

Use-case details

Describe the data being stored onto Filecoin

Each of the Slingshot datasets come from reputable organizations where the licensing allows for public storage of the data. The full list of datasets that are eligible for Slingshot can be found [here](https://github.com/filecoin-project/slingshot/blob/master/datasets.md). The [Slingshot Data Explorer](https://slingshot.filecoin.io/explore) also has a list of datasets stored in the past.

Where was the data in this dataset sourced from?

For long term archival through Evergreen - the data will be sourced from the Filecoin network. SPs interested in serving this data are expected to run retrievals to obtain pieces that can be re-stored in the future.

The original data was sourced directly from the organizations that own it or mirrors they support, which are linked to [here](https://github.com/filecoin-project/slingshot/blob/master/datasets.md).

Can you share a sample of the data? A link to a file, an image, a table, etc., are good ways to do this.

Yes - here are some examples of datasets onboarded through Slingshot:
 Million Song Dataset    - http://millionsongdataset.com/
Boxy Vehicles Dataset - https://boxy-dataset.com/boxy/, https://github.com/karstenBehrendt/boxy 
Foldingathome COVID-19 Dataset - https://registry.opendata.aws/foldingathome-covid19/ 

The [Slingshot Data Explorer](https://slingshot.filecoin.io/explore) has a list of all the stored data along with the SPs that onboarded it, which can be used to source the data from Filecoin network directly. 

Confirm that this is a public dataset that can be retrieved by anyone on the Network (i.e., no specific permissions or access rights are required to view the data).

Yes, these are all public datasets and deals made will require SPs to service retrievals on the network. We will sampling retrievability weekly to ensure the data remains retrievable and available to clients interested in obtaining it.

What is the expected retrieval frequency for this data?

We will be sampling retrievability weekly. We also expect some demand from researchers and developers for this data in the coming years. 

As part of additional replication in the future to keep stable mirrors of this dataset in the network, cross SP retrievals will be required to onboard more replicas with different SP organizations and in different datacenters / regions across the world.

Therefore, we expect the data to be retrieved somewhat frequently, 1-2 times per week.

For how long do you plan to keep this dataset stored on Filecoin?

Forever! The Evergreen engine is the first step in the road to fully autonomous permanent storage of humanities most valuable data within the Filecoin network.

DataCap allocation plan

In which geographies (countries, regions) do you plan on making storage deals?

The Evergreen engine will plan to distribute up to 10 replicas for each piece of data that is expiring in deals made through Slingshot v2 (in the following 60d at any given point in time), with the following distribution requirements for replicas:
No more than one replica per city / datacenter
No more than two replicas per country
At least one replica in three different continents

The goal is to distribute these replicas both geographically and across SP organizations to increase the availability of the data in different regions, and improve long–term availability. 

How will you be distributing your data to storage providers? Is there an offline data transfer process?

SPs will be tasked with procuring data required for the deals. This will primarily happen through retrievals on the Filecoin network. In cases where not possible, the offline data transfer option exists for going back to the root source of the data and processing it in a manner consistent with the original onboarding. 

How do you plan on choosing the storage providers with whom you will be making deals? This should include a plan to ensure the data is retrievable in the future both by you and others.

We plan for SPs interested in participating to fill out the [onboarding form](https://docs.google.com/forms/d/e/1FAIpQLSe5bpkD5RJeHGMNx3CpkV3a6UA2i7aroNE5DlGUdQF0mQU8DQ/viewform?usp=sf_link) in order to be eligible to receive deals from the Evergreen engine. This includes checking for location, miner IDs, and confirms their ability to service retrievals as required by the program. 

Over time, the retrieval sampling we do will also be made available through the Filecoin Reputation System, and retrieval success rate will be used as a measure of reliable performance to enable future dealmaking from the Evergreen engine. SPs that do not serve retrievals as required by the program will not be eligible for future deals.

How will you be distributing deals across storage providers?

The Evergreen engine will be available as an API for registered SPs to reach out to, to request deal proposals for eligible piece CIDs that they would like to store a replica of. The goal is to distribute replicas across SP operators and regions, using the following heuristics:
Max 1 replica per datacenter/city
Max 2 replicas per Storage Provider organization
Max 2 replicas per country
Min 3 continents

Do you have the resources/funding to start making deals as soon as you receive DataCap? What support from the community would help you onboard onto Filecoin?

Yes - current plan is to launch in the third week of March. We expect to hit the ground running! There are no blockers at this time for us to start making deals.
BDEio commented 1 year ago

@ribasushi Hi! Great to see that you have gotten approval for DataCap! BDE is a verified deals auction house helping you to get paid storing your data with reliable storage providers. If you need any help, please get in touch.

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 8

Multisig Notary address

f01858410

Client address

f1pkrmygbvweykpjcut36lf7ewgqdfhjklbhvepda

DataCap allocation requested

2000TiB

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f1pkrmygbvweykpjcut36lf7ewgqdfhjklbhvepda

Last two approvers

s0nik42 & cryptowhizzard

Rule to calculate the allocation request amount

800% of weekly dc amount requested

DataCap allocation requested

10.23GiB

Total DataCap granted for client so far

2.68PiB

Datacap to be granted to reach the total amount requested by the client (5 PiB)

2.31PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
131693 48 4.55TiB 15.61 848.01GiB
filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report[^1]

Storage Provider Distribution

The below table shows the distribution of storage providers that have stored data for this client.

If this is the first time a provider takes verified deal, it will be marked as new.

For most of the datacap application, below restrictions should apply.

✔️ Storage provider distribution looks healthy.

Provider Location Total Deals Sealed Percentage Unique Data Duplicate Deals
f01423116 Lillestrøm, Viken, NO
Altibox AS
4.60 TiB 0.14% 4.60 TiB 0.00%
f01310564 Oslo, Oslo, NO
Aremark EDB AS
6.01 TiB 0.19% 6.01 TiB 0.00%
f01611097 Mission Viejo, California, US
AT&T Services, Inc.
127.17 TiB 3.93% 125.58 TiB 1.25%
f01278 Grand Rapids, Michigan, US
AT&T Services, Inc.
15.00 TiB 0.46% 15.00 TiB 0.00%
f08403 Bourton on the Water, England, GB
British Telecommunications PLC
59.21 TiB 1.83% 59.21 TiB 0.00%
f01801091 Canton, Ohio, US
Charter Communications Inc
30.34 TiB 0.94% 30.34 TiB 0.00%
f01853438new Beijing, Beijing, CN
CHINA UNICOM China169 Backbone
2.17 TiB 0.07% 2.17 TiB 0.00%
f01747176new Beijing, Beijing, CN
CHINA UNICOM China169 Backbone
96.00 GiB 0.00% 96.00 GiB 0.00%
f0142637 Chengdu, Sichuan, CN
CHINANET-BACKBONE
1.66 TiB 0.05% 1.66 TiB 0.00%
f01345523 Antwerpen, Flanders, BE
Cogent Communications
364.71 TiB 11.28% 364.71 TiB 0.00%
f01826669 Philadelphia, Pennsylvania, US
Cogent Communications
79.95 TiB 2.47% 79.95 TiB 0.00%
f01883179 Philadelphia, Pennsylvania, US
Cogent Communications
4.63 TiB 0.14% 4.63 TiB 0.00%
f010446 Zaventem, Flanders, BE
Cogent Communications
32.00 GiB 0.00% 32.00 GiB 0.00%
f01858429 Boston, Massachusetts, US
Comcast Cable Communications, LLC
16.02 TiB 0.50% 16.02 TiB 0.00%
f01392893 Amsterdam, North Holland, NL
Fusix Networks B.V.
226.65 TiB 7.01% 226.65 TiB 0.00%
f010202 Hong Kong, Central and Western, HK
HK Broadband Network Ltd.
480.00 GiB 0.01% 480.00 GiB 0.00%
f0773157 Fremont, California, US
Hurricane Electric LLC
9.59 TiB 0.30% 9.59 TiB 0.00%
f0104671 Kawasaki, Kanagawa, JP
KDDI CORPORATION
386.00 GiB 0.01% 386.00 GiB 0.00%
f01840390 Seoul, Seoul, KR
Korea Telecom
11.17 TiB 0.35% 11.17 TiB 0.00%
f01790264 Seoul, Seoul, KR
Korea Telecom
4.23 TiB 0.13% 4.23 TiB 0.00%
f01466075 Seoul, Seoul, KR
Korea Telecom
2.13 TiB 0.07% 2.13 TiB 0.00%
f01764587 Seoul, Seoul, KR
Korea Telecom
1.50 TiB 0.05% 1.50 TiB 0.00%
f01871352 Seoul, Seoul, KR
Korea Telecom
1.03 TiB 0.03% 1.03 TiB 0.00%
f01699939 Gwangju, Gwangju, KR
Korea Telecom
604.50 GiB 0.02% 604.50 GiB 0.00%
f0717969 Los Angeles, California, US
Krypt Technologies
319.98 TiB 9.89% 319.98 TiB 0.00%
f01847751 Denver, Colorado, US
Level 3 Parent, LLC
49.90 TiB 1.54% 49.90 TiB 0.00%
f01872811new Dallas, Texas, US
Level 3 Parent, LLC
2.54 TiB 0.08% 2.54 TiB 0.00%
f0440429 Bucheon-si, Gyeonggi-do, KR
LG DACOM Corporation
186.83 TiB 5.78% 186.37 TiB 0.24%
f030379 Seoul, Seoul, KR
LG DACOM Corporation
120.87 TiB 3.74% 120.87 TiB 0.01%
f01806491 Seoul, Seoul, KR
LG DACOM Corporation
85.14 TiB 2.63% 85.11 TiB 0.04%
f033356 Seoul, Seoul, KR
LG DACOM Corporation
83.18 TiB 2.57% 83.15 TiB 0.04%
f03488 Seoul, Seoul, KR
LG DACOM Corporation
63.96 TiB 1.98% 63.83 TiB 0.20%
f024184 Seoul, Seoul, KR
LG DACOM Corporation
37.94 TiB 1.17% 37.88 TiB 0.16%
f097777 Kivertsi, Volyn, UA
Link Telecom Service Ltd
608.00 GiB 0.02% 608.00 GiB 0.00%
f019551 Birmingham, England, GB
Neonix Web Services Limited
6.25 TiB 0.19% 6.25 TiB 0.00%
f01775922 Ashburn, Virginia, US
New Dream Network, LLC
511.13 TiB 15.80% 505.25 TiB 1.15%
f01784458 Oslo, Oslo, NO
Nexthop AS
108.85 TiB 3.37% 108.85 TiB 0.00%
f01163272 Lys’va, Perm Krai, RU
PJSC Rostelecom
912.00 GiB 0.03% 912.00 GiB 0.00%
f02576 Copenhagen, Capital Region, DK
Telenor A/S
36.02 TiB 1.11% 36.02 TiB 0.00%
f01752548 Seattle, Washington, US
Wholesail networks LLC
319.87 TiB 9.89% 296.03 TiB 7.45%
f01851231 Seattle, Washington, US
Wholesail networks LLC
202.67 TiB 6.27% 202.67 TiB 0.00%
f0838684 Prague, Hlavní město Praha, CZ
WIA spol. s.r.o.
14.08 TiB 0.44% 14.08 TiB 0.00%
f01240 Heerhugowaard, North Holland, NL
Wijnand Schouten trading as Speedium
28.33 TiB 0.88% 28.33 TiB 0.00%
f0707721 Heerhugowaard, North Holland, NL
Wijnand Schouten trading as Speedium
26.27 TiB 0.81% 26.27 TiB 0.00%
f01199430 Heerhugowaard, North Holland, NL
Wijnand Schouten trading as Speedium
2.16 TiB 0.07% 2.16 TiB 0.00%
f01771403 Heerhugowaard, North Holland, NL
Wijnand Schouten trading as Speedium
1.98 TiB 0.06% 1.98 TiB 0.00%
f01886797 Vancouver, British Columbia, CA
Zayo Bandwidth
55.26 TiB 1.71% 55.26 TiB 0.00%

Provider Distribution

Deal Data Replication

The below table shows how each many unique data are replicated across storage providers.

⚠️ 44.89% of deals are for data replicated across less than 4 storage providers.

Unique Data Size Total Deals Made Number of Providers Deal Percentage
139.02 TiB 139.17 TiB 1 4.30%
408.16 TiB 839.54 TiB 2 25.96%
155.88 TiB 472.91 TiB 3 14.62%
118.36 TiB 475.12 TiB 4 14.69%
79.66 TiB 398.74 TiB 5 12.33%
58.41 TiB 351.04 TiB 6 10.85%
41.82 TiB 293.20 TiB 7 9.07%
20.22 TiB 161.95 TiB 8 5.01%
8.51 TiB 76.63 TiB 9 2.37%
2.47 TiB 24.69 TiB 10 0.76%
96.00 GiB 1.03 TiB 11 0.03%

Replication Distribution

Deal Data Shared with other Clients

The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.

However, this could be possible if all below clients use same software to prepare for the exact same dataset or they belong to a series of LDN applications for the same dataset.

⚠️ CID sharing has been observed.

Other Client Application Total Deals Affected Unique CIDs Approvers
f3wkoaov5p4ghrjtfk4lcwtloc3mr3vunxk37mkfm
h4lwiqj5thj7wddjgvzaqz5eqdzgvbfrhgqhrvxzr
mxva
Fei Yan - Kernelogic 908.45 TiB 5,055 5flyworker
4MegTei
3Reiers
3swatchliu
f3vnq2cmwig3qjisnx5hobxvsd4drn4f54xfxnv4t
ciw6vnjdsf5xipgafreprh5riwmgtcirpcdmi3urb
g36a
WhyrusleepingEstuary - Applications Research Group 680.95 TiB 8,946 3cryptowhizzard
2dannyob
2flyworker
2MegTei
1neogeweb3
3Reiers
f3xbtxeptbmiuevsbjnnsntx6p37a7q6lbw4x7gdk
dkiih2ha4qlymoayd2xwk2mpgbwdvgievlje7eivh
3e3q
Fei Yan - Kernelogic 654.30 TiB 2,831 2flyworker
2MegTei
3Reiers
2swatchliu
f13d6zt424jkp55u7kp67azotkzadtlokwnz2ntxa FilSwan - Slingshot Restore 604.92 TiB 3,110 4cryptowhizzard
1dannyob
2IreneYoung
2kernelogic
2MegTei
1psh0691
1Reiers
1s0nik42
1swatchliu
f1euejrtpg5vphqzydzleld2vgxfkhbrueiomz54y Fei Yan - Kernelogic 444.80 TiB 4,614 2liyunzhi-666
2newwebgroup
1psh0691
1swatchliu
1xiaoyuaiheshui
2xinaxu
1xingjitansuo
f3spci2tzjzhedgvxsoxg4hprrkyszdce5dacaxg4
ndkvpshpuma2uf6c4fmk2lvvrobnz5bvr6j5hfecc
pupq
Fei Yan - Kernelogic 437.30 TiB 2,639 4flyworker
2Reiers
2swatchliu
f1quvbybolurp6d4xzthieupygtco6mcakwflzwya TechGreedy 368.03 TiB 1,526 2cryptowhizzard
1dannyob
1Fenbushi-Filecoin
2flyworker
1jimcray
2MegTei
2Reiers
1TimWilliams00
f15djc5avdxihguvpmtej24rzbvnnqvzurxe55kja Kernelogic - Fei Yan - Slingshot Restore 306.30 TiB 3,272 1cryptowhizzard
1dannyob
2flyworker
1IreneYoung
1MegTei
1neogeweb3
1Reiers
1swatchliu
f1tzo23trsctqzaqxopwdsdaszgqhm7yqdadzg5oi Unknown 268.89 TiB 1,992 Unknown
f1zil5gn6fgelxw5lb7sbv22eayfltg7eohcrqpni CabrinaHuang-Xingjitansuo 219.53 TiB 205 2cryptowhizzard
1dannyob
1kernelogic
2MegTei
1neogeweb3
1Reiers
1TimWilliams00
1xinaxu
f14r2jybmccwiu6hze4fu55jyhclktvwacec56hea FilSwan 200.20 TiB 2,585 3cryptowhizzard
2dannyob
1kernelogic
2MegTei
2neogeweb3
1Reiers
f1ah2mafwi2dd3ow6qyri5mcxgmhvuhzsb2hgm6qy Unknown 167.69 TiB 680 Unknown
f1fxxzmzqgaimalpg4343q6anqkb6krud5coabwuq Unknown 159.63 TiB 648 Unknown
f1jrqov7v2hgwhsu45u4bg57hexwlu24hu4gnazqa Unknown 149.19 TiB 621 Unknown
f1jbuabatuk4azxrccbwwhvtgpbaz6m3mxqwtjrcq Unknown 141.26 TiB 573 Unknown
f1uhc5v6w4fkxu6qnecyjkwkcscfuz55mirzosbfq TechGreedy 139.81 TiB 714 2cryptowhizzard
3Fenbushi-Filecoin
2jimcray
1MegTei
2Reiers
f1uwcmgygyqo6ecvssmpcapdc2ywctegpem6h4o6q Unknown 133.28 TiB 906 Unknown
f1ngggncvdhysn62kbocfr2vapxgbu5azfcgv24ia Unknown 106.09 TiB 431 Unknown
f126fwrzeit24lle2j2cbxicwmtst2j6kcfp2ba6i Unknown 66.72 TiB 292 Unknown
f17ia7m5mvizrdug3sqtevqw3tifiqvxqr3kdaeuq Speedium NetworkSpeedium Network 54.99 TiB 811 2dannyob
3flyworker
4MegTei
3Reiers
6s0nik42
f1srdxedjfgezixzx6x5asyr7k5l3v632dvwjkxci Unknown 46.37 TiB 465 Unknown
f3rmy6c7zoefq3bb4thhvmv35ihe4t35hyaivoxdr
zzmtt5zx6hrdp4ltgzccndggynjkc3joxxok3quv5
mg2a
Speedium 37.12 TiB 1,082
f144zep4gitj73rrujd3jw6iprljicx6vl4wbeavi Textile 35.91 TiB 455 1Alex11801
5cryptowhizzard
1dannyob
2flyworker
1IreneYoung
1liyunzhi-666
1MegTei
4Reiers
2s0nik42
1XnMatrixSV
f3tektw5tqjnxbcdybnp7kcskg7t3rndvvcu5w7us
x7m3exqsfkxezncpefsf6fmianjvwkc2qw5qsiim6
luua
Glif auto verified 30.86 TiB 269 Unknown
f3wgfwtrs5p6jrkwfl2mksqa2ivgbgdjjrhjbefy3
n7qzvotc3y6sazmp5gfyj7um6jlgdvlbiepzawnc6
wxtq
FileDrive Labs 29.25 TiB 490 1GaryGJG
1IreneYoung
3Joss-Hua
1liyunzhi-666
1MegTei
1MetaWaveInfo
3newwebgroup
2psh0691
f1jazufgrriehamquvuxzzfeapmkn55vrgaxx334i Unknown 26.61 TiB 136 Unknown
f1khxvc7t53r7wekis47gwqb6r2jndelt32uabkxq Unknown 23.34 TiB 104 Unknown
f3waqhsynu4a3w2a4mcwfaprd4fu6rgd3uuvt7mwj
5v24br7u6vcb37xbvgbdgekaav3vcc3m6spz6etuh
4aja
Julien NOEL 21.68 TiB 159
f1v4ptfxfdtm3gd6lm54w5jbtnsd5fllawgf42mnq Unknown 16.59 TiB 108 Unknown
f1lqspaidgfkirz2yzh73xc4bi7vc3tpmfe6pc2na Unknown 16.39 TiB 119 Unknown
f1s2na7nktgkbf6amxg4ag5z73jne3gfivqqwptea Unknown 12.48 TiB 84 Unknown
f1qmhjs5m6xyqjt3x3jz3hl6vkmhd5etwnct3nada Handmade Data 12.00 TiB 537
f3xcewu5k4ftbxprwqxxwdgqdb7pzvtg26gntnwlu
vfpkkzrviw5mr3rvb5fbu24vkdwercjwb4qdqynuy
smna
Unknown 11.33 TiB 70 Unknown
f3rpqqflz4bhyylporz3kjhejftvfs2gbjxv7gcw3
imvviklmrqgee2jqsgp6hrl35ufckv76kdd245q35
2dtq
Julien NOEL 9.69 TiB 83
f3u7cvbygc2i2cuofc3dmec3z25ipekk6pmkf5hok
fwzqi52jzec3ktycygpc7x7wacvithqhdmwfi5sn4
3gra
Unknown 7.91 TiB 52 Unknown
f3qaipvxrz2gxexc7mcvjsxifmscfiw7c7zfhrmq7
6j5ee4hcbvg3gbtpea7wgz72kkjcjmwzhm5uo2onx
yocq
Guazi Dynamic 6.77 TiB 262 2kernelogic
1newwebgroup
f3soaazrjuc4os4mtov5miqkqtozzeemvhugamp3o
ch7yuhk6jjndibfdmudtwblsxzjh4cgua4g3aoatq
iuxa
DukeSoft (Free Music Archive) 6.73 TiB 114 1fireflyHZ
1ipfscn
1kernelogic
1liyunzhi-666
3newwebgroup
3Tom-OriginStorage
f1r3d25hl2y7rqlsu2mgczdethy4qqjmkfdlmibfq NEXRAD - FilSwan 6.42 TiB 189 1cryptowhizzard
2IreneYoung
1jamerduhgamer
5kernelogic
1liyunzhi-666
1Reiers
1xingjitansuo
f1a5z2ulumzvqogr2hui6o5vsbzzebcvc5mm3aqei Unknown 6.33 TiB 41 Unknown
f3vlzrzb6wjzlogdkhd5bsu2dzq6hrqryciu7bysm
b7glimexcqfxzxrcfnygrco7j3zcw4346vb6oeue4
uvhq
Julien NOEL 4.88 TiB 39 2flyworker
1IreneYoung
1neogeweb3
f1c2nxtixkivuzmmezwawg4nwzoknvd7hto37cy4q CabrinaHuang-Slingshot Restore Program 4.28 TiB 137 2flyworker
2MegTei
1neogeweb3
1Reiers
f3v7x4a2aapgx6o2r477tenoin3u5oadaeqyd7kjd
sitykvf4ok7vq2utcyh34lmu5u7oybs25ff6s4dbu
dpma
LeoCheung - Slingshot Restore 4.23 TiB 120 1IreneYoung
1Joss-Hua
1liyunzhi-666
1MetaWaveInfo
1neogeweb3
1psh0691
f1xd4hex5q44mkddd2n3wr23jmbv7qyzqdcsyetea Tianjin Zhihui Marine Technology Co., Ltd 3.34 TiB 27 1MegTei
1Reiers
1s0nik42
1steven004
f1r73sc6w57lmgoioycsbywogdxyb674twpzma4hi Unknown 3.34 TiB 39 Unknown
f1lnecek42mynnu5ph7ucoikald2gucl6jty2ivty 3.13 TiB 100 3cryptowhizzard
3flyworker
1MegTei
2neogeweb3
1swatchliu
f1o54sve7ede7im4caux3ug7lsyjmbue7ss3zzl6y FilSwan 3.03 TiB 97 3cryptowhizzard
3IreneYoung
1jamerduhgamer
1Joss-Hua
9kernelogic
2liyunzhi-666
1xingjitansuo
f13mgaavpzwrdogtl36uxjgqpwew4ohrt6ln2u7ly Unknown 2.63 TiB 84 Unknown
f3tcqolyrf4npnqit625jswb4dzxy55e47i4npdsz
yhaht6i5kpwhgxy4hkr3axzvfh437j3gyxmzdlsec
o6ja
Unknown 2.02 TiB 23 Unknown
f1mbt4wgkln5weftclj3pvul4yypqhahidp32skzq `` 1.94 TiB 33 Unknown
f1ju5oabz45ceog6e7k5omdj56uspv2pzgghiyzdy SYNC LIVE JAPAN INC. 1.56 TiB 13 1BlockMakeronline
1MegTei
1psh0691
2Reiers
f1i7l42sbxdbiisql3pzvaz6zuncs6dd66r33jgoq Gameguess 1.53 TiB 33
f1tbpahbkpvybbdt4nm5qqcfqjkcsvgxeupad4ewi Unknown 1.42 TiB 98 Unknown
f14wtqj7vf5ptmfanv3gnnfxjkzlljb4nfqzjz7my `` 1.28 TiB 32 Unknown
f1gtpgfpa5aan4kqxz24eigbba4qyj4ful7gby42a Medindia 1.22 TiB 28
f12m4wzu4ynkpilkh5bv4zaadigmr6hml4zg46dhq Chengdu Sinso Technology Co., Ltd. 1.06 TiB 33 1Alex11801
5kernelogic
1psh0691
2Reiers
1xingjitansuo
f3rwpgzlybuforc3jqa35f7ngqvwoz2m45gn7ur2z
zdxjyti7cncsbuyjsnlkkjvuouwwammwu6sghopa5
4ohq
Unknown 1.03 TiB 17 Unknown
f3ror6oml3jc4w77elkgvxvdhb77awavb3g72uteh
skm2smqymturk7yrqlbwrj5npsi7u4axgovrvpan4
eb3q
Unknown 1008.00 GiB 14 Unknown
f1onedsxngh2nlnsdc6uad2qljka3q5m6pgvleata Rushradar 736.00 GiB 23
f3uvtm6irz4xhy3ynectkexk6h7oicvglqkbypsvg
xoul3ny463ub6his4qlbwssv7jcbiquwzvxdyw4li
yg6q
Unknown 576.00 GiB 4 Unknown
f3qtzdze2xwqvsylbdsacvzt77okd7lijnhje264m
t5hmzewqzddg4vzpcxvh37q5g2w3mkzhlfkl4zkxy
enaq
Unknown 576.00 GiB 3 Unknown
f3wosfzpzfkvox2cfkqibrdyyr2bmezxef5nzussb
s4ozhk65of5htlb5srxmnzfv3yiq6c5tzleozjl5c
zlya
Unknown 512.00 GiB 5 Unknown
f3woyrzyn634jgelyt4tj4hzw7mp7lxpacxbvaav3
f7jnb4jrowjzl4mjadlpxgvxdiu36w23fzlizc5vs
2bqa
Fin-File Crypto 508.00 GiB 41 Unknown
f1w63dfqucpzz5eqit6pci3hp23mfblnslagk7c3y Unknown 443.50 GiB 14 Unknown
f1dbpdc56q6wfcmb4p2ppzqruufiqcr2s5xqwybma `` 352.00 GiB 1 Unknown
f3s5nkmqxk3sr7ptgg5xsm4xfdmlh2edaqcknfzei
xfzvoph74q74wyljchplxb6djwx5tokkjwkvvzxym
2m3a
Unknown 336.00 GiB 6 Unknown
f1qlscna4ylxqwpdjtjrzkxmqed55p7pyn2lp55hy Glif auto verified 320.00 GiB 1 Unknown
f3s5qozdyocudxtt2ekvcbu34dj2ubt3b4fqdzjql
a7gj7442xckmlntcsmzibru6zkpiqlwflgn554cdh
w6va
Speedium 256.00 GiB 4
f1bbiqiiet3iyt6t6hvccb5pggop2jh7io2ezweji Glif auto verified 256.00 GiB 1 Unknown
f1rc65exfdzq63s6a5sqjejbxqcid4h3pqlubqs6i Unknown 248.00 GiB 2 Unknown
f1ztna4zcsmxpz2buyl2ordstu4wi5gq4hraeajyq Glif auto verified 216.00 GiB 5 Unknown
f3w5fx6wta4ewl2iyf7xcogmzffz2fmrngpzdpduj
3xmk3dwjxc6dyq36gdf3rflkkrblh5nci5xymc5ha
l3qq
USC Shoah Foundation[DEPRECATED] USC Shoah Foundation 192.00 GiB 1 1flyworker
1MegTei
1s0nik42
1swatchliu
1XnMatrixSV
f3uvwjknloel3zcmjrgrbmgqwp3c32l7b7tyoqj7p
7njb3c2xmex6dh2jzz45a6smzqvhw53nbng2zn2p7
ciza
askender 160.00 GiB 5 2Fenbushi-Filecoin
1jamerduhgamer
1KodaRobotDog
1ozhtdong
1psh0691
1rayshitou
2Reiers
3swatchliu
3TimWilliams00
f3ryh45hai5r6v4gt2zrz3mcnjqeedozs5klilcq2
gqnc766vhofeywuejqcvgfbebnvfdo5rcpz74mj2x
abtq
Unknown 128.00 GiB 1 Unknown
f3rxun7fp4cdeuxquwvv23aktw47mxlf7bdohuwk7
lmpkfofteo36fn32tnp7i42ta3hvpyuufwwcvcliu
hkrq
Vonechain 128.00 GiB 4 31ane-1
3cryptowhizzard
1Joss-Hua
4kernelogic
1llifezou
1MegTei
1newwebgroup
2psh0691
1xiaoyuaiheshui
2xinaxu
f14d4fpu4dtlvlrb7qllmolyyi6hkdaf74zyjka2a Unknown 128.00 GiB 2 Unknown
f1uyr5lvule563sf4kmi33w7v6ybpsjhabhsn7qda Jeweltours 96.00 GiB 3
f3rgbf6zqkxbqtmcbp72p544z67tcmsfceaefqnai
dsyoufsolw2dky5dcem4tx4vhpbrp55kwfdmxyks5
czvq
Unknown 76.00 GiB 3 Unknown
f1bycr5r3ymkgqvkuxoemgsmnuawyawptwj44mqdi FileDrive Labs 64.25 GiB 3 11ane-1
1cryptowhizzard
1Joss-Hua
2kernelogic
1NDLABS-OFFICE
1newwebgroup
1steven004
f3vmnxpsmdb5vdv6n7srtpqb4hdtd3ui2xntkk7ca
tzhg3r6kkok433ijtatqwtymt27unojrfas7sa4dz
6htq
Unknown 64.00 GiB 1 Unknown
f14uhjnqrocqcenbjfaergw2uvaimysi4snv2oepy FileDrive Labs 32.25 GiB 2 11ane-1
2cryptowhizzard
1Joss-Hua
3kernelogic
1NDLABS-OFFICE
1newwebgroup
1steven004
f14sofcfnlfaeunm47r4sf4zvfsegnvamihl5ylwi Glif auto verified 32.00 GiB 1 Unknown
f3ucumnjg35m6fae7bzrxpcvjx3t6t6eezrriqxmr
v3fqnvijnu6et554kmuca6qyfsywp2kmo3af5ruyu
lyva
Glif auto verified 32.00 GiB 1 Unknown
f1d2ec3ca5uswidohd3rs4cbb2ka4fgiz6prabthq Glif auto verified 32.00 GiB 1 Unknown
f1hw5szpu2kv4jwcyqye4aci23dcxlg2e4tq3ngti Glif auto verified 32.00 GiB 1 Unknown
f1yvbvtuspymqk5hnmvdrtqlukdg6tosdhwzf47yy Glif auto verified 32.00 GiB 1 Unknown
f1pddbml2fpavdgmvr7oieesr3hcsmlqlp7mkmzuq Glif auto verified 32.00 GiB 1 Unknown
f1vfflyoqdw7pva2xda3kpecfvf2yc32ggxyblfiy Unknown 32.00 GiB 1 Unknown
f3uhjdwtlys7ybeegd3zzbeeyr5gcv45f4rxxi4dj
rybrtgsgmavwrv3bu7rfr7zywspofwa7sc7cfox2i
67ma
Glif auto verified 12.00 GiB 3 Unknown
f3qcchteu6el6opgnmrgftvajbktsnhcs2a3lv2vm
vwwl5xhiyyyjjijaukqbdgdtizrk2t5xgojbzqtlz
ulmq
Glif auto verified 8.88 GiB 6 Unknown
f3rutut57upcbuzyq6si2xajhvr7d4u7exd7knqop
4t6w3bpl57uqpdnfs72t2tyaz7vivwdvyc3bzvq2i
37ma
Unknown 8.00 GiB 1 Unknown
f3v3lj5jrsvv3nwmsvvj57yyty6ndb27oyi4yaqhw
zst3emdv25hefna6vxhtpjb5pytwahdod67syxjyz
ba3q
Glif auto verified 8.00 GiB 1 Unknown
f1g463yb4ok3lq3tffkvvfmfyngcagpx4kg7c7rei Protocol Labs - Filecoin Discover 4.00 GiB 2 1cryptowhizzard
1KodaRobotDog
1MegTei
1TimWilliams00
f3wrt6m62ppas5xdyg5mxw2v6nhopoord2tpqjpbw
f2h5cgljgly6ei4tsenmsmqom3bj4h7blaugmi2jm
lneq
Glif auto verified 1.00 GiB 1 Unknown
f3rkcl5lnoumsunl3grsy2b57z7zt6uoyvgnviz2d
w3ir7sslnya2634as2ksfxzziuxzgubavqsb3s2fm
ofcq
Unknown 1.00 GiB 1 Unknown
f3xf4n2i4b6yl4etuhr6hzee6w7t4bcwa5m5ni7ux
ef4t4rbzpflkpwryjrfb4zria5mx4sdyr5vndllyh
fdjq
Glif auto verified 768.00 MiB 2 Unknown

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

dkkapur commented 1 year ago

This application needs porting over to LDN v3 rather than having a dedicated multisig from the v2 implementation of the LDN process. Last set of approvals have Error:17 (no DataCap balance) since the notary assigned to this is out.

Based on this, pushing a manual allocation for #6 for this address, but we need to swap this over. cc @simonkim0515 @galen-mcandrew can we get this systematically swapped over from deprecated notary to updated LDN v3 address?

dkkapur commented 1 year ago

DataCap Allocation requested

Request number 6

Multisig Notary address

f01858410

Client address

f1pkrmygbvweykpjcut36lf7ewgqdfhjklbhvepda

DataCap allocation requested

2000TiB

dkkapur commented 1 year ago

manually patching last comment from bot as well, just in case.

dkkapur commented 1 year ago

@s0nik42 @cryptowhizzard can you try resigning this one through notary tool now and let me know if it's working / the proposal is indeed for the intended 2000 TiB from the LDN v3 multisig?

s0nik42 commented 1 year ago

wip

cryptowhizzard commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacecdgtff4jkstmupgakfd7zkobumk6zs7tsj2hgwifgj6s2dbq6fbq

Address

f1pkrmygbvweykpjcut36lf7ewgqdfhjklbhvepda

Datacap Allocated

500.00TiB

Signer Address

f1krmypm4uoxxf3g7okrwtrahlmpcph3y7rbqqgfa

Id

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecdgtff4jkstmupgakfd7zkobumk6zs7tsj2hgwifgj6s2dbq6fbq

s0nik42 commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacedke2ujatzz7dlcfs75rohnrejflvpiygh4ipeoa7ew6wq2qvnhoi

Address

f1pkrmygbvweykpjcut36lf7ewgqdfhjklbhvepda

Datacap Allocated

500.00TiB

Signer Address

f1wxhnytjmklj2czezaqcfl7eb4nkgmaxysnegwii

Id

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedke2ujatzz7dlcfs75rohnrejflvpiygh4ipeoa7ew6wq2qvnhoi

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f1pkrmygbvweykpjcut36lf7ewgqdfhjklbhvepda

Last two approvers

s0nik42 & cryptowhizzard

Rule to calculate the allocation request amount

total dc reached

DataCap allocation requested

0

Total DataCap granted for client so far

2.68PiB

Datacap to be granted to reach the total amount requested by the client (5 PiB)

2.31PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
131806 48 2000TiB 15.6 32.01GiB
galen-mcandrew commented 1 year ago

Looks like still trying to pull from old msig, not the v3 LDN Screen Shot 2023-01-31 at 9 50 09 AM

dkkapur commented 1 year ago

hmmmm. ok still going to the old notary ID. cc @fabriziogianni7 might be a bug, but feels like quite an edge case. going to pivot into making a new application for this one instead to reduce complexity. Will stick with remaining PiBs but inflate the weekly rate for it to keep up.

dkkapur commented 1 year ago

Closing this one out in favor of https://github.com/filecoin-project/filecoin-plus-large-datasets/issues/1576