search

filecoin-project / filecoin-plus-large-datasets

Hub for client applications for DataCap at a large scale
110 stars 62 forks source link

[DataCap Application] NDLABS - Life Sciences Dataset <3/4> #1523

Closed NDLABS-Leo closed 1 year ago

NDLABS-Leo commented 1 year ago

Data Owner Name

NDLABS

Data Owner Country/Region

Singapore

Data Owner Industry

Life Science / Healthcare

Website

https://www.ndlabs.io/#/

Social Media

Twitter： @imNDLABS
Slack： @NDLABS-OFFICE

Total amount of DataCap being requested

5PiB

Weekly allocation of DataCap requested

500TiB

On-chain address for first allocation

f17nerghj2kmg7b4e6asft3xexga5qbzbqe3hi4gy

Custom multisig

Identifier

No response

Share a brief history of your project and organization

ND LABS has technical operation centers and nodes in Singapore, Hong Kong, the United States, and Dubai. Since Fil has launch of the mainnet in 2020, ND has begun to provide technical services to partners to help them complete the construction of storage services. At present, the accumulated storage power of ND exceeds 300P globally. The largest node has 100P storage power, and the node owns exceeds more than 1.4 million FIL. 
ND LABS is positioned as a decentralized storage service provider for WEB3. For a long time, ND not only focuses on building nodes for partners, but also explores how to provide better storage services for potential clients of web3. Since October 2021, ND has been deeply involved in the FilPlus project, vigorously promoting the Filplus project to partners who has effective data storage needs. We also providing them with a complete set of solutions and technical services for storing data in the FIL network. The Singapore and US nodes are the main storage nodes, which was provide real data storage for early customers.

Is this project associated with other projects/ecosystem stakeholders?

Yes

If answered yes, what are the other projects/ecosystem stakeholders

We gonna cooperate with more SPs from other regions

Describe the data being stored onto Filecoin

For the first phase, we gonna store open datasets of Life Sciences from AWS with a total size of 2 PiB. 
Life Sciences Open Datasets has a total of 102 items, including but not limited to the following items. 
-Therapeutically Applicable Research to Generate Effective Treatments (TARGET)
-Gabriella Miller Kids First Pediatric Research Program (Kids First)
-Genome Aggregation Database (gnomAD)
-Allen Cell Imaging Collections
-International Neuroimaging Data-Sharing Initiative (INDI)
-Cell Organelle Segmentation in Electron Microscopy (COSEM) on AWS
-Distributed Archives for Neurophysiology Data Integration (DANDI)

Where was the data currently stored in this dataset sourced from

My Own Storage Infra

If you answered "Other" in the previous question, enter the details here

No response

How do you plan to prepare the dataset

IPFS, lotus

If you answered "other/custom tool" in the previous question, enter the details here

No response

Please share a sample of the data

https://ocg.cancer.gov/programs/target/
https://kidsfirstdrc.org/

Confirm that this is a public dataset that can be retrieved by anyone on the Network

If you chose not to confirm, what was the reason

No response

What is the expected retrieval frequency for this data

Yearly

For how long do you plan to keep this dataset stored on Filecoin

1 to 1.5 years

In which geographies do you plan on making storage deals

Greater China, Asia other than Greater China, North America

How will you be distributing your data to storage providers

Cloud storage (i.e. S3), HTTP or FTP server, IPFS, Shipping hard drives, Lotus built-in data transfer

How do you plan to choose storage providers

Slack, Filmine, Partners

If you answered "Others" in the previous question, what is the tool or platform you plan to use

No response

If you already have a list of storage providers to work with, fill out their names and provider IDs below

We are one of the members from Singapore SPWG and we also join in other SPWG. SPs from the SPWG are trustable and experienced. 
Also, we are engaging in encouraging more small SPs to join the Filecoin network. What’s more, We will provide those small SPs who newly join the network with technology support.

How do you plan to make deals to your storage providers

Lotus client

If you answered "Others/custom tool" in the previous question, enter the details here

No response

Can you confirm that you will follow the Fil+ guideline

Yes

large-datacap-requests[bot] commented 1 year ago

Thanks for your request!

Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!
large-datacap-requests[bot] commented 1 year ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

herrehesse commented 1 year ago

@NDLABS-OFFICE Awesome application! Can you try and answer my questionnaire posted in the 1/4 request #1521 ?

simonkim0515 commented 1 year ago

Datacap Request Trigger

Total DataCap requested

5PiB

Expected weekly DataCap usage rate

500TiB

Client address

f17nerghj2kmg7b4e6asft3xexga5qbzbqe3hi4gy

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Multisig Notary address

f01858410

Client address

f17nerghj2kmg7b4e6asft3xexga5qbzbqe3hi4gy

DataCap allocation requested

250TiB

Id

d30bb9d1-98dd-4f38-aa9b-62d213dee4fa

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report[^1]

There is no previous allocation for this issue.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

NiwanDao commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacearjffiycy72ru7sueptzbimbpd57ci5hzmklzzrs3mubbsnoay5w

Address

f17nerghj2kmg7b4e6asft3xexga5qbzbqe3hi4gy

Datacap Allocated

250.00TiB

Signer Address

f1a2lia2cwwekeubwo4nppt4v4vebxs2frozarz3q

Id

d30bb9d1-98dd-4f38-aa9b-62d213dee4fa

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacearjffiycy72ru7sueptzbimbpd57ci5hzmklzzrs3mubbsnoay5w

ipfscn commented 1 year ago

As a listed company, NDLabs has strong strength, and I am willing to express my support for the time being

ipfscn commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacebwohvmbi2zrn46eg434ktcnzelswqqy6mwejupxl7dui6ncoz5ae

Address

f17nerghj2kmg7b4e6asft3xexga5qbzbqe3hi4gy

Datacap Allocated

250.00TiB

Signer Address

f1j4n74chme7whbz3yls4a7ixqewb6dijypqg2a3a

Id

d30bb9d1-98dd-4f38-aa9b-62d213dee4fa

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebwohvmbi2zrn46eg434ktcnzelswqqy6mwejupxl7dui6ncoz5ae

NDLABS-Leo commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report[^1]

No application info found for this issue on https://filplus.d.interplanetary.one/clients.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

large-datacap-requests[bot] commented 1 year ago

Deleting comment

@fabriziogianni7 hasn't the permissions to post this comment.

Please, contact the assignee of this issue.

fabriziogianni7 commented 1 year ago

DataCap Allocation requested

Multisig Notary address

f01858410

Client address

f17nerghj2kmg7b4e6asft3xexga5qbzbqe3hi4gy

DataCap allocation requested

500TiB

Id

d30bb9d1-98dd-4f38-bb9b-62d213dee4fa

flyworker commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

https://github.com/data-preservation-programs/filplus-checker-assets/blob/main/filecoin-project/filecoin-plus-large-datasets/issues/1523/1676469508981.md

NDLABS-Leo commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

https://github.com/data-preservation-programs/filplus-checker-assets/blob/main/filecoin-project/filecoin-plus-large-datasets/issues/1523/1676553807605.md

flyworker commented 1 year ago

manual trigger has issue. where can i get deal list?

kernelogic commented 1 year ago

My DD: https://github.com/filecoin-project/filecoin-plus-large-datasets/issues/1521#issuecomment-1418502515

kernelogic commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacea4gqwp6p7l2qhwg7wb5pxipdspogvyrr2d2zycp7vffiyghreyyk

Address

f17nerghj2kmg7b4e6asft3xexga5qbzbqe3hi4gy

Datacap Allocated

500.00TiB

Signer Address

f1yjhnsoga2ccnepb7t3p3ov5fzom3syhsuinxexa

Id

d30bb9d1-98dd-4f38-bb9b-62d213dee4fa

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacea4gqwp6p7l2qhwg7wb5pxipdspogvyrr2d2zycp7vffiyghreyyk

xiaoyuaiheshui commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

https://github.com/data-preservation-programs/filplus-checker-assets/blob/main/filecoin-project/filecoin-plus-large-datasets/issues/1523/1676628374595.md

xiaoyuaiheshui commented 1 year ago

There seems to be a problem with the machine, waiting to review the list.

NDLABS-Leo commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report[^1]

No application info found for this issue on https://filplus.d.interplanetary.one/clients.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

NDLABS-Leo commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report[^1]

No application info found for this issue on https://filplus.d.interplanetary.one/clients.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

NDLABS-Leo commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

⚠️ CID sharing has been observed. (Top 3)

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the full report.

Joss-Hua commented 1 year ago

checker:manualTrigger < f1q6rat3ob7c56ea4hghcj7fkgmjvmqo2lammjxvy>

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Other Addresses[^2]

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

⚠️ CID sharing has been observed. (Top 3)

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the full report.

Joss-Hua commented 1 year ago

1521 #1522 #1524 Relevant LDN was checked together and no abnormality was reported.

Joss-Hua commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceavdfmezpoebxbexsjfc3n4qhnpmhwgpg2z54umb566mevioxn4hm

Address

f17nerghj2kmg7b4e6asft3xexga5qbzbqe3hi4gy

Datacap Allocated

500.00TiB

Signer Address

f1tfg54zzscugttejv336vivknmsnzzmyudp3t7wi

Id

d30bb9d1-98dd-4f38-bb9b-62d213dee4fa

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceavdfmezpoebxbexsjfc3n4qhnpmhwgpg2z54umb566mevioxn4hm

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 3

Multisig Notary address

f01858410

Client address

f17nerghj2kmg7b4e6asft3xexga5qbzbqe3hi4gy

DataCap allocation requested

1000.0TiB

Id

22055e45-3306-4501-859e-05bcb9c1e1ea

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f17nerghj2kmg7b4e6asft3xexga5qbzbqe3hi4gy

Last two approvers

Joss-Hua & kernelogic

Rule to calculate the allocation request amount

200% of weekly dc amount requested

DataCap allocation requested

1000.0TiB

Total DataCap granted for client so far

250TiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

4.75PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
null null 500TiB null 0B
filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

⚠️ CID sharing has been observed. (Top 3)

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the full report.

NDLABS-Leo commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 78.53% of deals are for data replicated across less than 3 storage providers.

Deal Data Shared with other Clients[^3]

⚠️ CID sharing has been observed. (Top 3)

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the full report.

NDLABS-Leo commented 1 year ago

Hi community members and notaries, FYI, here are clarifying data replication: Cause the SPs we cooperate with are located in different areas and their onboarding speed is not in line. The report of data replication will be back to normal when they finish the all data sealing.

psh0691 commented 1 year ago

Continuous support for the previous series.

psh0691 commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacedvt7ttac7hza2tkqdoqu5arhwxuwskbikeevglzclsxvuasw43l6

Address

f17nerghj2kmg7b4e6asft3xexga5qbzbqe3hi4gy

Datacap Allocated

1000.00TiB

Signer Address

f1qdko4jg25vo35qmyvcrw4ak4fmuu3f5rif2kc7i

Id

22055e45-3306-4501-859e-05bcb9c1e1ea

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedvt7ttac7hza2tkqdoqu5arhwxuwskbikeevglzclsxvuasw43l6

NDLABS-Leo commented 1 year ago

@psh0691 thank you for your support.

1ane-1 commented 1 year ago
f989b25d93b20c0c0d3160e2fa5394d

i will suport it

1ane-1 commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacea6wsiwzbexqhwhnaruxqgosv3l4zjjxmtk3loabkimjmngazsydm

Address

f17nerghj2kmg7b4e6asft3xexga5qbzbqe3hi4gy

Datacap Allocated

1000.00TiB

Signer Address

f1mdk7s2vntzm6hu35yuo6vjubtrpfnb2awhgvrri

Id

22055e45-3306-4501-859e-05bcb9c1e1ea

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacea6wsiwzbexqhwhnaruxqgosv3l4zjjxmtk3loabkimjmngazsydm

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 4

Multisig Notary address

f02049625

Client address

f17nerghj2kmg7b4e6asft3xexga5qbzbqe3hi4gy

DataCap allocation requested

1.95PiB

Id

2bd31743-269a-4dc6-91cb-b20a327dd354

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f17nerghj2kmg7b4e6asft3xexga5qbzbqe3hi4gy

Rule to calculate the allocation request amount

400% of weekly dc amount requested

DataCap allocation requested

1.95PiB

Total DataCap granted for client so far

909494701772928712704.0YiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

-1.09B

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
38823 14 1000.0TiB 16.49 257.37TiB
luobin544 commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacea7tyzlq366st3sw2di4dji5bqvpbnp5lkxwfbdozy2afecridi3i

Address

f17nerghj2kmg7b4e6asft3xexga5qbzbqe3hi4gy

Datacap Allocated

1.95PiB

Signer Address

f1tbd632f6w62glfaf7wjpimacbnjiz26poyoes2q

Id

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacea7tyzlq366st3sw2di4dji5bqvpbnp5lkxwfbdozy2afecridi3i

DaYouGroup commented 1 year ago

Same as 1522

DaYouGroup commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacearuzt5hcfg6blatq5sx7c3op7zazgtjpmvc75546jpn5l7h5wtys

Address

f17nerghj2kmg7b4e6asft3xexga5qbzbqe3hi4gy

Datacap Allocated

1.95PiB

Signer Address

f1nwjsd2mc6hu4qrwnmd6ukrfkuu4h5fhs7u3exii

Id

2bd31743-269a-4dc6-91cb-b20a327dd354

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacearuzt5hcfg6blatq5sx7c3op7zazgtjpmvc75546jpn5l7h5wtys

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 4

Multisig Notary address

f02049625

Client address

f17nerghj2kmg7b4e6asft3xexga5qbzbqe3hi4gy

DataCap allocation requested

1.95PiB

Id

962733a6-2bf3-4c76-b929-09d8332f414a