search

filecoin-project / filecoin-plus-large-datasets

Hub for client applications for DataCap at a large scale
110 stars 62 forks source link

[DataCap Application] <BossDB Open Neuroimagery Datasets><2/2> #1836

Closed caoxinhe0108 closed 7 months ago

caoxinhe0108 commented 1 year ago

Data Owner Name

Johns Hopkins University Applied Physics Laboratory

Data Owner Country/Region

United States

Data Owner Industry

Life Science / Healthcare

Website

https://registry.opendata.aws/bossdb

Social Media

https://registry.opendata.aws/bossdb

Total amount of DataCap being requested

10PiB

Weekly allocation of DataCap requested

1PiB

On-chain address for first allocation

f1ynv3f5ne5k7xxr7z5q7coro7rqpls3ilhuz3ndy

Data Type of Application

Public, Open Dataset (Research/Non-Profit)

Custom multisig

Identifier

No response

Share a brief history of your project and organization

This data ecosystem, Brain Observatory Storage Service & Database (BossDB), contains several neuro-imaging datasets across multiple modalities and scales, ranging from nanoscale (electron microscopy), to microscale (cleared lightsheet microscopy and array tomography), and mesoscale (structural and functional magnetic resonance imaging). Additionally, many of the datasets include dense segmentation and meshes.

Is this project associated with other projects/ecosystem stakeholders?

Yes

If answered yes, what are the other projects/ecosystem stakeholders

No response

Describe the data being stored onto Filecoin

This data ecosystem, Brain Observatory Storage Service & Database (BossDB), contains several neuro-imaging datasets across multiple modalities and scales, ranging from nanoscale (electron microscopy), to microscale (cleared lightsheet microscopy and array tomography), and mesoscale (structural and functional magnetic resonance imaging). Additionally, many of the datasets include dense segmentation and meshes.

Where was the data currently stored in this dataset sourced from

AWS Cloud

If you answered "Other" in the previous question, enter the details here

No response

How do you plan to prepare the dataset

lotus

If you answered "other/custom tool" in the previous question, enter the details here

No response

Please share a sample of the data

aws s3 ls --no-sign-request s3://bossdb-open-data/

2022-02-26 11:02:10 1.5 KiB witvliet2020/Dataset_8_Segmentation/synapses/info
2022-02-26 11:02:11 1.5 KiB witvliet2020/Dataset_8_Segmentation/synapses/provenance
2022-02-18 05:20:18 446 Bytes witvliet2020/Dataset_8_Segmentation/template/info
2022-06-21 10:00:04 3.8 KiB witvliet2020/Dataset_8_Segmentation_Properties/info

Total Objects: 664318037
Total Size: 849.7 TiB

Confirm that this is a public dataset that can be retrieved by anyone on the Network

If you chose not to confirm, what was the reason

No response

What is the expected retrieval frequency for this data

Yearly

For how long do you plan to keep this dataset stored on Filecoin

1.5 to 2 years

In which geographies do you plan on making storage deals

Greater China, Asia other than Greater China, North America, South America

How will you be distributing your data to storage providers

Cloud storage (i.e. S3)

How do you plan to choose storage providers

Slack, Big data exchange

If you answered "Others" in the previous question, what is the tool or platform you plan to use

No response

If you already have a list of storage providers to work with, fill out their names and provider IDs below

No response

How do you plan to make deals to your storage providers

No response

If you answered "Others/custom tool" in the previous question, enter the details here

No response

Can you confirm that you will follow the Fil+ guideline

Yes

large-datacap-requests[bot] commented 1 year ago

Thanks for your request!

Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!
large-datacap-requests[bot] commented 1 year ago

Thanks for your request!

Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!
large-datacap-requests[bot] commented 1 year ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

large-datacap-requests[bot] commented 1 year ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

caoxinhe0108 commented 1 year ago

This is the SP that I am currently cooperating with, please check it out, thank you

f02050599 Bang Sai, Phra Nakhon Si Ayutthaya, TH f02063202 Mueang Nonthaburi, Nonthaburi, TH f02064089 Singapore, Singapore, SG f02058557 Kuala Lumpur, Kuala Lumpur, MY f02045964 Sham Shui Po, Sham Shui Po, HK f02055638 Kuala Lumpur, Kuala Lumpur, MY f02056391 Hong Kong, Central and Western, HK f02048990 Hong Kong, Central and Western, HK f02041085 Tokyo, Tokyo, JP f02044834 Singapore, Singapore, SG f02046736 Jakarta, Jakarta, ID f02030031 Singapore, Singapore, SG f02029895 Seoul, Seoul, KR f01170282 Hong Kong, Central and Western, HK f02059055 Seoul, Seoul, KR f02042992 Singapore, Singapore, SG

Sunnyiscoming commented 1 year ago

Datacap Request Trigger

Total DataCap requested

5PiB

Expected weekly DataCap usage rate

600TiB

Client address

f147wnixotnvgcjacmwqlhj7qrkb2g2zhcvt3ykwa

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Multisig Notary address

f02049625

Client address

f147wnixotnvgcjacmwqlhj7qrkb2g2zhcvt3ykwa

DataCap allocation requested

256TiB

Id

d232b320-ff2f-49d7-9764-27d73746819c

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Multisig Notary address

f02049625

Client address

f147wnixotnvgcjacmwqlhj7qrkb2g2zhcvt3ykwa

DataCap allocation requested

256TiB

Id

ec394149-b79e-4f8e-9aaa-6e59981b1cb5

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report[^1]

No application info found for this issue on https://filplus.d.interplanetary.one/clients.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

TimGuo7 commented 1 year ago

happy to support after checked the required areas.

TimGuo7 commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacebgglqxl6gj7cwnakj7s5fagurheclndntgct263xcfzgckao2igq

Address

f147wnixotnvgcjacmwqlhj7qrkb2g2zhcvt3ykwa

Datacap Allocated

256.00TiB

Signer Address

f1yslbnnqzrjlyuxsmyxfbqcc7xthcavgpripjevi

Id

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebgglqxl6gj7cwnakj7s5fagurheclndntgct263xcfzgckao2igq

a1991car commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceavvdbmmdr2o7p4kpw35n6ygptm7uw6i2lsthfk2wf3wswhuxalnw

Address

f147wnixotnvgcjacmwqlhj7qrkb2g2zhcvt3ykwa

Datacap Allocated

256.00TiB

Signer Address

f1qnumecdypgrbaebtkdfjnwt5ndacadcuas3deiq

Id

ec394149-b79e-4f8e-9aaa-6e59981b1cb5

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceavvdbmmdr2o7p4kpw35n6ygptm7uw6i2lsthfk2wf3wswhuxalnw

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 14 days, so for now it is being closed. Please feel free to re-open if this is relevant, or start a new application for DataCap anytime. Thank you!

caoxinhe0108 commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report[^1]

No active deals found for this client.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

caoxinhe0108 commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the full report.

caoxinhe0108 commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval report.

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 2

Multisig Notary address

f02049625

Client address

f147wnixotnvgcjacmwqlhj7qrkb2g2zhcvt3ykwa

DataCap allocation requested

512TiB

Id

4c28b630-39f3-4c0f-a91f-8b365c4b9d63

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f02049625

Client address

f147wnixotnvgcjacmwqlhj7qrkb2g2zhcvt3ykwa

Rule to calculate the allocation request amount

100% weekly > 0.5PiB, requesting 0.5PiB

DataCap allocation requested

512TiB

Total DataCap granted for client so far

256TiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

4.75PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
3697 7 256TiB 19.69 17.81TiB
Chuangshi1 commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacea5nnhngq4rnmygnnaenig64faaagmo5orcwmi6pwkibnztud5zms

Address

f147wnixotnvgcjacmwqlhj7qrkb2g2zhcvt3ykwa

Datacap Allocated

512.00TiB

Signer Address

f1mdk7s2vntzm6hu35yuo6vjubtrpfnb2awhgvrri

Id

4c28b630-39f3-4c0f-a91f-8b365c4b9d63

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacea5nnhngq4rnmygnnaenig64faaagmo5orcwmi6pwkibnztud5zms

SuperChaiChai commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceacqorsb2qo2nmn6e2oajzrbge6bukaxkpbzu3vfbajmqp26vdn4i

Address

f147wnixotnvgcjacmwqlhj7qrkb2g2zhcvt3ykwa

Datacap Allocated

512.00TiB

Signer Address

f12mckci3omexgzoeosjvstcfxfe4vqw7owdia3da

Id

4c28b630-39f3-4c0f-a91f-8b365c4b9d63

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceacqorsb2qo2nmn6e2oajzrbge6bukaxkpbzu3vfbajmqp26vdn4i

caoxinhe0108 commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval report.

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 3

Multisig Notary address

f02049625

Client address

f147wnixotnvgcjacmwqlhj7qrkb2g2zhcvt3ykwa

DataCap allocation requested

1PiB

Id

5c5ae5c8-882c-415f-bc1f-7235cd3e1b99

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f02049625

Client address

f147wnixotnvgcjacmwqlhj7qrkb2g2zhcvt3ykwa

Rule to calculate the allocation request amount

200% weekly > 1PiB, requesting 1PiB

DataCap allocation requested

1PiB

Total DataCap granted for client so far

465661.3YiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

465661.3YiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
10000 7 512TiB 21.12 126.56TiB
1ane-1 commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval report.

ipollo00 commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval report.

ipollo00 commented 1 year ago

DD: The data backup keeps growing, every node can be retrieved, and the initial reports are healthy without any issues. Willing to support.

ipollo00 commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacebsnj5myt5pivr7x6srpcregt22dikkqvqs4jhcfiugtetbetqxkq

Address

f147wnixotnvgcjacmwqlhj7qrkb2g2zhcvt3ykwa

Datacap Allocated

1.00PiB

Signer Address

f1n5wlrrhoxpkgwij25xrtt7w7g2k3fhbthmdn6ri

Id

5c5ae5c8-882c-415f-bc1f-7235cd3e1b99

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebsnj5myt5pivr7x6srpcregt22dikkqvqs4jhcfiugtetbetqxkq

igoovo commented 1 year ago

It looks normal. I can give my support.

igoovo commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceastiocw3xpeoy6ntsyneb6ksix2l4kb5i77ohkg6gajz437k75kw

Address

f147wnixotnvgcjacmwqlhj7qrkb2g2zhcvt3ykwa

Datacap Allocated

1.00PiB

Signer Address

f1shnsfayxqll77svffaxnjenms7bbbysbqcatrpy

Id

5c5ae5c8-882c-415f-bc1f-7235cd3e1b99

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceastiocw3xpeoy6ntsyneb6ksix2l4kb5i77ohkg6gajz437k75kw

github-actions[bot] commented 11 months ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

caoxinhe0108 commented 11 months ago

checker:manualTrigger

filplus-checker-app[bot] commented 11 months ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

cryptowhizzard commented 11 months ago

Just a short message.

http://datasetcreators.com/downloadedcarfiles/1836-f02100549-f02058146-40174839-baga6ea4seaqdzy6gomv6gfal6ptwui2cbqtt5lxbowrp2awet6mdrl6hj25jyda/

Retrieving files works. Applicant is storing according to what he indicated in the LDN subject.

Good work!

github-actions[bot] commented 11 months ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

caoxinhe0108 commented 11 months ago

It's in progress

caoxinhe0108 commented 10 months ago

checker:manualTrigger

filplus-checker-app[bot] commented 10 months ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

⚠️ 1 storage providers sealed more than 30% of total datacap - f02042112: 30.93%

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

large-datacap-requests[bot] commented 10 months ago

DataCap Allocation requested

Request number 4

Multisig Notary address

f02049625

Client address

f147wnixotnvgcjacmwqlhj7qrkb2g2zhcvt3ykwa

DataCap allocation requested

2PiB

Id

27d096b9-d966-45b0-ad72-3bb0148c407f

large-datacap-requests[bot] commented 10 months ago

Stats & Info for DataCap Allocation

Multisig Notary address

f02049625

Client address

f147wnixotnvgcjacmwqlhj7qrkb2g2zhcvt3ykwa

Rule to calculate the allocation request amount

400% weekly > 2PiB, requesting 2PiB

DataCap allocation requested

2PiB

Total DataCap granted for client so far

931322574615478927360.0YiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

931322574615478927360.0YiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
22533 14 1PiB 30.36 257.87TiB
mikezli commented 10 months ago

checker:manualTrigger

mikezli commented 10 months ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaced2d3sqy75ocohpcu3fo62smgvnisp2bqb6cb3cqtpembzjgemvci

Address

f147wnixotnvgcjacmwqlhj7qrkb2g2zhcvt3ykwa

Datacap Allocated

2.00PiB

Signer Address

f1dnb3uz7sylxk6emti3ififcvu3nlufnnsjui6ea

Id

27d096b9-d966-45b0-ad72-3bb0148c407f

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaced2d3sqy75ocohpcu3fo62smgvnisp2bqb6cb3cqtpembzjgemvci

filplus-checker-app[bot] commented 10 months ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

sxxfuture-official commented 10 months ago

Good report and retrieval rate, will support

sxxfuture-official commented 10 months ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacebsndmosk5haassj6ap4dcc5vc34sc6u2yi6pkw4yop7ilnhnhex6

Address

f147wnixotnvgcjacmwqlhj7qrkb2g2zhcvt3ykwa

Datacap Allocated

2.00PiB

Signer Address

f1foiomqlmoshpuxm6aie4xysffqezkjnokgwcecq

Id

27d096b9-d966-45b0-ad72-3bb0148c407f

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebsndmosk5haassj6ap4dcc5vc34sc6u2yi6pkw4yop7ilnhnhex6