search

filecoin-project / filecoin-plus-large-datasets

Hub for client applications for DataCap at a large scale
109 stars 62 forks source link

[DataCap Application] Genome Ark #1678

Closed Micaucas closed 11 months ago

Micaucas commented 1 year ago

Data Owner Name

Genome 10K Community of Scientists

Data Owner Country/Region

United States

Data Owner Industry

Life Science / Healthcare

Website

https://genome10k.ucsc.edu/

Social Media

Twitter: https://twitter.com/genome10k
Facebook: https://www.facebook.com/genome10k/

Total amount of DataCap being requested

5PiB

Weekly allocation of DataCap requested

400TiB

On-chain address for first allocation

f1pt35xbg63qo4kwomz6monedjst2yqd5pdfw4lpa

Custom multisig

Identifier

No response

Share a brief history of your project and organization

The Genome 10K Organization is a community of scientists dedicated to the preservation and understanding of genetic diversity in the animal species on our planet. We organize and facilitate projects, such as the Bat 1K, the Bird 10K, and our flagship, the Vertebrate Genomes Project, to sequence the genomes from as many animals as possible, while partnering with sister projects such as the Earth Biogenome Project, the Insect 5K (i5K), and the GIGA – Global Invertebrate Genomics Alliance. Our goal is to assemble a genomic zoo that will live forever as a basis for the science and preservation of life.

Is this project associated with other projects/ecosystem stakeholders?

No

If answered yes, what are the other projects/ecosystem stakeholders

No response

Describe the data being stored onto Filecoin

The Genome Ark hosts genomic information for the Vertebrate Genomes Project (VGP) and other related projects. The VGP is an international collaboration that aims to generate complete and near error-free reference genomes for all extant vertebrate species. These genomes will be used to address fundamental questions in biology and disease, to identify species most genetically at risk for extinction, and to preserve genetic information of life.
Total: 583.8TiB

Where was the data currently stored in this dataset sourced from

AWS Cloud

If you answered "Other" in the previous question, enter the details here

No response

How do you plan to prepare the dataset

lotus, I don't know yet

If you answered "other/custom tool" in the previous question, enter the details here

No response

Please share a sample of the data

https://registry.opendata.aws/genomeark/

Confirm that this is a public dataset that can be retrieved by anyone on the Network

If you chose not to confirm, what was the reason

No response

What is the expected retrieval frequency for this data

Sporadic

For how long do you plan to keep this dataset stored on Filecoin

More than 3 years

In which geographies do you plan on making storage deals

Asia other than Greater China, North America, Europe

How will you be distributing your data to storage providers

HTTP or FTP server, IPFS, Shipping hard drives, I don't know yet

How do you plan to choose storage providers

Slack, Filmine, Big data exchange, I don't know yet

If you answered "Others" in the previous question, what is the tool or platform you plan to use

No response

If you already have a list of storage providers to work with, fill out their names and provider IDs below

No response

How do you plan to make deals to your storage providers

Boost client, Lotus client, I don't know yet

If you answered "Others/custom tool" in the previous question, enter the details here

No response

Can you confirm that you will follow the Fil+ guideline

Yes

large-datacap-requests[bot] commented 1 year ago

Thanks for your request!

Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!
large-datacap-requests[bot] commented 1 year ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

cryptowhizzard commented 1 year ago

Dear applicant,

Thank you for applying for datacap. As Filecoin FIL+ notary i am screening your application and conducting due diligence.

Looking at your application i have some questions: As you are brand new on Github and have no history of past applications it seems to me that applying for 5PB of datacap is a lot. One needs comprehensive knowledge of Filecoin, packing of data, distribution of data and all it's requirements coming with it. Are you brand new in the Filecoin space or have you applied for datacap in the past on different Github account names?

Can you show us visible proof of the size of your data and the storage systems you have there?

As last question i would like you to fill out this form to provide us with the necessary information to make a educated decision on your LDN request if we would like to support it.

Thanks!

Sunnyiscoming commented 1 year ago

Could you send an email to filplus-app-review@fil.org with your official domain in order to confirm your identity? Email name should includes the issue id #1678.

Micaucas commented 1 year ago

@cryptowhizzard Hello, since I haven't contacted the sp, I can't fill out the form yet. Thank you!

Micaucas commented 1 year ago

@Sunnyiscoming Hello, I'm an individual sp. And I will continue to participate in the test of FVM.

Sunnyiscoming commented 1 year ago

Weekly allocation of DataCap requested 400TiB

Can you give more detailed plan about sps you will cooperate with?

Micaucas commented 1 year ago

@Sunnyiscoming OK. I'm contacting several SPs for this dataset storing. Our communication is in process.

Sunnyiscoming commented 1 year ago

Datacap Request Trigger

Total DataCap requested

5PiB

Expected weekly DataCap usage rate

400TiB

Client address

f1pt35xbg63qo4kwomz6monedjst2yqd5pdfw4lpa

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Multisig Notary address

f02049625

Client address

f1pt35xbg63qo4kwomz6monedjst2yqd5pdfw4lpa

DataCap allocation requested

200TiB

Id

1ed641a8-a926-43cc-a525-3ee23cb7b6e2

Bennyyangpu commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacebtg25u53lcp4k2ob4n43nl5m7jfxady6hm2y5vygabsme3vogzvs

Address

f1pt35xbg63qo4kwomz6monedjst2yqd5pdfw4lpa

Datacap Allocated

200.00TiB

Signer Address

f174fg3bqbln3zjnkxtyf6s54txqkr7yqkj6cig7y

Id

1ed641a8-a926-43cc-a525-3ee23cb7b6e2

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebtg25u53lcp4k2ob4n43nl5m7jfxady6hm2y5vygabsme3vogzvs

Casey-PG commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacebnvxxdlguynp3zap4hs37lqkimo7zdxu5hynmkb3rly4kdehry5c

Address

f1pt35xbg63qo4kwomz6monedjst2yqd5pdfw4lpa

Datacap Allocated

200.00TiB

Signer Address

f1d4yb3wags3mtddzesxoo63jv7dmlec3bq4yteni

Id

1ed641a8-a926-43cc-a525-3ee23cb7b6e2

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebnvxxdlguynp3zap4hs37lqkimo7zdxu5hynmkb3rly4kdehry5c

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 2

Multisig Notary address

f02049625

Client address

f1pt35xbg63qo4kwomz6monedjst2yqd5pdfw4lpa

DataCap allocation requested

400TiB

Id

136c6a59-2c29-45f8-98f8-9d5321d6969c

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

⚠️ 1 storage providers have unknown IP location - f02056257

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 3 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the full report.

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

⚠️ 1 storage providers have unknown IP location - f02056257

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 3 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the full report.

MEIYAN666 commented 1 year ago

1678941743161

Based on the datacap and cid checks, the application meets the expected community requirements. I hope you can reach the decentralization goal as soon as possible. If you have trouble finding sp, try slack channel such as fil-deal-market or filmine platform.

AthSmith commented 1 year ago

Looks normal and acceptable, willing to support.

AthSmith commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacedgxdv7um7tr54mg5ct47xeevi7fizfp7nr225iadrzweimuo2m5m

Address

f1pt35xbg63qo4kwomz6monedjst2yqd5pdfw4lpa

Datacap Allocated

400.00TiB

Signer Address

f1vxbqrf7rfum3n6m5u6eb4re6xj7amvsaqnzu64y

Id

136c6a59-2c29-45f8-98f8-9d5321d6969c

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedgxdv7um7tr54mg5ct47xeevi7fizfp7nr225iadrzweimuo2m5m

MEIYAN666 commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceaiwpvsaqv6go6rfcxfkv47wsf65onqnkpeaglu5tbsqm7lm5si76

Address

f1pt35xbg63qo4kwomz6monedjst2yqd5pdfw4lpa

Datacap Allocated

400.00TiB

Signer Address

f1bwugfihrmn3iyunzyxst5nttql3dge4khwmurtq

Id

136c6a59-2c29-45f8-98f8-9d5321d6969c

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceaiwpvsaqv6go6rfcxfkv47wsf65onqnkpeaglu5tbsqm7lm5si76

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 3

Multisig Notary address

f02049625

Client address

f1pt35xbg63qo4kwomz6monedjst2yqd5pdfw4lpa

DataCap allocation requested

800TiB

Id

7f6391fd-ad19-46ca-8fcd-9a638533d79d

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f02049625

Client address

f1pt35xbg63qo4kwomz6monedjst2yqd5pdfw4lpa

Last two approvers

Meibuy & Protocan

Rule to calculate the allocation request amount

200% of weekly dc amount requested

DataCap allocation requested

800TiB

Total DataCap granted for client so far

200TiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

4.80PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
null null 400TiB null 11.81TiB
filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the full report.

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the full report.

TakiChain commented 1 year ago

CID checker and Retrieval can be done. Willing to suport!

TakiChain commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaced23w2uuo5ska7oklpbttclfdvkab5xewtcpuntok2my5vgmrnn3u

Address

f1pt35xbg63qo4kwomz6monedjst2yqd5pdfw4lpa

Datacap Allocated

800.00TiB

Signer Address

f15impf3j2zcaex4lhyxndxswuuhv24vzstuqtxsi

Id

7f6391fd-ad19-46ca-8fcd-9a638533d79d

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaced23w2uuo5ska7oklpbttclfdvkab5xewtcpuntok2my5vgmrnn3u

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the full report.

MEIYAN666 commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacecbztqkdxbredg5nvqidrmxmugnpns2aa7ymppmg7htjl4k7sce34

Address

f1pt35xbg63qo4kwomz6monedjst2yqd5pdfw4lpa

Datacap Allocated

800.00TiB

Signer Address

f1bwugfihrmn3iyunzyxst5nttql3dge4khwmurtq

Id

7f6391fd-ad19-46ca-8fcd-9a638533d79d

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecbztqkdxbredg5nvqidrmxmugnpns2aa7ymppmg7htjl4k7sce34

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 4

Multisig Notary address

f02049625

Client address

f1pt35xbg63qo4kwomz6monedjst2yqd5pdfw4lpa

DataCap allocation requested

1.56PiB

Id

565e8814-3016-47de-bc2a-8006a96d9c3b

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f02049625

Client address

f1pt35xbg63qo4kwomz6monedjst2yqd5pdfw4lpa

Rule to calculate the allocation request amount

400% of weekly dc amount requested

DataCap allocation requested

1.56PiB

Total DataCap granted for client so far

727595761418342891520.0YiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

-8.79B

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
34996 14 800TiB 17.41 213.75TiB
Suyanj commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacebfqz2bj4vw2zotbvw6lashefhy7lhll5ewl3fjia7mzbwscwspfs

Address

f1pt35xbg63qo4kwomz6monedjst2yqd5pdfw4lpa

Datacap Allocated

1.56PiB

Signer Address

f1ihv7gz3vn3xqvikpt4rwryecgisl7745lodx3yi

Id

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebfqz2bj4vw2zotbvw6lashefhy7lhll5ewl3fjia7mzbwscwspfs

TakiChain commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacebesmbxwiigob6b7yx5tvwow3lyanzx5zefc53elaispnxi27mcks

Address

f1pt35xbg63qo4kwomz6monedjst2yqd5pdfw4lpa

Datacap Allocated

1.56PiB

Signer Address

f15impf3j2zcaex4lhyxndxswuuhv24vzstuqtxsi

Id

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebesmbxwiigob6b7yx5tvwow3lyanzx5zefc53elaispnxi27mcks

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 5

Multisig Notary address

f02049625

Client address

f1pt35xbg63qo4kwomz6monedjst2yqd5pdfw4lpa

DataCap allocation requested

1.56PiB

Id

76f3a889-adee-432e-bb27-c4fdcdd1b769

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f02049625

Client address

f1pt35xbg63qo4kwomz6monedjst2yqd5pdfw4lpa

Rule to calculate the allocation request amount

400% of weekly dc amount requested

DataCap allocation requested

1.56PiB

Total DataCap granted for client so far

1.4528632164001478e+36YiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

1.4528632164001478e+36YiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
79626 23 1.56PiB 14.74 403.65TiB
kevzak commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

⚠️ All retrieval success ratios are below 1%.

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval report.

spaceT9 commented 1 year ago

checker:manualTrigger

spaceT9 commented 1 year ago

rerieval rate too low to sign

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

⚠️ All retrieval success ratios are below 1%.

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 31.07% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval report.

spaceT9 commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

⚠️ All retrieval success ratios are below 1%.

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 31.07% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

Micaucas commented 1 year ago

checker:manualTrigger

Bennyyangpu commented 1 year ago

checker:manualTrigger

Bennyyangpu commented 1 year ago

image LGTM, willing to support.

Bennyyangpu commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacec7235prf57tno5wmbaqkssailj34sxc24tv6eg43hnzrbjcmv2wy

Address

f1pt35xbg63qo4kwomz6monedjst2yqd5pdfw4lpa

Datacap Allocated

1.56PiB

Signer Address

f174fg3bqbln3zjnkxtyf6s54txqkr7yqkj6cig7y

Id

76f3a889-adee-432e-bb27-c4fdcdd1b769

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacec7235prf57tno5wmbaqkssailj34sxc24tv6eg43hnzrbjcmv2wy

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 31.07% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

MEIYAN666 commented 1 year ago

Basically acceptable, but need to improve Deal Data Replication in the next round.

MEIYAN666 commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacecfydrjk2pql2hg3hksdgnreqqsrb3ftcbbrdxlvxr3c3wl7quf5m

Address

f1pt35xbg63qo4kwomz6monedjst2yqd5pdfw4lpa

Datacap Allocated

1.56PiB

Signer Address

f1bwugfihrmn3iyunzyxst5nttql3dge4khwmurtq

Id

76f3a889-adee-432e-bb27-c4fdcdd1b769

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecfydrjk2pql2hg3hksdgnreqqsrb3ftcbbrdxlvxr3c3wl7quf5m

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 14 days, so for now it is being closed. Please feel free to contact the Fil+ Gov team to re-open the application if it is still being processed. Thank you!