search

filecoin-project / filecoin-plus-large-datasets

Hub for client applications for DataCap at a large scale
110 stars 62 forks source link

[DataCap Application] <lnjoying> - <lnjoying Aws Dataset> #1834

Closed ElioLam closed 11 months ago

ElioLam commented 1 year ago

Data Owner Name

lnjoying

Data Owner Country/Region

China

Data Owner Industry

IT & Technology Services

Website

http://www.lnjoying.com/

Social Media

1.http://www.lnjoying.com/lists/65.html
2.微信公众号：秒如科技

Total amount of DataCap being requested

5PiB

Weekly allocation of DataCap requested

500TiB

On-chain address for first allocation

f1fqcvp53xdph7ruo2bckz4ytv25ygjwhwccm4bvi

Data Type of Application

Public, Open Dataset (Research/Non-Profit)

Custom multisig

Identifier

No response

Share a brief history of your project and organization

Lnjoying Technology is a company that created in 2019.We're backed by TusStar,Fangxin Capital,GL Ventures and so on.Lnjoying Technology is committed to becoming a world-class edge cloud service provider.
We are interested in filecoin, and we've been paying attention for years.In the last few years, we invested in many FILs.Now we want to join the filecoin ecosystem to store some open data.Then we will store our own open data to the filecoin net.

Is this project associated with other projects/ecosystem stakeholders?

No

If answered yes, what are the other projects/ecosystem stakeholders

No response

Describe the data being stored onto Filecoin

1.This dataset captures Sunflower's genetic diversity originating from thousands of wild, cultivated, and landrace sunflower individuals distributed across North America.
2.The 3000 Rice Genome Project is an international effort to sequence the genomes of 3,024 rice varieties from 89 countries.
3.The National Ocean Service (NOS)  has been developing and implementing hydrodynamic model-based Operational Forecast Systems.
4.The NOAA National Water Model Retrospective dataset contains input and output from multi-decade CONUS retrospective simulations. These simulations used meteorological input fields from meteorological retrospective datasets. The output frequency and fields available in this historical NWM dataset differ from those contained in the real-time operational NWM forecast model.

Where was the data currently stored in this dataset sourced from

AWS Cloud

If you answered "Other" in the previous question, enter the details here

No response

How do you plan to prepare the dataset

lotus, graphsplit, others/custom tool

If you answered "other/custom tool" in the previous question, enter the details here

Swan Client tool (https://github.com/filswan/go-swan-client#Graphsplit) to prepare the dataset.

Please share a sample of the data

1.s3://ubc-sunflower-genome/   (67.2TiB)
2.s3://3kricegenome/   (96.6TiB)
3.s3://noaa-ofs-pds/   (101.0TiB)
4.s3://noaa-nwm-retrospective-2-1-zarr-pds/  (132TiB)

Confirm that this is a public dataset that can be retrieved by anyone on the Network

If you chose not to confirm, what was the reason

No response

What is the expected retrieval frequency for this data

Monthly

For how long do you plan to keep this dataset stored on Filecoin

2 to 3 years

In which geographies do you plan on making storage deals

Greater China, Asia other than Greater China, South America, Europe

How will you be distributing your data to storage providers

HTTP or FTP server, IPFS, Shipping hard drives, Others

How do you plan to choose storage providers

Slack, Partners

If you answered "Others" in the previous question, what is the tool or platform you plan to use

No response

If you already have a list of storage providers to work with, fill out their names and provider IDs below

f01789666
f0134516
f0118330
f0839509
f0867300
f01395673
f01072221
f0143858
f01786736
f01348489
f0522948
f01228008
f01053413
f01975316
f01975326
f01390330

How do you plan to make deals to your storage providers

Boost client, Lotus client, Others/custom tool

If you answered "Others/custom tool" in the previous question, enter the details here

Swan Client tool：
https://github.com/filswan/go-swan-client

Can you confirm that you will follow the Fil+ guideline

Yes

large-datacap-requests[bot] commented 1 year ago

Thanks for your request!

Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!
large-datacap-requests[bot] commented 1 year ago

Thanks for your request!

Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!
large-datacap-requests[bot] commented 1 year ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

large-datacap-requests[bot] commented 1 year ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

large-datacap-requests[bot] commented 1 year ago

Thanks for your request!

Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!
large-datacap-requests[bot] commented 1 year ago

Thanks for your request!

Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!
large-datacap-requests[bot] commented 1 year ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

large-datacap-requests[bot] commented 1 year ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

large-datacap-requests[bot] commented 1 year ago

Thanks for your request!

Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!
large-datacap-requests[bot] commented 1 year ago

Thanks for your request!

Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!
large-datacap-requests[bot] commented 1 year ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

large-datacap-requests[bot] commented 1 year ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

Normalnoise commented 1 year ago

@ElioLam can you share some info about swan-client experience? and why do you want to store these datasets?

ElioLam commented 1 year ago

@Normalnoise 1.We have researched and are familiar with the swan tool command.Such as use "swan-client generate-car graphsplit car" to generate car and use "swan-client task" to make deals. 2.One of our client wants to use some of that data.Also we want to join the ipfs ecology and test the filecoin network performance.In the fulture we will store some our data in the network.

Sunnyiscoming commented 1 year ago

Could you send an email to filplus-app-review@fil.org with your official domain in order to confirm your identity? Email name should includes the issue id #1834.

ElioLam commented 1 year ago

@Sunnyiscoming We have sent an email to you at sarahsun@lnjoying.com, please check, thank you!

Sunnyiscoming commented 1 year ago

Datacap Request Trigger

Total DataCap requested

5PiB

Expected weekly DataCap usage rate

500TiB

Client address

f1fqcvp53xdph7ruo2bckz4ytv25ygjwhwccm4bvi

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Multisig Notary address

f02049625

Client address

f1fqcvp53xdph7ruo2bckz4ytv25ygjwhwccm4bvi

DataCap allocation requested

250TiB

Id

a286b2b6-9bc6-41db-8bd4-8d1219781b15

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Multisig Notary address

f02049625

Client address

f1fqcvp53xdph7ruo2bckz4ytv25ygjwhwccm4bvi

DataCap allocation requested

250TiB

Id

04ea581e-bb43-492d-8f35-1644ef763392

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report[^1]

No application info found for this issue on https://filplus.d.interplanetary.one/clients.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report[^1]

No application info found for this issue on https://filplus.d.interplanetary.one/clients.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

Normalnoise commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacebcuni7ux6vlrhuj3habmovys2e3tjntwncd4kzceperxdowrhgp4

Address

f1fqcvp53xdph7ruo2bckz4ytv25ygjwhwccm4bvi

Datacap Allocated

250.00TiB

Signer Address

f1c5non5yf35avgcpsqvxu4yj54yyvxorwyjochqq

Id

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebcuni7ux6vlrhuj3habmovys2e3tjntwncd4kzceperxdowrhgp4

nj-steve commented 1 year ago

@ElioLam What's your plan that you will send deals to these storage providers?

ElioLam commented 1 year ago

@nj-steve hi nj-steve, We will send 8 copies to different sp. We send storage transactions to storage providers in 3 different regions

nj-steve commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceagablkvk6apzt4u2246stkplkl5bwffmdrhwfqcfi6k2qgxfda2w

Address

f1fqcvp53xdph7ruo2bckz4ytv25ygjwhwccm4bvi

Datacap Allocated

250.00TiB

Signer Address

f1xx6555qijma7igpnjspyvdunc4vfxkawnpqy5ii

Id

04ea581e-bb43-492d-8f35-1644ef763392

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceagablkvk6apzt4u2246stkplkl5bwffmdrhwfqcfi6k2qgxfda2w

ElioLam commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report[^1]

No active deals found for this client.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

nj-steve commented 1 year ago

Hi, when will you use this client for storing the data?

ElioLam commented 1 year ago

@nj-steve We are preparing the data and expect to start using it in two weeks，thankyou

ElioLam commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report[^1]

No active deals found for this client.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

ElioLam commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report[^1]

No active deals found for this client.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

ElioLam commented 1 year ago

checker:manualTrigger

ElioLam commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

⚠️ 1 storage providers sealed more than 70% of total datacap - f02229707: 78.06%

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 3 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval report.

ElioLam commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 3 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval report.

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 2

Multisig Notary address

f02049625

Client address

f1fqcvp53xdph7ruo2bckz4ytv25ygjwhwccm4bvi

DataCap allocation requested

500TiB

Id

747088bf-2b35-4007-9875-1775fe878d9a

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f02049625

Client address

f1fqcvp53xdph7ruo2bckz4ytv25ygjwhwccm4bvi

Rule to calculate the allocation request amount

100% of weekly dc amount requested

DataCap allocation requested

500TiB

Total DataCap granted for client so far

250TiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

4.75PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
5774 4 250TiB 35.4 62.48TiB
ElioLam commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

⚠️ All retrieval success ratios are below 1%.

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval report.

ElioLam commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

⚠️ All retrieval success ratios are below 1%.

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval report.

ElioLam commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval report.

Joss-Hua commented 1 year ago

Base the report, considering that the number of SPs and replicas can continue to increase, while other aspects are healthy, this round of allocation is supported.

Joss-Hua commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacedxuwndkchvvsjms2m5dwrdyifxhvfgvflld4aahqu5dbi7y5md5a

Address

f1fqcvp53xdph7ruo2bckz4ytv25ygjwhwccm4bvi

Datacap Allocated

500.00TiB

Signer Address

f1tfg54zzscugttejv336vivknmsnzzmyudp3t7wi

Id

747088bf-2b35-4007-9875-1775fe878d9a

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedxuwndkchvvsjms2m5dwrdyifxhvfgvflld4aahqu5dbi7y5md5a

a1991car commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacectw3olkkiuq3nnayytkkreakh23k3w224o6pq6s7r45w4odipbri

Address

f1fqcvp53xdph7ruo2bckz4ytv25ygjwhwccm4bvi

Datacap Allocated

500.00TiB

Signer Address

f1qnumecdypgrbaebtkdfjnwt5ndacadcuas3deiq

Id

747088bf-2b35-4007-9875-1775fe878d9a

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacectw3olkkiuq3nnayytkkreakh23k3w224o6pq6s7r45w4odipbri

a1991car commented 1 year ago

Temporarily supported, please improve the retrieval success rate