filecoin-project / filecoin-plus-large-datasets

Hub for client applications for DataCap at a large scale
109 stars 62 forks source link

[DataCap Application] Limradar #1595

Closed Pauline546 closed 11 months ago

Pauline546 commented 1 year ago

Data Owner Name

Shanghai Limradar Electronic Technology Co., Ltd

Data Owner Country/Region

China

Data Owner Industry

Other

Website

https://www.limradar.com/

Social Media

Wechat: Limingruida

Total amount of DataCap being requested

5PiB

Weekly allocation of DataCap requested

400TiB

On-chain address for first allocation

f1n36arb7rlf774wuzg35e5vaeedhzfsyjkixbgda

Custom multisig

Identifier

No response

Share a brief history of your project and organization

Shanghai Limradar was established in 2020. Our company focuses on radar detection, multi-sensor fusion, artificial intelligence traffic control and other technology research in the field of transportation, and provides relevant millimeter wave radar products around intelligent transportation, intelligent security, advanced assisted driving, rail safety and other applications.

Is this project associated with other projects/ecosystem stakeholders?

No

If answered yes, what are the other projects/ecosystem stakeholders

No response

Describe the data being stored onto Filecoin

The data we store are radar test records used in various fields. Our company's product---Radar can be applied in several scenarios, including Smart Traffic, Smart Security, Advanced Driving Assistance, Track and traffic safety, etc. We have a large accumulation of data. The data we own is both public and private.

Where was the data currently stored in this dataset sourced from

My Own Storage Infra

If you answered "Other" in the previous question, enter the details here

No response

How do you plan to prepare the dataset

lotus

If you answered "other/custom tool" in the previous question, enter the details here

No response

Please share a sample of the data

https://drive.google.com/file/d/1cFc8Hq8_Wkg6jJwn7lU0pVq-eSG6w5hB/view?usp=sharing

Confirm that this is a public dataset that can be retrieved by anyone on the Network

If you chose not to confirm, what was the reason

No response

What is the expected retrieval frequency for this data

Yearly

For how long do you plan to keep this dataset stored on Filecoin

1 to 1.5 years

In which geographies do you plan on making storage deals

Greater China, Asia other than Greater China, North America

How will you be distributing your data to storage providers

HTTP or FTP server, Shipping hard drives

How do you plan to choose storage providers

Slack

If you answered "Others" in the previous question, what is the tool or platform you plan to use

No response

If you already have a list of storage providers to work with, fill out their names and provider IDs below

No response

How do you plan to make deals to your storage providers

Boost client, Lotus client

If you answered "Others/custom tool" in the previous question, enter the details here

No response

Can you confirm that you will follow the Fil+ guideline

Yes

large-datacap-requests[bot] commented 1 year ago

Thanks for your request!

Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!
large-datacap-requests[bot] commented 1 year ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

cryptowhizzard commented 1 year ago

Dear applicant,

Thank you for applying for datacap. As Filecoin FIL+ notary i am screening your application and conducting due diligence.

Looking at your application i have some questions: As you are brand new on Github and have no history of past applications it seems to me that applying for 5PB of datacap is a lot. One needs comprehensive knowledge of Filecoin, packing of data, distribution of data and all it's requirements coming with it. Are you brand new in the Filecoin space or have you applied for datacap in the past on different Github account names?

Can you show us visible proof of the size of your data and the storage systems you have there?

As last question i would like you to fill out this form to provide us with the necessary information to make a educated decision on your LDN request if we would like to support it.

Thanks!

Sunnyiscoming commented 1 year ago

Can you provide more detailed informations about SPs you will cooperate with? Could you send an email to filplus-app-review@fil.org with your official domain in order to confirm your identity? Email name should includes the issue id #1595.

Pauline546 commented 1 year ago

@Sunnyiscoming SP has not been finalized yet from the SP side. But we will contact sps from different regions. Here's the email, please check it. email

lvschouwen commented 1 year ago

In you application you specify "The data we own is both public and private.". Can you tell us how much of the requested datacap is public and how much is private?

FIL+ is ment to store public data. Private data can be stored in FIL-E. If you application is a mix of both, I think it would be wise to move to FIL-E just to be sure private data does not get mixed in the FIL+ program and we can discussion about what has been stored later on.

@kevzak Tagging you as I would like to know your opinion about this.

caoyoungyoung commented 1 year ago

The videos shared look like sensitive test data involving train and car, those data owned by the government? is it pubic accessible?

kevzak commented 1 year ago

If both public and private, they could split into two separate applications. Or they can categorize all into E-Fil+ and go through full client/business/SP check.

Pauline546 commented 1 year ago

@lvschouwen @kevzak Thank you for your concern about our application! What I am saying in the application is that our company has both public and private data. But data we chose for datacap applying is public data. If our future storage in filecoin is very safe and convenient, we will consider participating in E-Fil+ next step!

Pauline546 commented 1 year ago

@caoyoungyoung Yes, data we choose are public data and owned by Limradar.

Pauline546 commented 1 year ago

@simonkim0515 @Sunnyiscoming Hi, can you please push my application into trigger?

large-datacap-requests[bot] commented 1 year ago

Deleting comment

@Sunnyiscoming hasn't the permissions to post this comment.

Please, contact the assignee of this issue.

Sunnyiscoming commented 1 year ago

Datacap Request Trigger

Total DataCap requested

5PiB

Expected weekly DataCap usage rate

400TiB

Client address

f1n36arb7rlf774wuzg35e5vaeedhzfsyjkixbgda

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Multisig Notary address

f02049625

Client address

f1n36arb7rlf774wuzg35e5vaeedhzfsyjkixbgda

DataCap allocation requested

200TiB

Id

d85a0fb1-06e8-4b3a-bca1-3f5179620ccb

Destore2023 commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceatjfflll65mgmf4fyt5okpfb2j6vihmvlz4tl2capqpmo6sfgr6s

Address

f1n36arb7rlf774wuzg35e5vaeedhzfsyjkixbgda

Datacap Allocated

200.00TiB

Signer Address

f1yh6q3nmsg7i2sys7f7dexcuajgoweudcqj2chfi

Id

d85a0fb1-06e8-4b3a-bca1-3f5179620ccb

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceatjfflll65mgmf4fyt5okpfb2j6vihmvlz4tl2capqpmo6sfgr6s

Destore2023 commented 1 year ago

KYC is ok, Looks normal.

cryptowhizzard commented 1 year ago

Sounds good. Thanks @swatchliu

@Pauline546 can you list us the SP's where you want to store this data?

Destore2023 commented 1 year ago

Mr. Chen Lei and I had a 15-minute phone call today. The bullet point of KYC as follows:

  1. Due to radar research and development, a large amount of scientific data and recording videos need to be stored.

  2. The company's private cloud storage space has been used 82%, and it needs to continue to increase the cold preparation space.

  3. The new storage method can bring the company's latest investment direction, which will be dealt with in the future.

cryptowhizzard commented 1 year ago

Hi Eric,

Thanks for your time and effort you put into this. I am waiting for the list of SP's ( minimum of 4 for first allocation and different continents / organizations. ) .

Pauline546 commented 1 year ago

@swatchliu Nice chat! Thank you! @cryptowhizzard Thank you for your patience. I am still in the process of contacting SP to join us. I will provide more information about SP on the actual sealing process in the future.

jomozz commented 1 year ago

@Pauline546 Have you contacted SPs yet? Waiting for your list

data-programs commented 1 year ago
KYC

This user’s identity has been verified through filplus.storage

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

Pauline546 commented 1 year ago

OK.

cryptowhizzard commented 1 year ago

Tried to retrieve some data here but i got lots of errors.


cat 1595-f02031234-f02244750-46896534-baga6ea4seaqj2lpesnfbknwkcozwmejgslosukm25yx2gsauexodft5knwk6sly.log 2023-07-26T19:06:10.133+0200 WARN rpc go-jsonrpc@v0.3.1/client.go:615 unmarshaling failed {"message": "{\"Err\":\"exhausted 5 attempts but failed to open stream, err: protocols not supported: [/fil/retrieval/qry/1.0.0]\",\"Root\":null,\"Piece\":null,\"Size\":0,\"MinPrice\":\"\u003cnil\u003e\",\"UnsealPrice\":\"\u003cnil\u003e\",\"PricePerByte\":\"\u003cnil\u003e\",\"PaymentInterval\":0,\"PaymentIntervalIncrease\":0,\"Miner\":\"f02244750\",\"MinerPeer\":{\"Address\":\"f02244750\",\"ID\":\"12D3KooWHfCEGvQAdv7TR2tcQJtSwo8sQ6Da1Tdf6KzpsxxHY8ET\",\"PieceCID\":null}}"} 2023-07-26T19:06:10.133+0200 INFO retry retry/retry.go:17 Retrying after error:RPC client error: unmarshaling result: failed to parse big string: '"\u003cnil\u003e"' 2023-07-26T19:08:00.633+0200 WARN rpc go-jsonrpc@v0.3.1/client.go:615 unmarshaling failed {"message": "{\"Err\":\"exhausted 5 attempts but failed to open stream, err: protocols not supported: [/fil/retrieval/qry/1.0.0]\",\"Root\":null,\"Piece\":null,\"Size\":0,\"MinPrice\":\"\u003cnil\u003e\",\"UnsealPrice\":\"\u003cnil\u003e\",\"PricePerByte\":\"\u003cnil\u003e\",\"PaymentInterval\":0,\"PaymentIntervalIncrease\":0,\"Miner\":\"f02244750\",\"MinerPeer\":{\"Address\":\"f02244750\",\"ID\":\"12D3KooWHfCEGvQAdv7TR2tcQJtSwo8sQ6Da1Tdf6KzpsxxHY8ET\",\"PieceCID\":null}}"} 2023-07-26T19:08:00.633+0200 INFO retry retry/retry.go:17 Retrying after error:RPC client error: unmarshaling result: failed to parse big string: '"\u003cnil\u003e"' 2023-07-26T19:09:31.217+0200 WARN rpc go-jsonrpc@v0.3.1/client.go:615 unmarshaling failed {"message": "{\"Err\":\"exhausted 5 attempts but failed to open stream, err: protocols not supported: [/fil/retrieval/qry/1.0.0]\",\"Root\":null,\"Piece\":null,\"Size\":0,\"MinPrice\":\"\u003cnil\u003e\",\"UnsealPrice\":\"\u003cnil\u003e\",\"PricePerByte\":\"\u003cnil\u003e\",\"PaymentInterval\":0,\"PaymentIntervalIncrease\":0,\"Miner\":\"f02244750\",\"MinerPeer\":{\"Address\":\"f02244750\",\"ID\":\"12D3KooWHfCEGvQAdv7TR2tcQJtSwo8sQ6Da1Tdf6KzpsxxHY8ET\",\"PieceCID\":null}}"} 2023-07-26T19:09:31.217+0200 INFO retry retry/retry.go:17 Retrying after error:RPC client error: unmarshaling result: failed to parse big string: '"\u003cnil\u003e"' 2023-07-26T19:10:07.783+0200 WARN rpc go-jsonrpc@v0.3.1/client.go:615 unmarshaling failed {"message": "{\"Err\":\"exhausted 5 attempts but failed to open stream, err: protocols not supported: [/fil/retrieval/qry/1.0.0]\",\"Root\":null,\"Piece\":null,\"Size\":0,\"MinPrice\":\"\u003cnil\u003e\",\"UnsealPrice\":\"\u003cnil\u003e\",\"PricePerByte\":\"\u003cnil\u003e\",\"PaymentInterval\":0,\"PaymentIntervalIncrease\":0,\"Miner\":\"f02244750\",\"MinerPeer\":{\"Address\":\"f02244750\",\"ID\":\"12D3KooWHfCEGvQAdv7TR2tcQJtSwo8sQ6Da1Tdf6KzpsxxHY8ET\",\"PieceCID\":null}}"} 2023-07-26T19:10:07.783+0200 INFO retry retry/retry.go:17 Retrying after error:RPC client error: unmarshaling result: failed to parse big string: '"\u003cnil\u003e"' 2023-07-26T19:10:29.463+0200 WARN rpc go-jsonrpc@v0.3.1/client.go:615 unmarshaling failed {"message": "{\"Err\":\"exhausted 5 attempts but failed to open stream, err: protocols not supported: [/fil/retrieval/qry/1.0.0]\",\"Root\":null,\"Piece\":null,\"Size\":0,\"MinPrice\":\"\u003cnil\u003e\",\"UnsealPrice\":\"\u003cnil\u003e\",\"PricePerByte\":\"\u003cnil\u003e\",\"PaymentInterval\":0,\"PaymentIntervalIncrease\":0,\"Miner\":\"f02244750\",\"MinerPeer\":{\"Address\":\"f02244750\",\"ID\":\"12D3KooWHfCEGvQAdv7TR2tcQJtSwo8sQ6Da1Tdf6KzpsxxHY8ET\",\"PieceCID\":null}}"} 2023-07-26T19:10:29.463+0200 ERROR retry retry/retry.go:29 Failed after 5 attempts, last error: RPC client error: unmarshaling result: failed to parse big string: '"\u003cnil\u003e"' ERROR: RPC client error: unmarshaling result: failed to parse big string: '"\u003cnil\u003e"'

cryptowhizzard commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

⚠️ 1 storage providers sealed more than 90% of total datacap - f02244750: 100.00%

⚠️ All storage providers are located in the same region.

Deal Data Replication

⚠️ 100.00% of deals are for data replicated across less than 2 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

Pauline546 commented 1 year ago

Please keep my application.

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 14 days, so for now it is being closed. Please feel free to contact the Fil+ Gov team to re-open the application if it is still being processed. Thank you!

Pauline546 commented 1 year ago

I'm looking for more SPs to stroe data. Can fil-plus team help open my application?

clriesco commented 1 year ago

Removed stale label and reopened issue :)

Pauline546 commented 1 year ago

@clriesco Thank you!

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

Pauline546 commented 1 year ago

Please keep my application open.

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

Pauline546 commented 1 year ago

Please keep my application open.

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

Pauline546 commented 1 year ago

Please keep my application open.

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

Pauline546 commented 1 year ago

Please keep my application open.

Sunnyiscoming commented 1 year ago

Hello, @Pauline546 per the https://github.com/filecoin-project/notary-governance/issues/922 for Open, Public Dataset applicants, please complete the following Fil+ registration form to identify yourself as the applicant and also please add the contact information of the SP entities you are working with to store copies of the data.

This information will be reviewed by Fil+ Governance team to confirm validity and then the application will be allowed to move forward for additional notary review.

Casey-PG commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

⚠️ 1 storage providers have unknown IP location - f01668

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard.

Pauline546 commented 1 year ago

Hello @Sunnyiscoming , I have submitted the form.

Casey-PG commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceakqhh7pm3drv3wobmyrcedk226ofo575ilaqqive47h2bs6dazcw

Address

f1n36arb7rlf774wuzg35e5vaeedhzfsyjkixbgda

Datacap Allocated

200.00TiB

Signer Address

f1d4yb3wags3mtddzesxoo63jv7dmlec3bq4yteni

Id

d85a0fb1-06e8-4b3a-bca1-3f5179620ccb

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceakqhh7pm3drv3wobmyrcedk226ofo575ilaqqive47h2bs6dazcw

Wengeding commented 1 year ago

have confirmed the status of the SP is ok, please take care to keep. 1698726712532

Wengeding commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceag2yztfv6fdwwekwjlwhgez6nchg37mewo2mfe2vivk4gcay2ncc

Address

f1n36arb7rlf774wuzg35e5vaeedhzfsyjkixbgda

Datacap Allocated

200.00TiB

Signer Address

f1txfsjmix4vlzido4dkildrnbw26owtlbslexmpa

Id

d85a0fb1-06e8-4b3a-bca1-3f5179620ccb

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceag2yztfv6fdwwekwjlwhgez6nchg37mewo2mfe2vivk4gcay2ncc

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.