search

filecoin-project / filecoin-plus-large-datasets

Hub for client applications for DataCap at a large scale
109 stars 62 forks source link

[DataCap Application] <HZ Weitu technology Co., LTD> - <3Dsolution nonE-FIL> #2151

Closed xujunhuaweitu closed 1 year ago

xujunhuaweitu commented 1 year ago

Data Owner Name

Hangzhou Weitu technology Co., LTD

What is your role related to the dataset

Dataset Owner

Data Owner Country/Region

China

Data Owner Industry

IT & Technology Services

Website

N/A

Social Media

N/A

Total amount of DataCap being requested

5PiB

Expected size of single dataset (one copy)

500T

Number of replicas to store

10

Weekly allocation of DataCap requested

800TiB

On-chain address for first allocation

f1elc35nz6bzmtxmchc2uoiajv5mkjuhw2yvorl5i

Data Type of Application

Public, Open Commercial/Enterprise

Custom multisig

Identifier

No response

Share a brief history of your project and organization

We leverage our parent company's expertise in computer hardware and software infrastructure design to establish ourselves as a leading provider of professional computer technology services, a manufacturer of blockchain products, and a distributor of electronic commercial display solutions. We are actively engaged in blockchain technology research and employ cutting-edge methods to integrate blockchain computing into devices like smart homes and HVAC equipment. By harnessing the power of idle devices through specialized computing modules, we enhance our computational capabilities while keeping costs minimal. Furthermore, we offer remote monitoring software for these blockchain devices, ensuring a secure and efficient control system. Our philosophy is rooted in professionalism and excellence, evident in our diverse range of intelligent commercial display products and integrated solutions that cater to the TV and surveillance industries.

Is this project associated with other projects/ecosystem stakeholders?

No

If answered yes, what are the other projects/ecosystem stakeholders

No response

Describe the data being stored onto Filecoin

The data of the company's 3D glasses-free display and other related products,
designed product posters and other promotional content

Where was the data currently stored in this dataset sourced from

My Own Storage Infra

If you answered "Other" in the previous question, enter the details here

No response

If you are a data preparer. What is your location (City and Country)

Hangzhou, China

If you are a data preparer, how will the data be prepared? Please include tooling used and technical details?

I'm a preparer also the owner of our data. Our data was stored in our own storage infra. We will transfer online to those SPs when they are ready.

If you are not preparing the data, who will prepare the data? (Provide name and business)

No response

Has this dataset been stored on the Filecoin network before? If so, please explain and make the case why you would like to store this dataset again to the network. Provide details on preparation and/or SP distribution.

N/A

Please share a sample of the data

https://drive.google.com/file/d/17zB2loGKl8ou3JuMjYSbm5SIsG1xT4c9/view?usp=sharing

https://drive.google.com/file/d/1H5jU2bvAxS9cdn7WK7Y9hTP5guiC6V_t/view?usp=sharing

https://drive.google.com/file/d/1yd6WpiFFTMjAyTnMCEv0yDN11a6sMNNH/view?usp=sharing

https://drive.google.com/file/d/1Ni812sXw8yIwsKQERBgP-PnwtdcM2_T2/view?usp=sharing

https://drive.google.com/file/d/15YR7nF-aTaqGI4652UZNfu32NbFg6hKd/view?usp=sharing

https://drive.google.com/file/d/138RGOKpyADudpDFA4uWTtHo5loyqqPhw/view?usp=sharing

https://drive.google.com/file/d/1BZACooUwziBZLIVmAxIY9jSgjagsuPc4/view?usp=sharing

https://drive.google.com/file/d/1BZACooUwziBZLIVmAxIY9jSgjagsuPc4/view?usp=sharing

https://drive.google.com/file/d/1sElRryQiWCOhyhlyYsPwsSzFNqwu3HGz/view?usp=sharing

https://drive.google.com/file/d/1ksSr6VEJ7Wb8JkQbowZLgTYBC7ddte8q/view?usp=sharing

https://drive.google.com/file/d/1YsI3ABIHm7zD6gE08Kb3t-9gkuT-BLCJ/view?usp=sharing

https://drive.google.com/file/d/1nhostX6jSg0JimxACvVL8x6Cv9ijmDEu/view?usp=sharing

https://drive.google.com/file/d/1vpAPxS_A6DTxH1FyPTdY8DRtabONRWF4/view?usp=sharing

https://drive.google.com/file/d/1NvsxUXM5Fp-85Su9WS6h_96i2fuuR_gQ/view?usp=sharing

https://drive.google.com/file/d/1ndMY9G0vefBkyhr-g-WdqgFTlrR3F1m0/view?usp=sharing

https://drive.google.com/file/d/1uHyslyOh38FkaSCfduAaGMGKP7E8U2rr/view?usp=sharing

https://drive.google.com/file/d/1RvBUq0Gb80reLepggu_BzBtHB4BP0Xhe/view?usp=sharing

Confirm that this is a public dataset that can be retrieved by anyone on the Network

If you chose not to confirm, what was the reason

No response

What is the expected retrieval frequency for this data

Sporadic

For how long do you plan to keep this dataset stored on Filecoin

2 to 3 years

In which geographies do you plan on making storage deals

Greater China, Asia other than Greater China, North America, South America, Europe

How will you be distributing your data to storage providers

Cloud storage (i.e. S3), HTTP or FTP server, IPFS, Lotus built-in data transfer

How do you plan to choose storage providers

Slack, Filmine, Partners

If you answered "Others" in the previous question, what is the tool or platform you plan to use

No response

If you already have a list of storage providers to work with, fill out their names and provider IDs below

IN communicating. Base on whether the SPs have collateral or not when I pass the application.

How do you plan to make deals to your storage providers

Boost client

If you answered "Others/custom tool" in the previous question, enter the details here

No response

Can you confirm that you will follow the Fil+ guideline

Yes

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 68.31% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

maxvint commented 1 year ago

Willing to support the round.

maxvint commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacedm32prilbs3e6kq7thwdexwer3ns7fkcaa755ml2exbcm4glnwow

Address

f1elc35nz6bzmtxmchc2uoiajv5mkjuhw2yvorl5i

Datacap Allocated

1.00PiB

Signer Address

f1ui5iy4mmkxjbw7752omiwp2ols2fzv4thrayagi

Id

dce26a85-a082-4b40-a67d-48884589a7eb

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedm32prilbs3e6kq7thwdexwer3ns7fkcaa755ml2exbcm4glnwow

cryptowhizzard commented 1 year ago

Hello,

I have managed to download a deals from you but there is something strange with your data:

gocar inspect 2151-f02637820-f02329119-53035030-baga6ea4seaqfz6rf2wjzj73oo235opzkfr2lvprv5mzqsfdxjo3g5qphzaahgoy Version: 1 Roots: bafykbzaceaonces5i6g42il5xxnrfgaojlkxupjlxxcyxkns2ck4tm4l7ie2o Root blocks present in data: Yes Block count: 32803 Min / average / max block length (bytes): 60 / 1047510 / 1048576 Min / average / max CID length (bytes): 38 / 38 / 64 Block count per codec: raw: 32769 dag-pb: 34 CID count per multihash: identity: 1 blake2b-256: 32802

The data provided is not the data you show in the samples of your LDN and i cannot unpack the car file to UnixFS. Can you explain?

cryptowhizzard commented 1 year ago

@Casey-PG @maxvint

Did you download data from this LDN and did you inspect the data? Please provide me with the due diligence done?

xujunhuaweitu commented 1 year ago

@cryptowhizzard @kevzak We have applied for private data files, which are not public files. We have encrypted these files during storage.

cryptowhizzard commented 1 year ago

Scherm­afbeelding 2023-09-18 om 14 48 57

This is the Non E-Fil.

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 4

Multisig Notary address

f02049625

Client address

f1elc35nz6bzmtxmchc2uoiajv5mkjuhw2yvorl5i

DataCap allocation requested

2PiB

Id

9436e151-8e3c-4971-9271-b290057c310f

xujunhuaweitu commented 1 year ago

@cryptowhizzard Please review the records. image

DaYouGroup commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 72.20% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

DaYouGroup commented 1 year ago

"72.20% of deals are for data replicated across less than 4 storage providers." Please explain why.

psh0691 commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacedtbi6srbddas4bpkov7yt5dunkt3ptcpunwzeixf32drpaaa7ezy

Address

f1elc35nz6bzmtxmchc2uoiajv5mkjuhw2yvorl5i

Datacap Allocated

2.00PiB

Signer Address

f1qdko4jg25vo35qmyvcrw4ak4fmuu3f5rif2kc7i

Id

9436e151-8e3c-4971-9271-b290057c310f

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedtbi6srbddas4bpkov7yt5dunkt3ptcpunwzeixf32drpaaa7ezy

psh0691 commented 1 year ago

스크린샷 2023-09-20 15-17-20 In fact, it was distributed to 10 SPs, but it appears to be skewed to a small number of SPs.

NDLABS-Leo commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 72.20% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

xujunhuaweitu commented 1 year ago

@psh0691 Thank you for your support.

@DaYouGroup Yes, because the storage speed of each SP varies, e+fil data needs to be encrypted before storage by SPs. The speed of encrypting data varies depending on the encryption method used.

NDLABS-Leo commented 1 year ago

I apologize for the copying and pasting error. I was just doing a quick check.

DaYouGroup commented 1 year ago

Willing to support this round

DaYouGroup commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacechugmhpus7eer6q2fxld6i6b67etms5h4wyhv7gjtwe7uquxeuuw

Address

f1elc35nz6bzmtxmchc2uoiajv5mkjuhw2yvorl5i

Datacap Allocated

2.00PiB

Signer Address

f1nwjsd2mc6hu4qrwnmd6ukrfkuu4h5fhs7u3exii

Id

9436e151-8e3c-4971-9271-b290057c310f

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacechugmhpus7eer6q2fxld6i6b67etms5h4wyhv7gjtwe7uquxeuuw

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

xujunhuaweitu commented 1 year ago

keep open

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 52.84% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

AlanGreaterheat commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 52.84% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

AlanGreaterheat commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceavnjkkw2bbbibhqungrbe7n6aublxxt4fiko766ierzpbcrv6lo6

Address

f1elc35nz6bzmtxmchc2uoiajv5mkjuhw2yvorl5i

Datacap Allocated

2.00PiB

Signer Address

f1pnmzlxj7cfeo2v6oj5nco46hkg2l46wj7o4xxui

Id

9436e151-8e3c-4971-9271-b290057c310f

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceavnjkkw2bbbibhqungrbe7n6aublxxt4fiko766ierzpbcrv6lo6

Tom-OriginStorage commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacebfdqomrawygom74e6myhdi57devkk6xbpzsu3lragohe4etvn7hk

Address

f1elc35nz6bzmtxmchc2uoiajv5mkjuhw2yvorl5i

Datacap Allocated

2.00PiB

Signer Address

f1q6bpjlqia6iemqbrdaxr2uehrhpvoju3qh4lpga

Id

9436e151-8e3c-4971-9271-b290057c310f

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebfdqomrawygom74e6myhdi57devkk6xbpzsu3lragohe4etvn7hk

kevzak commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 51.63% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard.

kevzak commented 1 year ago

SPs taking deals f02211572 | Chengdu, Sichuan, CNChina Mobile Communications Group Co., Ltd. | 92.00 TiB | 2.38% | 92.00 TiB | 0.00% f02368282 | Chengdu, Sichuan, CNCHINA UNICOM China169 Backbone | 752.34 TiB | 19.47% | 721.72 TiB | 4.07% f02226869 | Nanchang, Jiangxi, CNCHINA UNICOM China169 Backbone | 399.91 TiB | 10.35% | 398.19 TiB | 0.43% f02274508 | Hong Kong, Central and Western, HKChina Unicom Global | 955.22 TiB | 24.72% | 955.22 TiB | 0.00% f02815620 | Hong Kong, Central and Western, HKChina Unicom Global | 52.22 TiB | 1.35% | 52.22 TiB | 0.00% f02329119 | Hangzhou, Zhejiang, CNCT-HangZhou-IDC | 144.13 TiB | 3.73% | 144.13 TiB | 0.00% f02133079 | Hong Kong, Central and Western, HKHK Broadband Network Ltd. | 51.72 TiB | 1.34% | 51.72 TiB | 0.00% f02037700 | Seoul, Seoul, KRKorea Telecom | 259.94 TiB | 6.73% | 259.94 TiB | 0.00% f01159754 | Singapore, Singapore, SGTencent Building, Kejizhongyi Avenue | 62.81 TiB | 1.63% | 62.81 TiB | 0.00% f01853077 | Singapore, Singapore, SGZenlayer Inc | 354.34 TiB | 9.17% | 354.34 TiB | 0.00% f01852363 | Singapore, Singapore, SGZenlayer Inc | 235.59 TiB | 6.10% | 235.59 TiB | 0.00% f02322031 | Los Angeles, California, USZenlayer Inc | 99.88 TiB | 2.58% | 99.88 TiB | 0.00% f02320270 | Los Angeles, California, USZenlayer Inc | 99.81 TiB | 2.58% | 99.81 TiB | 0.00% f02327534 | Los Angeles, California, USZenlayer Inc | 99.66 TiB | 2.58% | 99.66 TiB | 0.00% f02321504 | Los Angeles, California, USZenlayer Inc | 99.66 TiB | 2.58% | 99.66 TiB | 0.00% f02320312 | Los Angeles, California, USZenlayer Inc | 99.53 TiB | 2.58% | 99.53 TiB | 0.00% f01834291 | Los Angeles, California, USZenlayer Inc | 4.97 TiB | 0.13% | 4.97 TiB | 0.00%

SPs listed upfront: f01853077 - Verified to support retrieval f01834291 US - Approved by community reviewers f02327534 US - Approved by community reviewers f02226869 - CN - LuckyMine - New updated node f02274508 - HK - H&W - New updated node

Confirm all SP entities @xujunhuaweitu

herrehesse commented 1 year ago

High amount of these deals go to the same entity under VPN. Selfdealing is what we are looking at.

large-datacap-requests[bot] commented 1 year ago

The issue reached the total datacap requested. This should be closed