filecoin-project / filecoin-plus-large-datasets

Hub for client applications for DataCap at a large scale
110 stars 62 forks source link

[DataCap Application]ZhongHe Survey and Design Co., Ltd. #310

Closed zhonghdadi closed 1 year ago

zhonghdadi commented 2 years ago

Large Dataset Notary Application

To apply for DataCap to onboard your dataset to Filecoin, please fill out the following.

Core Information

Please respond to the questions below by replacing the text saying "Please answer here". Include as much detail as you can in your answer.

Project details

Share a brief history of your project and organization.

Founded in 2007, ZhongHe Survey and Design Co., Ltd. is located in Hepingli, Dongcheng District, Beijing. It is committed to mineral resource exploration, landscaping services, water pollution control, research and development and production of intelligent and cost-effective IoT environmental monitoring products. A high-tech enterprise with Internet + intelligent hardware technology innovation as the core. Since its establishment, the company has always been committed to the large-scale application of environmental Internet of Things, agricultural intelligent hardware research and development and agricultural big data analysis, providing technical and data support services for scientific planting, food safety traceability, and agricultural brand building. The company consistently implements the international quality management system, and has obtained the national industrial production license, technology "little giant" enterprise certification, remote wireless acquisition and control system, tubular soil moisture sensor data acquisition system, automatic water and fertilizer irrigation control integrated machine software, full Automatic intelligent irrigation control system, intelligent agricultural Internet of Things service platform system, integrated dust monitoring system, integrated automatic weather station monitoring system, automatic weather station data monitoring system and other software copyrights.

What is the primary source of funding for this project?

From our corporate shareholders.

What other projects/ecosystem stakeholders is this project associated with?

No.

Use-case details

Describe the data being stored onto Filecoin

It mainly stores water pollution detection data and large-scale environmental IOT production data, such as tubular soil moisture sensor data, dust monitoring, weather station monitoring data, etc.

Where was the data in this dataset sourced from?

It is derived from water pollution detection data and data generated by the large-scale application of environmental Internet of Things, data collected by tubular soil moisture sensors, dust monitoring data in the air from dust monitoring equipment, and meteorological data generated by weather station monitoring equipment.

Can you share a sample of the data? A link to a file, an image, a table, etc., are good ways to do this.

https://ddkc-01.oss-cn-beijing.aliyuncs.com/beijing/pm2.5/beijing_pm25_20121009-20121221.zip
https://ddkc-01.oss-cn-beijing.aliyuncs.com/beijing/air/beijing_20210101-20211231.zip

Confirm that this is a public dataset that can be retrieved by anyone on the Network (i.e., no specific permissions or access rights are required to view the data).

Yes, it is a public data. 
We are working on a website where we will publish the CID of the data to be stored. 
The public will be able to view the data through this website.

What is the expected retrieval frequency for this data?

This type of data is not as attractive to the general public as entertainment content, and We want people or organizations concerned about environmental monitoring to see our data.So the search frequency is not expected to be as high as that of video sites.This is the reason for we choosing the Filecoin network for storage.We want to retain the data over a longer period of time and provide it to those who need it when they need it.

For how long do you plan to keep this dataset stored on Filecoin?

I think it's a permanent archival, and we'll constantly update our data stored on Filecoin.

DataCap allocation plan

In which geographies (countries, regions) do you plan on making storage deals?

Republic of North American, Asia

How will you be distributing your data to storage providers? Is there an offline data transfer process?

It is possible online and offline if you are a North American or Asia storage provider.

How do you plan on choosing the storage providers with whom you will be making deals? This should include a plan to ensure the data is retrievable in the future both by you and others.

And storage providers who are willing to make deals with us are welcome.

How will you be distributing deals across storage providers?

We have specific platform to transfer the data. And there is an offline data transfer process.

Do you have the resources/funding to start making deals as soon as you receive DataCap? What support from the community would help you onboard onto Filecoin?

Sure, we have. 
large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f12ima4tjej3yqvbnu7hizyobfrrkq574v7ojytay

Last two approvers

llifezou & newwebgroup

Rule to calculate the allocation request amount

800% of weekly dc amount requested

DataCap allocation requested

800TiB

Total DataCap granted for client so far

1.41PiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

3.58PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
38494 11 800TiB 21.73 197.51TiB
fireflyHZ commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceaunc22e5ebgmob4jwrkny7d6enlaggegh2bve3pxkcpclzbkdapy

Address

f12ima4tjej3yqvbnu7hizyobfrrkq574v7ojytay

Datacap Allocated

800.00TiB

Signer Address

f1fg6jkxsr3twfnyhdlatmq36xca6sshptscds7xa

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceaunc22e5ebgmob4jwrkny7d6enlaggegh2bve3pxkcpclzbkdapy

Joss-Hua commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacedb43trczy7ny7r7zasd4mcocrwl6bgmptetnppujpodfkm75xta6

Address

f12ima4tjej3yqvbnu7hizyobfrrkq574v7ojytay

Datacap Allocated

800.00TiB

Signer Address

f1tfg54zzscugttejv336vivknmsnzzmyudp3t7wi

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedb43trczy7ny7r7zasd4mcocrwl6bgmptetnppujpodfkm75xta6

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 7

Multisig Notary address

f01858410

Client address

f12ima4tjej3yqvbnu7hizyobfrrkq574v7ojytay

DataCap allocation requested

800TiB

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f12ima4tjej3yqvbnu7hizyobfrrkq574v7ojytay

Last two approvers

Joss-Hua & fireflyHZ

Rule to calculate the allocation request amount

800% of weekly dc amount requested

DataCap allocation requested

800TiB

Total DataCap granted for client so far

2.19PiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

2.80PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
44994 11 800TiB 25.83 106.29TiB
stcloudlisa commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacea6a3zzeg4g4xr5czlaxekbxkffbpr5onebt6aqib6yso7zthoia4

Address

f12ima4tjej3yqvbnu7hizyobfrrkq574v7ojytay

Datacap Allocated

800.00TiB

Signer Address

f1jvvltduw35u6inn5tr4nfualyd42bh3vjtylgci

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacea6a3zzeg4g4xr5czlaxekbxkffbpr5onebt6aqib6yso7zthoia4

Tom-OriginStorage commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacedauzq2rqizqymt2zili7midrseuzklgnjdatypevkxdfvehdqhcq

Address

f12ima4tjej3yqvbnu7hizyobfrrkq574v7ojytay

Datacap Allocated

800.00TiB

Signer Address

f1q6bpjlqia6iemqbrdaxr2uehrhpvoju3qh4lpga

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedauzq2rqizqymt2zili7midrseuzklgnjdatypevkxdfvehdqhcq

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 8

Multisig Notary address

f01858410

Client address

f12ima4tjej3yqvbnu7hizyobfrrkq574v7ojytay

DataCap allocation requested

800TiB

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f12ima4tjej3yqvbnu7hizyobfrrkq574v7ojytay

Last two approvers

llifezou & 1LISA2

Rule to calculate the allocation request amount

800% of weekly dc amount requested

DataCap allocation requested

800TiB

Total DataCap granted for client so far

2.97PiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

2.02PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
56436 11 800TiB 23.79 127.35TiB
xiaoyuaiheshui commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacecifgh3fjdtczyowt2aseu75xr5suphqwc2ppvb2bnicwzu7263x2

Address

f12ima4tjej3yqvbnu7hizyobfrrkq574v7ojytay

Datacap Allocated

800.00TiB

Signer Address

f122qmy25wdtt5mxd77kndiq7z5x2n3iwiuz2wdsa

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecifgh3fjdtczyowt2aseu75xr5suphqwc2ppvb2bnicwzu7263x2

liyunzhi-666 commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacedbdxr2ewhf44i4k56p3mj65gebihvuhrp4ywqdn2rfjtz32pw6sw

Address

f12ima4tjej3yqvbnu7hizyobfrrkq574v7ojytay

Datacap Allocated

800.00TiB

Signer Address

f1pszcrsciyixyuxxukkvtazcokexbn54amf7gvoq

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedbdxr2ewhf44i4k56p3mj65gebihvuhrp4ywqdn2rfjtz32pw6sw

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 9

Multisig Notary address

f01858410

Client address

f12ima4tjej3yqvbnu7hizyobfrrkq574v7ojytay

DataCap allocation requested

800TiB

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f12ima4tjej3yqvbnu7hizyobfrrkq574v7ojytay

Last two approvers

liyunzhi-666 & jggapp

Rule to calculate the allocation request amount

800% of weekly dc amount requested

DataCap allocation requested

800TiB

Total DataCap granted for client so far

3.75PiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

1.24PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
107527 16 800TiB 13.31 38.07TiB
fireflyHZ commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacedz2czvuwr7duojtq3epvpmbay6xkdzjgz6nxxpxi36rhc7hmieu2

Address

f12ima4tjej3yqvbnu7hizyobfrrkq574v7ojytay

Datacap Allocated

800.00TiB

Signer Address

f1fg6jkxsr3twfnyhdlatmq36xca6sshptscds7xa

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedz2czvuwr7duojtq3epvpmbay6xkdzjgz6nxxpxi36rhc7hmieu2

newwebgroup commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacecfsef2jfxaq5clieytm7fuubwxfhqpa43uy4bvtg67uaazhkdwnc

Address

f12ima4tjej3yqvbnu7hizyobfrrkq574v7ojytay

Datacap Allocated

800.00TiB

Signer Address

f1e77zuityhvvw6u2t6tb5qlnsegy2s67qs4lbbbq

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecfsef2jfxaq5clieytm7fuubwxfhqpa43uy4bvtg67uaazhkdwnc

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 10

Multisig Notary address

f01858410

Client address

f12ima4tjej3yqvbnu7hizyobfrrkq574v7ojytay

DataCap allocation requested

370TiB

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f12ima4tjej3yqvbnu7hizyobfrrkq574v7ojytay

Last two approvers

newwebgroup & fireflyHZ

Rule to calculate the allocation request amount

800% of weekly dc amount requested

DataCap allocation requested

370TiB

Total DataCap granted for client so far

4.54PiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

470TiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
155211 16 800TiB 14.50 2.51TiB
Tom-OriginStorage commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacecqsih23uxsqqze3flwzl3dbjbxtkdnk2bpzlxgrqvxpahpizccmk

Address

f12ima4tjej3yqvbnu7hizyobfrrkq574v7ojytay

Datacap Allocated

370.00TiB

Signer Address

f1q6bpjlqia6iemqbrdaxr2uehrhpvoju3qh4lpga

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecqsih23uxsqqze3flwzl3dbjbxtkdnk2bpzlxgrqvxpahpizccmk

newwebgroup commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacecbxjqtpunzrf3v6fgmq4gmmyyabxqna3r2ndwzkquzumc5c4d7hy

Address

f12ima4tjej3yqvbnu7hizyobfrrkq574v7ojytay

Datacap Allocated

370.00TiB

Signer Address

f1e77zuityhvvw6u2t6tb5qlnsegy2s67qs4lbbbq

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecbxjqtpunzrf3v6fgmq4gmmyyabxqna3r2ndwzkquzumc5c4d7hy

large-datacap-requests[bot] commented 1 year ago

The issue reached the total datacap requested. This should be closed

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f12ima4tjej3yqvbnu7hizyobfrrkq574v7ojytay

Last two approvers

newwebgroup & llifezou

Rule to calculate the allocation request amount

total dc reached

DataCap allocation requested

0

Total DataCap granted for client so far

4.90PiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

100TiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
164085 16 370TiB 15.31 70.51TiB
zhonghdadi commented 1 year ago

Hi @dkkapur my datacap still has 100T left, why doesn't the bot allocate it to me?

filplus-checker commented 1 year ago

DataCap and CID Checker Report[^1]

If this is the first time a provider takes verified deal, it will be marked as new.

For most of the datacap application, below restrictions should apply.

✔️ Storage provider distribution looks healthy.

Provider Location Total Deals Sealed Percentage Unique Data Duplicate Deals
f01938665new Sham Shui Po, Sham Shui Po, HK 792.47 TiB 15.79% 786.00 TiB 0.82%
f01938714new Sham Shui Po, Sham Shui Po, HK 739.78 TiB 14.74% 737.47 TiB 0.31%
f01938717new Singapore, Singapore, SG 642.00 TiB 12.79% 639.34 TiB 0.41%
f01938718new Morrisville, North Carolina, US 558.00 TiB 11.12% 558.00 TiB 0.00%
f01938721new Hong Kong, Central and Western, HK 498.03 TiB 9.92% 498.03 TiB 0.00%
f01852023 Busan, Busan, KR 431.25 TiB 8.59% 431.25 TiB 0.00%
f01852325 Hong Kong, Central and Western, HK 368.53 TiB 7.34% 368.53 TiB 0.00%
f01851482 Busan, Busan, KR 343.78 TiB 6.85% 343.78 TiB 0.00%
f01852677 Morrisville, North Carolina, US 326.41 TiB 6.50% 326.41 TiB 0.00%
f01852664 Singapore, Singapore, SG 270.28 TiB 5.38% 270.28 TiB 0.00%
f0240185 Clifton, New Jersey, US 9.81 TiB 0.20% 9.81 TiB 0.00%
f0143858 Clifton, New Jersey, US 9.81 TiB 0.20% 9.81 TiB 0.00%
f03223 San Jose, California, US 9.72 TiB 0.19% 9.72 TiB 0.00%
f01193812 Boardman, Oregon, US 9.22 TiB 0.18% 9.22 TiB 0.00%
f0674600 Los Angeles, California, US 5.92 TiB 0.12% 5.80 TiB 2.11%
f02301 San Jose, California, US 4.94 TiB 0.10% 4.94 TiB 0.00%

Provider Distribution

Deal Data Replication

The below table shows how each many unique data are replicated across storage providers.

✔️ Data replication looks healthy.

Unique Data Size Total Deals Made Number of Providers Deal Percentage
55.95 TiB 56.08 TiB 1 1.12%
22.22 TiB 44.44 TiB 2 0.89%
18.72 TiB 57.00 TiB 3 1.14%
147.69 TiB 595.44 TiB 4 11.86%
852.22 TiB 4.17 PiB 5 85.00%

Replication Distribution

Deal Data Shared with other Clients

The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.

⚠️ CID sharing has been observed.

Other Client Application Total Deals Affected Unique CIDs Verifier
f1wyxv3ysg3xpgmzlpuhkfqykm6wfhohdg4ordnmq Shenzhen Jubao Time Technology Co., Ltd. 196.75 TiB 2,121 LDN v3 multisig
f14z37zddplbkmmkvm3jrdldkxji5a5r6iux4dhfi Common primitive universe 39.45 TiB 186 LDN v3 multisig
f1dbpdc56q6wfcmb4p2ppzqruufiqcr2s5xqwybma `` 2.58 TiB 83 Philipp Banhardt
f17subptxqumxfdt27r64amsvkehh5bwxtd2aethi wujia 1.89 TiB 61 embedsky

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

cryptowhizzard commented 1 year ago

1214

CID sharing / fraudulent data.

lvschouwen commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report[^1]

Storage Provider Distribution

The below table shows the distribution of storage providers that have stored data for this client.

If this is the first time a provider takes verified deal, it will be marked as new.

For most of the datacap application, below restrictions should apply.

✔️ Storage provider distribution looks healthy.

Provider Location Total Deals Sealed Percentage Unique Data Duplicate Deals
f01193812 Boardman, Oregon, US
Amazon.com, Inc.
9.22 TiB 0.18% 9.22 TiB 0.00%
f01938721new Hong Kong, Central and Western, HK
BIH-Global Internet Harbor
498.03 TiB 9.92% 498.03 TiB 0.00%
f01852325 Hong Kong, Central and Western, HK
BIH-Global Internet Harbor
368.53 TiB 7.34% 368.53 TiB 0.00%
f01938665new Sham Shui Po, Sham Shui Po, HK
China Unicom Global
792.47 TiB 15.79% 786.00 TiB 0.82%
f01938714new Sham Shui Po, Sham Shui Po, HK
China Unicom Global
739.78 TiB 14.74% 737.47 TiB 0.31%
f0240185 Clifton, New Jersey, US
DigitalOcean, LLC
9.81 TiB 0.20% 9.81 TiB 0.00%
f0143858 Clifton, New Jersey, US
DigitalOcean, LLC
9.81 TiB 0.20% 9.81 TiB 0.00%
f0674600 Los Angeles, California, US
IT7 Networks Inc
5.92 TiB 0.12% 5.80 TiB 2.11%
f01852023 Busan, Busan, KR
Korea Telecom
431.25 TiB 8.59% 431.25 TiB 0.00%
f01851482 Busan, Busan, KR
Korea Telecom
343.78 TiB 6.85% 343.78 TiB 0.00%
f03223 San Jose, California, US
Krypt Technologies
9.72 TiB 0.19% 9.72 TiB 0.00%
f02301 San Jose, California, US
Krypt Technologies
4.94 TiB 0.10% 4.94 TiB 0.00%
f01938717new Singapore, Singapore, SG
StarHub Ltd
642.00 TiB 12.79% 639.34 TiB 0.41%
f01852664 Singapore, Singapore, SG
StarHub Ltd
270.28 TiB 5.38% 270.28 TiB 0.00%
f01938718new Morrisville, North Carolina, US
TierPoint, LLC
558.00 TiB 11.12% 558.00 TiB 0.00%
f01852677 Morrisville, North Carolina, US
TierPoint, LLC
326.41 TiB 6.50% 326.41 TiB 0.00%

Provider Distribution

Deal Data Replication

The below table shows how each many unique data are replicated across storage providers.

✔️ Data replication looks healthy.

Unique Data Size Total Deals Made Number of Providers Deal Percentage
55.95 TiB 56.08 TiB 1 1.12%
22.22 TiB 44.44 TiB 2 0.89%
18.72 TiB 57.00 TiB 3 1.14%
147.69 TiB 595.44 TiB 4 11.86%
852.22 TiB 4.17 PiB 5 85.00%

Replication Distribution

Deal Data Shared with other Clients

The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.

However, this could be possible if all below clients use same software to prepare for the exact same dataset or they belong to a series of LDN applications for the same dataset.

⚠️ CID sharing has been observed.

Other Client Application Total Deals Affected Unique CIDs Approvers
f1wyxv3ysg3xpgmzlpuhkfqykm6wfhohdg4ordnmq Shenzhen Jubao Time Technology Co., Ltd. 196.75 TiB 2,121 11ane-1
2kernelogic
2NDLABS-OFFICE
3stcouldlisa
1Tom-OriginStorage
1zizi-defil
f14z37zddplbkmmkvm3jrdldkxji5a5r6iux4dhfi Common primitive universe 39.45 TiB 186 Unknown
f1dbpdc56q6wfcmb4p2ppzqruufiqcr2s5xqwybma `` 2.58 TiB 83 Unknown
f17subptxqumxfdt27r64amsvkehh5bwxtd2aethi wujia 1.89 TiB 61

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 14 days, so for now it is being closed. Please feel free to contact the Fil+ Gov team to re-open the application if it is still being processed. Thank you!