filecoin-project / filecoin-plus-large-datasets

Hub for client applications for DataCap at a large scale
110 stars 62 forks source link

[DataCap Application] Aohuan Technology - Front-end material #940

Closed AohuanTec closed 1 year ago

AohuanTec commented 2 years ago

Large Dataset Notary Application

To apply for DataCap to onboard your dataset to Filecoin, please fill out the following.

Core Information

Please respond to the questions below by replacing the text saying "Please answer here". Include as much detail as you can in your answer.

Project details

Share a brief history of your project and organization.

Beijing Aohuan Technology Co., Ltd. was established in 2008. As a leading IT service provider in China, Aohuan has been focusing on the development and operation of high-end Internet e-commerce and information system platform for many years. Based on the deep cultivation of the Internet industry, Aohuan provides comprehensive digital solutions from the aspects of strategy, technology and operation, creating the ultimate ecology in the "Internet +" era, and helping enterprises to successfully transform.

What is the primary source of funding for this project?

Currently, it mainly comes from financing and operating income, and we do not rule out the introduction of further strategic investment partners in the future.

What other projects/ecosystem stakeholders is this project associated with?

There is no other projects/ecosystem stakeholders associated with.

Use-case details

Describe the data being stored onto Filecoin

The data are material files used in front-end software development, such as background images, music, button clicks and sound effects of animation transitions. We use different styles of materials according to customers' needs to present the most satisfactory results.

Where was the data in this dataset sourced from?

The materials are the virtual effects videos generated by the company's data resources department. Audio files are the materials used in the past front-end software development process. The above resources do not exist copyright disputes, which is the whole network can use.

Can you share a sample of the data? A link to a file, an image, a table, etc., are good ways to do this.

Audio material sample:
https://drive.google.com/drive/folders/1P3JePaGnuiG7BO4U4KsoO0NIQ3i8I_WN?usp=sharing
Video material sample:
https://drive.google.com/drive/folders/1tUjWtKcz74FyLvhKEd0EH1g2sEdfkRV2?usp=sharing

Confirm that this is a public dataset that can be retrieved by anyone on the Network (i.e., no specific permissions or access rights are required to view the data).

Yes, it is a public data.

What is the expected retrieval frequency for this data?

The expected retrieval frequency is about 10 times per year.

For how long do you plan to keep this dataset stored on Filecoin?

18 months at least. We will have a try to store a longer time.

DataCap allocation plan

In which geographies (countries, regions) do you plan on making storage deals?

Asia

How will you be distributing your data to storage providers? Is there an offline data transfer process?

There is no offline transmission.
You can upload or download files from an online storage server.

How do you plan on choosing the storage providers with whom you will be making deals? This should include a plan to ensure the data is retrievable in the future both by you and others.

We want to select SPs with a certain level of strength, which will be measured in terms of R&D capability, Oems capability, and maintained storage Filecoin power. We will fully examine the relevant certificates and historical credit ratings of storage enterprises. Of course, we will preferentially select SPs that contribute to the Filecoin retrieval market.

How will you be distributing deals across storage providers?

We will allocate the data according to the comprehensive strength of the storage provider, and the provider with stronger comprehensive strength will get more data capacity.

Do you have the resources/funding to start making deals as soon as you receive DataCap? What support from the community would help you onboard onto Filecoin?

Yes, we are ready to carry out the project.
If the authorities can provide more FVM related development examples.It would help us learn how to use the Filecoin network to build Dapps.
large-datacap-requests[bot] commented 2 years ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

raghavrmadya commented 2 years ago

Can you provide evidence that the background images, music, button clicks, and sound effects of animation transitions are generated and owned by your organization? Additionally, we need more details on how much data you have. It is difficult to determine the request for 3 PiBs

AohuanTec commented 2 years ago

There are two sources of material resources used in the front-end development process. Common materials such as button styles and transition effects generally use public resources on the Internet. We have integrated and summarized the scattered resources. In addition, for special effects, we will use generative software (such as Houdini) to customize the generation. img_v2_9ca9bd91-40a4-40c3-bbcc-cfbbb3ea483g

At present, we've collected and created about >700TiB of material files: img_v2_5e3fa027-44eb-4418-a6e9-254c7eb16b6g

One direct details are as follows: img_v2_258f54c3-696b-4317-85f6-f4b7b5446e3g

We plan to store a minimum of 4-5 copies on the Filecoin network, so we applied for a DC capacity of 3PiB. In the future, the material files will be continuously added and updated, and we will continue to store the data on the chain.

AohuanTec commented 2 years ago

Hello, team, @raghavrmadya , we offered evidence a few days ago. if you noticed our reply and have no other questions, could you please update our application? Thanks!

simonkim0515 commented 2 years ago

Datacap Request Trigger

Total DataCap requested

3PiB

Expected weekly DataCap usage rate

100TiB

Client address

f1g3pn5gkliwaoeatenmqzfzbqiys6ntyb4sbqfnq

large-datacap-requests[bot] commented 2 years ago

DataCap Allocation requested

Multisig Notary address

f01858410

Client address

f1g3pn5gkliwaoeatenmqzfzbqiys6ntyb4sbqfnq

DataCap allocation requested

50TiB

Id

ed917fb0-7f87-4c75-a298-efee6a379039

Tom-OriginStorage commented 2 years ago

1:Could you send an email to filplus-app-review@fil.org ? 2:Can you provide more detailed information about other storage providers participated in this program, such as you can list SPs you have contacted with at present?

newwebgroup commented 2 years ago

As mentioned above, the transmission mode of data sets is online downloading. Please provide a download link to verify that you have a 700TIB dataset

NDLABS-Leo commented 2 years ago

Because the notary has raised questions and has not responded, waiting for the client to deal with it...

AohuanTec commented 2 years ago

@Tom-OriginStorage

Sunnyiscoming commented 2 years ago

The email address is not from your domain name(aohuanit.com). Could you send an email to filplus-app-review@fil.org with your official domain in order to confirm your identity? Email name should includes the issue id #940.

AohuanTec commented 2 years ago

@Sunnyiscoming
We don't have an email with domain (aohuanit.com), but the "master@360server.cn" is the official email address of our company, you can get this address from our official website.

In addition, the content of the email contains a complete link to this issue.

Sunnyiscoming commented 2 years ago

Ok. I saw that.

AohuanTec commented 1 year ago

Some notaries require to use the mail with the domain name (aohuanit.com) for KYC verification. Our company has been using the free corporate mail provided by 360, and the domain name is 360server.cn. In order to comply with the review rules of Fil+, we specially applied for our own domain name email address and resent the email. Official staff and notaries are requested to verify. img_v2_81537ca3-6998-44fe-b24c-ee810b8c451g

AohuanTec commented 1 year ago

Currently contacted SPs include NWG, Shenzhen Star-Storage, SXX Future Data, node numbers: f01943316, f01964215, f022820, f0815838, f01801587, f01981603

Tom-OriginStorage commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacecngbijcytqaes46nlk2eilhkbeotkhsajajwqs5hyhs6b6xwpkdc

Address

f1g3pn5gkliwaoeatenmqzfzbqiys6ntyb4sbqfnq

Datacap Allocated

50.00TiB

Signer Address

f1q6bpjlqia6iemqbrdaxr2uehrhpvoju3qh4lpga

Id

ed917fb0-7f87-4c75-a298-efee6a379039

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecngbijcytqaes46nlk2eilhkbeotkhsajajwqs5hyhs6b6xwpkdc

psh0691 commented 1 year ago

Sign the primary DC allocation based on the initial verified data.

psh0691 commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceai6au6p7lf7dfdi3udkztr2ybxaoege7rvgleua7tvniqtygbzai

Address

f1g3pn5gkliwaoeatenmqzfzbqiys6ntyb4sbqfnq

Datacap Allocated

50.00TiB

Signer Address

f1qdko4jg25vo35qmyvcrw4ak4fmuu3f5rif2kc7i

Id

ed917fb0-7f87-4c75-a298-efee6a379039

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceai6au6p7lf7dfdi3udkztr2ybxaoege7rvgleua7tvniqtygbzai

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 2

Multisig Notary address

f01858410

Client address

f1g3pn5gkliwaoeatenmqzfzbqiys6ntyb4sbqfnq

DataCap allocation requested

100TiB

Id

0cf0ef0a-7940-4a31-93a1-dcbe60c7d477

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f1g3pn5gkliwaoeatenmqzfzbqiys6ntyb4sbqfnq

Last two approvers

psh0691 & llifezou

Rule to calculate the allocation request amount

100% of weekly dc amount requested

DataCap allocation requested

100TiB

Total DataCap granted for client so far

50TiB

Datacap to be granted to reach the total amount requested by the client (3PiB)

2.95PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
1337 4 50TiB 29.92 6.46TiB
filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report[^1]

Storage Provider Distribution

The below table shows the distribution of storage providers that have stored data for this client.

If this is the first time a provider takes verified deal, it will be marked as new.

For most of the datacap application, below restrictions should apply.

Since this is the 3rd allocation, the following restrictions have been relaxed:

✔️ Storage provider distribution looks healthy.

Provider Location Total Deals Sealed Percentage Unique Data Duplicate Deals
f01771695 Wuhan, Hubei, CN
CHINA UNICOM China169 Backbone
10.38 TiB 24.98% 10.38 TiB 0.00%
f01964215 Shenzhen, Guangdong, CN
CHINANET-BACKBONE
6.22 TiB 14.97% 6.22 TiB 0.00%
f01753456 Hong Kong, Central and Western, HK
UNION FU WAH DIGITAL TECHNOLOGY LIMITED
12.50 TiB 30.10% 12.50 TiB 0.00%
f01681234 Hong Kong, Central and Western, HK
UNION FU WAH DIGITAL TECHNOLOGY LIMITED
12.44 TiB 29.95% 12.44 TiB 0.00%

Provider Distribution

Deal Data Replication

The below table shows how each many unique data are replicated across storage providers.

Since this is the 3rd allocation, the following restrictions have been relaxed:

✔️ Data replication looks healthy.

Unique Data Size Total Deals Made Number of Providers Deal Percentage
1.16 TiB 2.31 TiB 2 5.57%
6.16 TiB 18.47 TiB 3 44.47%
5.19 TiB 20.75 TiB 4 49.96%

Replication Distribution

Deal Data Shared with other Clients

The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.

However, this could be possible if all below clients use same software to prepare for the exact same dataset or they belong to a series of LDN applications for the same dataset.

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

NDLABS-Leo commented 1 year ago

Client Contact me on slack, waiting for reply questions for further review.

AohuanTec commented 1 year ago

I contacted the relevant SP manufacturer, and the response to me was that IDC’s China Unicom network service provider had bandwidth problems in the past two days. They were dealing with this problem yesterday, and I will continue to track the network situation.

herrehesse commented 1 year ago

@AohuanTec If that is the case, then please perform another check and let us know if the miners are reachable. We wil do automated tests every day to see if they stay online, we will also download and extract the data to see if everything is in order.

Until then I kindly ask notaries not to sign and continue with this application.

@AohuanTec How are you going to resolve the distribution, all your SP's are in the same region.

AohuanTec commented 1 year ago

@cryptowhizzard Yes, we urge the relevant SP to continue to fix the retrieval problem. It is worth affirming that their engineers are continuing to improve even during the Chinese New Year holidays, and it seems to have achieved results so far. Now that the holiday is over, we have to start the next storage work. If you approve of our work, please help us sign it.

AohuanTec commented 1 year ago

? f0187709 does not belong to our SPs, nor does the data CID img_v2_fb78cd44-b81a-4acf-9b1c-b0c620281b8g

cryptowhizzard commented 1 year ago

That is strange. Please ignore my message above, i will check again for you today.

// Cleaning up my above message to start with a clean slate.

Ok , i tested here and i can retrieve data. I don't want to check the data itself and don't want to hold up the proces. I will do a propose.

For the next round, can you please show us some proof of data stored? And please, fill out the KYC form -> this form

cryptowhizzard commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceb66pjbu7o7rgizyemrh7ihwgohetnvpltdirjyhto2ahckppbozm

Address

f1g3pn5gkliwaoeatenmqzfzbqiys6ntyb4sbqfnq

Datacap Allocated

100.00TiB

Signer Address

f1krmypm4uoxxf3g7okrwtrahlmpcph3y7rbqqgfa

Id

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceb66pjbu7o7rgizyemrh7ihwgohetnvpltdirjyhto2ahckppbozm

AohuanTec commented 1 year ago

Okay, next round I'll provide evidence that we backed up the unseal files for quick retrieval. If you support our project, please help me complete the signature, this project has been stopped for a while.

AohuanTec commented 1 year ago

@cryptowhizzard I will fill the form later, Thanks!

Alex11801 commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacedc73sycq4gwkv2ukjgdt5yyxuu7ktvcfsbr7uerfms3qdyys4c6y

Address

f1g3pn5gkliwaoeatenmqzfzbqiys6ntyb4sbqfnq

Datacap Allocated

100.00TiB

Signer Address

f1hhippi64yiyhpjdtbidfyzma6irc2nuav7mrwmi

Id

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedc73sycq4gwkv2ukjgdt5yyxuu7ktvcfsbr7uerfms3qdyys4c6y

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 3

Multisig Notary address

f01858410

Client address

f1g3pn5gkliwaoeatenmqzfzbqiys6ntyb4sbqfnq

DataCap allocation requested

200TiB

Id

21653558-acc7-4cb7-a0df-d22c94baf9d3

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f1g3pn5gkliwaoeatenmqzfzbqiys6ntyb4sbqfnq

Last two approvers

Alex11801 & cryptowhizzard

Rule to calculate the allocation request amount

200% of weekly dc amount requested

DataCap allocation requested

200TiB

Total DataCap granted for client so far

150TiB

Datacap to be granted to reach the total amount requested by the client (3PiB)

2.85PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
4503 7 100TiB 40.42 24.75TiB
filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report[^1]

Storage Provider Distribution

The below table shows the distribution of storage providers that have stored data for this client.

If this is the first time a provider takes verified deal, it will be marked as new.

For most of the datacap application, below restrictions should apply.

Since this is the 4th allocation, the following restrictions have been relaxed:

✔️ Storage provider distribution looks healthy.

Provider Location Total Deals Sealed Percentage Unique Data Duplicate Deals
f01964253 Guangzhou, Guangdong, CN
China Unicom Guangdong IP network
4.25 TiB 3.42% 4.25 TiB 0.00%
f01986229 Hangzhou, Zhejiang, CN
CHINANET-BACKBONE
43.16 TiB 34.74% 43.16 TiB 0.00%
f01964215 Shenzhen, Guangdong, CN
CHINANET-BACKBONE
18.34 TiB 14.77% 18.34 TiB 0.00%
f01771695 Hong Kong, Central and Western, HK
HONG KONG BRIDGE INFO-TECH LIMITED
10.38 TiB 8.35% 10.38 TiB 0.00%
f01876488 Ho Chi Minh City, Ho Chi Minh, VN
UCLOUD INFORMATION TECHNOLOGY (HK) LIMITED
4.41 TiB 3.55% 4.41 TiB 0.00%
f01681234 Hong Kong, Central and Western, HK
UNION FU WAH DIGITAL TECHNOLOGY LIMITED
31.19 TiB 25.11% 30.44 TiB 2.40%
f01753456 Hong Kong, Central and Western, HK
UNION FU WAH DIGITAL TECHNOLOGY LIMITED
12.50 TiB 10.06% 12.50 TiB 0.00%

Provider Distribution

Deal Data Replication

The below table shows how each many unique data are replicated across storage providers.

Since this is the 4th allocation, the following restrictions have been relaxed:

⚠️ 55.12% of deals are for data replicated across less than 4 storage providers.

Unique Data Size Total Deals Made Number of Providers Deal Percentage
15.25 TiB 15.25 TiB 1 12.28%
19.63 TiB 39.25 TiB 2 31.60%
4.66 TiB 13.97 TiB 3 11.25%
4.28 TiB 17.16 TiB 4 13.81%
4.88 TiB 24.59 TiB 5 19.80%
2.25 TiB 14.00 TiB 6 11.27%

Replication Distribution

Deal Data Shared with other Clients

The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.

However, this could be possible if all below clients use same software to prepare for the exact same dataset or they belong to a series of LDN applications for the same dataset.

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

cryptowhizzard commented 1 year ago

Hi,

I tested retrieval today with SP f01964215, it did not work. Can you please take a look.

Feb 9 12:20:03 proposals dealscanner-f01914993-f01964215: Recv 0 B, Paid 0 FIL, Open (New), 0s [1675842797944985820|0] Feb 9 12:20:03 proposals dealscanner-f01914993-f01964215: Recv 0 B, Paid 0 FIL, DealProposed (WaitForAcceptance), 13ms [1675842797944985820|0] Feb 9 12:20:04 proposals dealscanner-f01914993-f01964215: Recv 0 B, Paid 0 FIL, DealAccepted (Accepted), 461ms [1675842797944985820|0] Feb 9 12:20:04 proposals dealscanner-f01914993-f01964215: Recv 0 B, Paid 0 FIL, PaymentChannelSkip (Ongoing), 462ms [1675842797944985820|0] Feb 9 12:20:04 proposals dealscanner-f01914993-f01964215: Recv 0 B, Paid 0 FIL, ProviderCancelled (Cancelling), 464ms [1675842797944985820|0] Feb 9 12:20:04 proposals dealscanner-f01914993-f01964215: Recv 0 B, Paid 0 FIL, CancelComplete (Cancelled), 465ms [1675842797944985820|0] Feb 9 12:20:04 proposals dealscanner-f01914993-f01964215: ERROR: Retrieval Proposal Cancelled: Provider cancelled retrieval Feb 9 12:20:04 proposals dealscanner-f01914993-f01964215:

AohuanTec commented 1 year ago

unseal files for quick retrieval: a8061ff5-9067-4a1f-8d4c-f1c46a307517

AohuanTec commented 1 year ago

@herrehesse Since the CIDs that have just been sealed must be manually merged with metadata before they can be retrieved, there will be a time lag in the retrieval of a new batch of dealids. I just contacted SP operation and maintenance to manually merge metadata, and I have tested it locally. If you find a dealid that cannot be retrieved later, you can notify me to solve it.

    #lotus state get-deal 24199558
    {
  "Proposal": {
    "PieceCID": {
      "/": "baga6ea4seaqhlu5rnceguvmmrbrbeqv7dskbn3t424p3olt3mcq4tb6qtligwfy"
    },
    "PieceSize": 34359738368,
    "VerifiedDeal": true,
    "Client": "f01914993",
    "Provider": "f01964215",
    "Label": "uAXASIB2-4-qdjlm2dQMf9jSe80kzAPi0TWuLgvVrSbkqny8z",
    "StartEpoch": 2594873,
    "EndEpoch": 4135816,
    "StoragePricePerEpoch": "0",
    "ProviderCollateral": "10382840982189418",
    "ClientCollateral": "0"
  },
  "State": {
    "SectorStartEpoch": 2585917,
    "LastUpdatedEpoch": -1,
    "SlashEpoch": -1,
    "VerifiedClaim": 6663278
  }
}

    # lotus client retrieve --provider f01964215 uAXASIB2-4-qdjlm2dQMf9jSe80kzAPi0TWuLgvVrSbkqny8z test.car
    Recv 0 B, Paid 0 FIL, Open (New), 0s
Recv 0 B, Paid 0 FIL, DealProposed (WaitForAcceptance), 3ms
Recv 0 B, Paid 0 FIL, DealAccepted (Accepted), 179ms
Recv 0 B, Paid 0 FIL, PaymentChannelSkip (Ongoing), 179ms
Recv 25.99 KiB, Paid 0 FIL, BlocksReceived (Ongoing), 551ms
Recv 27.85 KiB, Paid 0 FIL, BlocksReceived (Ongoing), 552ms
Recv 1.027 MiB, Paid 0 FIL, BlocksReceived (Ongoing), 903ms
Recv 2.027 MiB, Paid 0 FIL, BlocksReceived (Ongoing), 1.198s
Recv 3.027 MiB, Paid 0 FIL, BlocksReceived (Ongoing), 1.658s
Recv 4.027 MiB, Paid 0 FIL, BlocksReceived (Ongoing), 1.869s
Recv 5.027 MiB, Paid 0 FIL, BlocksReceived (Ongoing), 2.051s
Recv 6.027 MiB, Paid 0 FIL, BlocksReceived (Ongoing), 2.11s
Recv 7.027 MiB, Paid 0 FIL, BlocksReceived (Ongoing), 2.433s
Recv 8.027 MiB, Paid 0 FIL, BlocksReceived (Ongoing), 2.843s
Recv 9.027 MiB, Paid 0 FIL, BlocksReceived (Ongoing), 3.248s
Recv 10.03 MiB, Paid 0 FIL, BlocksReceived (Ongoing), 3.755s
Recv 11.03 MiB, Paid 0 FIL, BlocksReceived (Ongoing), 4.248s
Recv 12.03 MiB, Paid 0 FIL, BlocksReceived (Ongoing), 4.7s
Recv 13.03 MiB, Paid 0 FIL, BlocksReceived (Ongoing), 5.15s
Recv 14.03 MiB, Paid 0 FIL, BlocksReceived (Ongoing), 5.56s
Recv 15.03 MiB, Paid 0 FIL, BlocksReceived (Ongoing), 5.999s
herrehesse commented 1 year ago

@AohuanTec Thank you for the collaboration and continued work. Together we must strive for perfection. Can you provide us with information about which SP's are which businesses?

Screenshot 2023-02-10 at 09 10 08

As long as the data that you claim to store is packed and inside the retrieved sectors, will continue to support.

AohuanTec commented 1 year ago

@herrehesse pls check Slack PM

herrehesse commented 1 year ago

Received. Please let me know if your retrievals are OK and willing to support this next round.

psh0691 commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report[^1]

Storage Provider Distribution

The below table shows the distribution of storage providers that have stored data for this client.

If this is the first time a provider takes verified deal, it will be marked as new.

For most of the datacap application, below restrictions should apply.

Since this is the 4th allocation, the following restrictions have been relaxed:

✔️ Storage provider distribution looks healthy.

Provider Location Total Deals Sealed Percentage Unique Data Duplicate Deals
f01964253 Guangzhou, Guangdong, CN
China Mobile communications corporation
4.25 TiB 2.89% 4.25 TiB 0.00%
f01986229 Hangzhou, Zhejiang, CN
CHINANET-BACKBONE
43.16 TiB 29.36% 43.16 TiB 0.00%
f01964215 Shenzhen, Guangdong, CN
CHINANET-BACKBONE
18.34 TiB 12.48% 18.34 TiB 0.00%
f01986236 Los Angeles, California, US
Cogent Communications
12.00 TiB 8.17% 12.00 TiB 0.00%
f01771695 Hong Kong, Central and Western, HK
HONG KONG BRIDGE INFO-TECH LIMITED
10.38 TiB 7.06% 10.38 TiB 0.00%
f01876488 Singapore, Singapore, SG
SingNet
15.16 TiB 10.31% 15.16 TiB 0.00%
f01681234 Hong Kong, Central and Western, HK
UNION FU WAH DIGITAL TECHNOLOGY LIMITED
31.19 TiB 21.22% 30.44 TiB 2.40%
f01753456 Hong Kong, Central and Western, HK
UNION FU WAH DIGITAL TECHNOLOGY LIMITED
12.50 TiB 8.51% 12.50 TiB 0.00%

Provider Distribution

Deal Data Replication

The below table shows how each many unique data are replicated across storage providers.

Since this is the 4th allocation, the following restrictions have been relaxed:

✔️ Data replication looks healthy.

Unique Data Size Total Deals Made Number of Providers Deal Percentage
13.06 TiB 13.06 TiB 1 8.89%
13.25 TiB 26.50 TiB 2 18.03%
1.22 TiB 3.66 TiB 3 2.49%
16.28 TiB 65.16 TiB 4 44.33%
4.88 TiB 24.59 TiB 5 16.73%
2.25 TiB 14.00 TiB 6 9.53%

Replication Distribution

Deal Data Shared with other Clients

The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.

However, this could be possible if all below clients use same software to prepare for the exact same dataset or they belong to a series of LDN applications for the same dataset.[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

psh0691 commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacebdkrk3ksttjvlerym4qafox44r6ysevub3zse5jxtb62nmtr4izc

Address

f1g3pn5gkliwaoeatenmqzfzbqiys6ntyb4sbqfnq

Datacap Allocated

200.00TiB

Signer Address

f1qdko4jg25vo35qmyvcrw4ak4fmuu3f5rif2kc7i

Id

21653558-acc7-4cb7-a0df-d22c94baf9d3

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebdkrk3ksttjvlerym4qafox44r6ysevub3zse5jxtb62nmtr4izc

cryptowhizzard commented 1 year ago

Hi,

I would love to do due diligence here and move forward on this LDN, however, retrieval does not work.

Feb 15 17:22:08 proposals dealscanner-f01914993-f01986236: Error: Failed to retrieve content with candidate miner f01986236: data transfer failed: datatransfer error: data transfer channel 12D3KooWGJpT1vdLktshKZRWrA3Apw1eKBxwjPfoJF64AtEwdKrq-12D3KooWGgu8UiXJF3rBiBKdShrWDaffcWZwpAndyCY5qehQimj5-1676477401279110771 failed to transfer data: channel 12D3KooWGJpT1vdLktshKZRWrA3Apw1eKBxwjPfoJF64AtEwdKrq-12D3KooWGgu8UiXJF3rBiBKdShrWDaffcWZwpAndyCY5qehQimj5-1676477401279110771: graphsync request failed to complete: expected link (bafybeig5hmw4g6ywjev4plgkilbsf3ynwuvcr4kowysi5gg54jza2qwkb4) at path does not match link sent by remote (bafkreigat6c4kd6smbpi6jxgu24m4qhejrfxd3nsko7tyzclx73w5ze724), possible malicious responder

AohuanTec commented 1 year ago

@cryptowhizzard Can you provide the deal_id or dataCID which cannot retrieve? I will contact SP to resolve the issue.

cryptowhizzard commented 1 year ago

Done on slack.

cryptowhizzard commented 1 year ago

Feb 16 19:01:26 proposals dealscanner-f01914993-f01986236: Recv 43.62 MiB, Paid 0 FIL, BlocksReceived (Ongoing), 17m22.031s [1676445845934082941|45734848] Feb 16 19:13:30 proposals dealscanner-f01914993-f01986236: Recv 43.62 MiB, Paid 0 FIL, DataTransferError (Erroring), 29m26.178s [1676445845934082941|45734848] Feb 16 19:13:30 proposals dealscanner-f01914993-f01986236: Recv 43.62 MiB, Paid 0 FIL, BlockstoreFinalized (Errored), 29m26.18s [1676445845934082941|45734848] Feb 16 19:13:30 proposals dealscanner-f01914993-f01986236: ERROR: Retrieval Error: error generated by data transfer: deal data transfer failed: data transfer channel 12D3KooWAhG3BRy2RhVgMbvBNyq5z61JwFYHcmEXopGm5pw54QdW-12D3KooWGgu8UiXJF3rBiBKdShrWDaffcWZwpAndyCY5qehQimj5-1676445845928232540 failed to transfer data: channel 12D3KooWAhG3BRy2RhVgMbvBNyq5z61JwFYHcmEXopGm5pw54QdW-12D3KooWGgu8UiXJF3rBiBKdShrWDaffcWZwpAndyCY5qehQimj5-1676445845928232540: graphsync request failed to complete: error traversing node at "Links/4/Hash/Links/18/Hash": could not load link "bafkreig4aimtr2tzizarpfppoxczhi2oviq36xums54576ia6qz7jrnzbm": expected link (bafybeig5hmw4g6ywjev4plgkilbsf3ynwuvcr4kowysi5gg54jza2qwkb4) at path does not match link sent by remote (bafkreie6cckkyqr2ymixq2d462tushww3oakcug7iof72mzd5cb67wk6qq), possible malicious responder Feb 16 19:13:30 proposals dealscanner-f01914993-f01986236:

Still not working btw.

AohuanTec commented 1 year ago

img_v2_7cb1a849-bd79-49fc-bbfb-06f54e96632g @cryptowhizzard It can be seen that the data is not unretrievable. There is no problem with our server, but your location is too far away from the location of the node, causing network packet loss, so let's not be too pedantic.

kernelogic commented 1 year ago

I went all the way to spin up a AWS node in Singapore zone and was able to retrieve a full sector and validate its content. In the future I will use this Singapore node to validate Asian SPs.

image

image

image
kernelogic commented 1 year ago

image