search

filecoin-project / filecoin-plus-large-datasets

Hub for client applications for DataCap at a large scale
110 stars 62 forks source link

[DataCap Application] Daxian Tec - Industry Datasets #1016

Closed jeterhunt closed 9 months ago

jeterhunt commented 2 years ago

Large Dataset Notary Application

To apply for DataCap to onboard your dataset to Filecoin, please fill out the following.

Core Information

Please respond to the questions below by replacing the text saying "Please answer here". Include as much detail as you can in your answer.

Project details

Share a brief history of your project and organization.

Beijing Daxian Technology Co., Ltd. is an industry-oriented Saas platform, dedicated to helping enterprises tap the procurement opportunities and channel resources of big customers, and empower enterprises through big data and AI technology. Our team members all have decades of SaaS related background, strong big data analysis ability and rich project management experience, who are experts in product, technology, data and sales industries.The company focuses on the in-depth mining of customer data resources in subdivided industries, and has a comprehensive layout in education, medical, finance, energy, transportation and government industries to help enterprises find precise customers and core channels, understand the market situation, and reasonably allocate sales resources.

What is the primary source of funding for this project?

The project will be funded by our company.

What other projects/ecosystem stakeholders is this project associated with?

No other associated items.

Use-case details

Describe the data being stored onto Filecoin

The products are targeted at large financial and economic customers, and the multi-dimensional and multi-depth data mining and knowledge graph construction are carried out to help the majority of scientific and technological innovative enterprises to achieve intelligent sales for education, medical care, finance, government and other fields. It relies on big data technology to provide users with market analysis, business opportunities mining, channel expansion, intelligent CRM and other features. 
1. Market analysis: according to the historical recruitment and acquisition transaction data, conduct statistical analysis, extrapolation and prediction in terms of products, customer groups, regions, time and other dimensions, and assist users in making market layout and sales decisions;
2. Business opportunity mining: predict the future procurement demand of the purchaser through data collection and correlation analysis of the purchaser's historical procurement, industry trends, project announcements, academic papers and other data;
3. Channel development: Based on the in-depth modeling of enterprises in the industry segmentation field, build the profile of channel dealers and relationship maps, and break through the relationship barriers between customers and buyers;
4. Intelligent CRM: Provide intelligent and efficient clue and customer management functions, and realize the full chain closed-loop of sales lead insight, mining, reaching, closing and after-sales management.
We save large data sets to Filecoin for cold storage backup and user retrieval, including marketing statistics, industry news, product information, and so on.

Where was the data in this dataset sourced from?

It's the network open data collected by colleagues from the data resources department of our company which is trimmed to fit the project.

Can you share a sample of the data? A link to a file, an image, a table, etc., are good ways to do this. 

https://www.daxiancloud.com/file/articles_0101.zip
https://www.daxiancloud.com/file/articles_0110.zip
https://www.daxiancloud.com/file/articles_0119.zip
https://www.daxiancloud.com/file/articles_0128.zip
https://www.daxiancloud.com/file/articles_0206.zip
https://www.daxiancloud.com/file/articles_0215.zip
https://www.daxiancloud.com/file/articles_0224.zip
https://www.daxiancloud.com/file/articles_0305.zip
https://www.daxiancloud.com/file/articles_0314.zip
https://www.daxiancloud.com/file/articles_0323.zip
https://www.daxiancloud.com/file/articles_0401.zip
https://www.daxiancloud.com/file/articles_0410.zip
https://www.daxiancloud.com/file/articles_0419.zip
https://www.daxiancloud.com/file/articles_0428.zip
https://www.daxiancloud.com/file/articles_0507.zip
https://www.daxiancloud.com/file/articles_0516.zip
https://www.daxiancloud.com/file/articles_0525.zip
https://www.daxiancloud.com/file/articles_0603.zip
https://www.daxiancloud.com/file/articles_0612.zip
https://www.daxiancloud.com/file/articles_0621.zip
...

Confirm that this is a public dataset that can be retrieved by anyone on the Network (i.e., no specific permissions or access rights are required to view the data).

Yes, it can be accessed without any identification.

What is the expected retrieval frequency for this data?

As the data are segmented, the retrieval frequency is not so high, which is about 5 times per year.

For how long do you plan to keep this dataset stored on Filecoin?

We plan to permanently store all the data.

DataCap allocation plan

In which geographies (countries, regions) do you plan on making storage deals?

Asia, mainly in CN.

How will you be distributing your data to storage providers? Is there an offline data transfer process?

Both online and offline transmissions are possible. If the SP requests offline transmission, we can also mail storage disks.

How do you plan on choosing the storage providers with whom you will be making deals? This should include a plan to ensure the data is retrievable in the future both by you and others.

Currently we have contacted several SPs through the FIL community in China. Meanwhile, in order to select more trustworthy partners, we set up a system to evaluate the capabilities of the SPs.
In the future, we will contact more SPs through other channels. For the data that has been packaged and stored, we will disclose its on-chain CID, and visitors can retrieve the data stored on the chain through CID.

How will you be distributing deals across storage providers?

Due to the previous systematic evaluation of SPs, we allocate the size of datacapaccording to the final results.

Do you have the resources/funding to start making deals as soon as you receive DataCap? What support from the community would help you onboard onto Filecoin?

Partner SPs are already ready. Once the datacap is approved, it plans to save it as File Plus as soon as possible.
If we have any questions in the future, we will contact the official staff by email.
large-datacap-requests[bot] commented 2 years ago

Thanks for your request!

Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!
large-datacap-requests[bot] commented 2 years ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

jeterhunt commented 2 years ago

Hey, @RG @Kevin - FF @Deep Kapur Just want to flag this proposal if you haven't seen this. Feel free to check it,please!

jeterhunt commented 2 years ago

If you have any additional information to add, please feel free to contact us. @galen-mcandrew @raghavrmadya @Kevin-FF-USA @dkkapur

jeterhunt commented 1 year ago

No response for a long time. @Kevin-FF-USA @raghavrmadya @galen-mcandrew

Sunnyiscoming commented 1 year ago

What's the relationship between you and the organization? Can you provide more detailed information about other storage providers participated in this program, such as you can list SPs you have contacted with at present? Could you send an email to filplus-app-review@fil.org with your official domain in order to confirm your identity? Email name should includes the issue id #1016.

raghavrmadya commented 1 year ago

Unable to view files after downloading

raghavrmadya commented 1 year ago

please share in an accessible format on the drive

jeterhunt commented 1 year ago

@Sunnyiscoming I am a software technology research and development engineer at Daxian Tec. At present, our company has contacted several Filcoin storage companies in China, "Shenzhen Star Storage Technology" and "Yichang SXX Future Data". We are conducting on-site inspections.

jeterhunt commented 1 year ago

And confirm email has been sent, It is sent through the enterprise official domain email address. image

jeterhunt commented 1 year ago

@raghavrmadya I did a download and decompression test in private, and the file can be displayed normally. I don't know why you can't view the data here. In addition, I uploaded a compressed package to weiyun cloud, you can try again. https://share.weiyun.com/5G0rNl33 a85515b3-8d3b-4640-803b-8c1e67350d25

simonkim0515 commented 1 year ago

Datacap Request Trigger

Total DataCap requested

5PiB

Expected weekly DataCap usage rate

200TiB

Client address

f1kluvacbdczzmzaicduhsnwnuyd2q2jisikkdija

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Multisig Notary address

f01858410

Client address

f1kluvacbdczzmzaicduhsnwnuyd2q2jisikkdija

DataCap allocation requested

100TiB

Id

f1387579-5679-46c5-9828-2e39518021ae

IreneYoung commented 1 year ago

@jeterhunt How many SPs you intend to make deal with?

jeterhunt commented 1 year ago

@IreneYoung At present, we have contacted 5 SPs , which are provided by powerful domestic storage companies in China, and are also distributed in different regions. But this is not necessarily the final number, we are looking for more SP, including overseas.

IreneYoung commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacedfcgs2uljn6h4wfu4wxcyjvw3mtq2k7r2xzq72hlsdjzdji23rne

Address

f1kluvacbdczzmzaicduhsnwnuyd2q2jisikkdija

Datacap Allocated

100.00TiB

Signer Address

f1d4gmpqz3execjj2wvrxuuhvbms5mzh7t7yqrviq

Id

f1387579-5679-46c5-9828-2e39518021ae

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedfcgs2uljn6h4wfu4wxcyjvw3mtq2k7r2xzq72hlsdjzdji23rne

newwebgroup commented 1 year ago
  1. Can you provide more detailed information about other storage providers participated in this program, such as you can list SPs you have contacted with at present?

2.How large is your existing dataset? How much is the data growth per month?

jeterhunt commented 1 year ago

@newwebgroup

  1. Through the domestic Filecoin community and the roundtables held by domestic storage providers, we have been able to connect with companies with technology capabilities. In this project, 6 (possibly more) minners are planning to join in, which are f0815838, f01981603, f01964215, f01611281, f0408629 and f01964253.

  2. The collective amount of data we use for big data analysis reaches the level of PB, of course, we will select the desensitized part for on-chain cold storage backup. As for the growth of data, about 50T data will be added every month.

newwebgroup commented 1 year ago

Please provide more evidence that you have a PB level dataset

jeterhunt commented 1 year ago

@newwebgroup image

newwebgroup commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceagkby25apbpizaqcari53sfjiajlvevhgofjueombk7wroo3l3m2

Address

f1kluvacbdczzmzaicduhsnwnuyd2q2jisikkdija

Datacap Allocated

100.00TiB

Signer Address

f1e77zuityhvvw6u2t6tb5qlnsegy2s67qs4lbbbq

Id

f1387579-5679-46c5-9828-2e39518021ae

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceagkby25apbpizaqcari53sfjiajlvevhgofjueombk7wroo3l3m2

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 2

Multisig Notary address

f01858410

Client address

f1kluvacbdczzmzaicduhsnwnuyd2q2jisikkdija

DataCap allocation requested

200TiB

Id

81f17cf9-2522-4e62-a446-39dd8c6c2aaf

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f1kluvacbdczzmzaicduhsnwnuyd2q2jisikkdija

Last two approvers

newwebgroup & IreneYoung

Rule to calculate the allocation request amount

100% of weekly dc amount requested

DataCap allocation requested

200TiB

Total DataCap granted for client so far

100TiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

4.90PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
2337 4 100TiB 35.34 23.46TiB
filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report[^1]

Storage Provider Distribution

The below table shows the distribution of storage providers that have stored data for this client.

If this is the first time a provider takes verified deal, it will be marked as new.

For most of the datacap application, below restrictions should apply.

Since this is the 3rd allocation, the following restrictions have been relaxed:

✔️ Storage provider distribution looks healthy.

Provider Location Total Deals Sealed Percentage Unique Data Duplicate Deals
f01771695new Wuhan, Hubei, CN
CHINA UNICOM China169 Backbone		 25.38 TiB 36.84% 20.53 TiB 19.09%
f01986203 Guangzhou, Guangdong, CN
CHINANET Guangdong province network		 13.00 TiB 18.87% 13.00 TiB 0.00%
f01964215 Shenzhen, Guangdong, CN
CHINANET-BACKBONE		 7.00 TiB 10.16% 7.00 TiB 0.00%
f01753456new Hong Kong, Central and Western, HK
UNION FU WAH DIGITAL TECHNOLOGY LIMITED		 23.38 TiB 33.94% 21.00 TiB 10.16%
f01681234 Hong Kong, Central and Western, HK
UNION FU WAH DIGITAL TECHNOLOGY LIMITED		 128.00 GiB 0.18% 128.00 GiB 0.00%

Provider Distribution

Deal Data Replication

The below table shows how each many unique data are replicated across storage providers.

Since this is the 3rd allocation, the following restrictions have been relaxed:

✔️ Data replication looks healthy.

Unique Data Size Total Deals Made Number of Providers Deal Percentage
320.00 GiB 320.00 GiB 1 0.45%
7.66 TiB 15.31 TiB 2 22.23%
7.63 TiB 23.91 TiB 3 34.71%
5.75 TiB 29.16 TiB 4 42.33%
32.00 GiB 192.00 GiB 5 0.27%

Replication Distribution

Deal Data Shared with other Clients

The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.

However, this could be possible if all below clients use same software to prepare for the exact same dataset or they belong to a series of LDN applications for the same dataset.

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

cryptowhizzard commented 1 year ago

Hello,

Only 2 miners are reachable. ( f01753456 and f01681234 ) , however they both give errors on everything i try to retrieve. The other miners are not reachable.

The FIL+ program requires your miners to be reachable and retrieving of data should be possible. None off all the data uploaded is available for retrievable.

Question 1: Can you please contact the SP's in question and correct the situation? Question 2: Can you provide us with a list of CID's of the dataset you build so we can verify what you are doing?

Thanks

root@xxxxxx:~# lotus net connect f01771695 f01771695 -> {12D3KooWGjG3NDWERwRNb87YLZrxBWjhAqxqyKRH8q7pUdhazxVa: [/ip4/119.36.32.147/tcp/7001]} ERROR: failed to parse multiaddr "f01771695": must begin with /

root@xx:~# telnet 119.36.32.147 7001 Trying 119.36.32.147... telnet: Unable to connect to remote host: Connection refused

lotus net connect f01986203 f01986203 -> {12D3KooWQqqxN3dAu6xy1Q7heYGYBd9uEzMuiccXGd9vK7UFxAaL: [/ip4/120.133.132.150/tcp/12911]} ERROR: failed to parse multiaddr "f01986203": must begin with / root@xx:~# telnet 120.133.132.150 12911 Trying 120.133.132.150... telnet: Unable to connect to remote host: Connection refused

lotus net connect f01964215 f01964215 -> {12D3KooWMm54HHNegB6gb7Eqxbc1sA3HSRSraxLQ8SD1J66Q2aMy: [/ip4/14.17.106.229/tcp/12891]} ERROR: failed to parse multiaddr "f01964215": must begin with / root@xx:~# telnet 14.17.106.229 12891 Trying 14.17.106.229... telnet: Unable to connect to remote host: Connection refused

root@xx:~# lotus net connect f01753456 f01753456 -> {12D3KooWDBjFE7UCn5jcUDYifK8QEpE2j8fMs1rDip9CPiNTyNiW: [/ip4/39.109.85.25/tcp/12288]} ERROR: failed to parse multiaddr "f01753456": must begin with /

You have new mail in /var/mail/root root@xx:~# telnet 39.109.85.25 12288 Trying 39.109.85.25... Connected to 39.109.85.25. Escape character is '^]'. /multistream/1.0.0

lotus net connect f01681234 f01681234 -> {12D3KooWA152A3djuxHxmLDFLc59fhdqLvceKu52zpY1rS4pAX4b: [/ip4/39.109.85.23/tcp/12288]} ERROR: failed to parse multiaddr "f01681234": must begin with /

root@proposals:~# telnet 39.109.85.23 12288 Trying 39.109.85.23... Connected to 39.109.85.23. Escape character is '^]'. /multistream/1.0.0

cryptowhizzard commented 1 year ago

Hello,

Is there any progress?

cat /root/Dropbox/clientdealscannerdone/f01926691.csv.log /usr/local/bin/lotus state get-deal 20388674 /usr/local/bin/lotus client retrieve --provider f01964215 uAXASIF9yVnhPCxnO2uMQBEe-1dhVrRJjqOMcbsBKYGctXoBL /usr/local/bin/lotus state get-deal 20388675 /usr/local/bin/lotus client retrieve --provider f01964215 uAXASIGaw6Arf74vD03ZhaX_8Iq_f_ZOZfSNZ85Y4e-ea5ogX /usr/local/bin/lotus state get-deal 20796000 /usr/local/bin/lotus client retrieve --provider f01771695 uAXASILAJPub8IKhqmFziBxy0vq_CnczUkITrf-VnD3ZlWhbQ /usr/local/bin/lotus state get-deal 20796001 /usr/local/bin/lotus client retrieve --provider f01771695 uAXASILlNm_v6zjHXwYnlzR79ognbLKCsc2iNQop--9EIfh-F /usr/local/bin/lotus state get-deal 20821539 /usr/local/bin/lotus client retrieve --provider f01771695 uAXASIDzepX23v5RfuhrPntu8_JoUGARWkUhM6M6DfW5bIa76 Recv 0 B, Paid 0 FIL, Open (New), 0s [1674620104712459132|0] Recv 0 B, Paid 0 FIL, DealProposed (WaitForAcceptance), 13ms [1674620104712459132|0] Recv 0 B, Paid 0 FIL, DealAccepted (Accepted), 283ms [1674620104712459132|0] Recv 0 B, Paid 0 FIL, PaymentChannelSkip (Ongoing), 283ms [1674620104712459132|0] /usr/local/bin/lotus state get-deal 20906737 /usr/local/bin/lotus client retrieve --provider f01771695 uAXASINsQ6ki-AQMOF-NKjiLDHk6G_m2VxguPxyzZyJpCdGBy Recv 0 B, Paid 0 FIL, Open (New), 0s [1674620104712459133|0] Recv 0 B, Paid 0 FIL, DealProposed (WaitForAcceptance), 10ms [1674620104712459133|0] ERROR: offer error: retrieval query offer errored: failed to fetch piece to retrieve from: getting pieces for cid bafybeib432sx3n57srp3ugwpt3n3z7e2cqmaivurjbgortudpvxfwino7i: getting pieces containing block bafybeib432sx3n57srp3ugwpt3n3z7e2cqmaivurjbgortudpvxfwino7i: failed to lookup index for mh 12203cdea57db7bf945fba1acf9edbbcfc9a1418045691484ce8ce837d6e5b21aefa, err: datastore: key not found

Recv 0 B, Paid 0 FIL, DealAccepted (Accepted), 285ms [1674620104712459133|0] Recv 0 B, Paid 0 FIL, PaymentChannelSkip (Ongoing), 285ms [1674620104712459133|0] ERROR: offer error: retrieval query offer errored: failed to fetch piece to retrieve from: getting pieces for cid bafybeig3cdverpqbamhbpy2kryrmghsoq37g3fogboh4olgzzcnee5daoi: getting pieces containing block bafybeig3cdverpqbamhbpy2kryrmghsoq37g3fogboh4olgzzcnee5daoi: failed to lookup index for mh 1220db10ea48be01030e17e34a8e22c31e4e86fe6d95c60b8fc72cd9c89a42746072, err: datastore: key not found

ERROR: offer error: retrieval query offer errored: failed to fetch piece to retrieve from: getting pieces for cid bafybeic7ojlhqtyldhhnvyyqard35voykwwrey5i4mog5qckmbts2xuajm: getting pieces containing block bafybeic7ojlhqtyldhhnvyyqard35voykwwrey5i4mog5qckmbts2xuajm: failed to lookup index for mh 12205f7256784f0b19cedae3100447bed5d855ad1263a8e31c6ec04a60672d5e804b, err: datastore: key not found

ERROR: offer error: retrieval query offer errored: failed to fetch piece to retrieve from: getting pieces for cid bafybeidgwduavx7prpb5g5tbnf77yivp376zhgl5enm7hfrypptzvzuic4: getting pieces containing block bafybeidgwduavx7prpb5g5tbnf77yivp376zhgl5enm7hfrypptzvzuic4: failed to lookup index for mh 122066b0e80adfef8bc3d37661697ffc22afdffd93997d2359f396387be79ae68817, err: datastore: key not found

jeterhunt commented 1 year ago

lotus state get-deal 20828553 lotus client retrieval-ask f01771695 uAXASIPR7PuG7HN1ODzIrhGyEYlJR7ZUJaZfapy2kWGYFeSwa Ask: f01771695 Unseal price: 0 FIL Price per byte: 0 FIL Payment interval: 1 MiB Payment interval increase: 1 MiB Size: 31.75 GiB Total price for 34091302912 bytes: 0 FIL

lotus state get-deal 20915777 lotus client retrieval-ask f01771695 uAXASIJLeo-a5yL9rxh5h62_gTdeUKjvCDaAjXcgW2AWh11hl Ask: f01771695 Unseal price: 0 FIL Price per byte: 0 FIL Payment interval: 1 MiB Payment interval increase: 1 MiB Size: 31.75 GiB Total price for 34091302912 bytes: 0 FIL

lotus state get-deal 20915706 lotus client retrieval-ask f01771695 uAXASINUtEYibcggwFI9_HVDUjtfGdLpGFKNrjG5YgMfwYH-u Ask: f01771695 Unseal price: 0 FIL Price per byte: 0 FIL Payment interval: 1 MiB Payment interval increase: 1 MiB Size: 31.75 GiB Total price for 34091302912 bytes: 0 FIL

lotus state get-deal 20791381 lotus client retrieval-ask f01771695 uAXASIMTfB0OH7yT7CkcSZ-npc-9JLHCP8ZUE_1aGE-ftH9mX Ask: f01771695 Unseal price: 0 FIL Price per byte: 0 FIL Payment interval: 1 MiB Payment interval increase: 1 MiB Size: 31.75 GiB Total price for 34091302912 bytes: 0 FIL

cryptowhizzard commented 1 year ago

Question:

Have you stored the unsealed files? When i try to retrieve it get's stuck for > 12 hours.

jeterhunt commented 1 year ago

@cryptowhizzard Yes, almost. Perhaps because the network transmission rate and stability across continents are not impressive, we can only encourage all SPs to upgrade their bandwidth as much as possible. like f01771695: img_v2_3f67133c-8001-4e4e-b7cd-115611d8012g

cryptowhizzard commented 1 year ago

Hi,

I would love to move forward here, but retrieval is not workin, still not .....

Feb 15 16:35:16 proposals dealscanner-f01926691-f01986229: Error: retrieval query for miner f01986229 failed: failed to dial 12D3KooWEfxT2rACPpBkwQJzfKJoJBWuaR9hY7kqMK6ZotG7ueqR: Feb 15 16:35:16 proposals dealscanner-f01926691-f01986229: * [/ip4/119.36.32.147/tcp/7007] failed to negotiate security protocol: context deadline exceeded

jeterhunt commented 1 year ago

@cryptowhizzard Can you post a complete test command so that I can locate the problem. You can also communicate with me directly through Slack PM @daxianyun during the testing process, which can speed up the efficiency.

herrehesse commented 1 year ago

Not supportive of this application due to the "Asia, mainly in CN". If the applicant can send "across" Asia (HK, SG, JP) then can easily send to EU and USA with the same bandwidth. Please provide me with a list of SP's, business names and region on which you want to store your files.

Also, a first time GitHub account asking for full 5PiB with zero history or reputation seems rather excessive my friend.

jeterhunt commented 1 year ago

@herrehesse My plan is to introduce SPs from US, Singapore and other countries.

and then, The DC quota is determined according to the nature of the project, which has nothing to do with the github account. There is also data transmission to different parts of the world, which depends on the capabilities of each client and various business considerations.

Don't always express some very childish views, I think our conversation can be more serious and responsible.

jeterhunt commented 1 year ago

@cryptowhizzard @herrehesse You two form Dcent, you ask me questions for a month . I answer your questions carefully and try to meet your requirements as much as possible.

Now you say cannot support!

@raghavrmadya @Kevin-FF-USA @simonkim0515 @galen-mcandrew As a client, we are in a very weak position in this system, we have no reliable channels to assert our rights, even though I realized at the beginning that I could not get the support of some notaries, but I have to deal with their difficulties in good faith all the time .

Now, even if I do everything I can, I can't find a notary who can support me, please tell me what should I do?

I feel willful evil and indifference everywhere in this project.

cryptowhizzard commented 1 year ago

Hi @jeterhunt

I did not say anywhere that i cannot support your LDN? Hence, i did a retrieval of your data and inspection of your data, it looks fine.

The only problem i have here before i can sign are your SP's/organizations you work with. Most/All of them are involved in Fil+abuse and that is a problem.

Scherm­afbeelding 2023-02-17 om 14 16 49

Since this metrics are relatively new and might come as a surprise to you as a customer I will provide your with a remedy.

Can you work with SP's with standing reputation from the US? GreaterHeat / PikNik / Seal / DLTX are all ok. To balance your data I will ask you to store the next tranche of datacap solely on these new SP's to be sure that the data has enough redundancy in the network.

If this is acceptable for you, let me know the new SP's and i will sign/propose.

jeterhunt commented 1 year ago

@cryptowhizzard We have communicated with GreaterHeat-Alan in the past and reached a storage agreement. We will add their nodes f01988794 and f01985775 in Dallas to our project. In addition to region of US, we also found SPs from Singapore and Japan to join.

kernelogic commented 1 year ago

Confirmed with Alan they indeed got into an agreement. Will support and do future retrievals to verify.

kernelogic commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceaxgoqjdjs3qpmhtychjqstxqs7gitorrapqlihshrim5dm3fdwek

Address

f1kluvacbdczzmzaicduhsnwnuyd2q2jisikkdija

Datacap Allocated

200.00TiB

Signer Address

f1yjhnsoga2ccnepb7t3p3ov5fzom3syhsuinxexa

Id

81f17cf9-2522-4e62-a446-39dd8c6c2aaf

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceaxgoqjdjs3qpmhtychjqstxqs7gitorrapqlihshrim5dm3fdwek

cryptowhizzard commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacebzzg3uzphf5fb2fwvvvrrcobzny3a5mx52fwkpjf3teyjom3mth4

Address

f1kluvacbdczzmzaicduhsnwnuyd2q2jisikkdija

Datacap Allocated

200.00TiB

Signer Address

f1krmypm4uoxxf3g7okrwtrahlmpcph3y7rbqqgfa

Id

81f17cf9-2522-4e62-a446-39dd8c6c2aaf

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebzzg3uzphf5fb2fwvvvrrcobzny3a5mx52fwkpjf3teyjom3mth4

cryptowhizzard commented 1 year ago

Thanks for the explanation. Looking forward to your first milestone.

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 3

Multisig Notary address

f01858410

Client address

f1kluvacbdczzmzaicduhsnwnuyd2q2jisikkdija

DataCap allocation requested

400TiB

Id

f548b29e-b067-4184-a8ff-9daa89ae96fb

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f1kluvacbdczzmzaicduhsnwnuyd2q2jisikkdija

Last two approvers

cryptowhizzard & kernelogic

Rule to calculate the allocation request amount

200% of weekly dc amount requested

DataCap allocation requested

400TiB

Total DataCap granted for client so far

100TiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

4.90PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
3431 6 200TiB 24.07 0B
filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the full report.

liyunzhi-666 commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the full report.

liyunzhi-666 commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the full report.

liyunzhi-666 commented 1 year ago

retrieval is OK,and no CID sharing 1677568102088

liyunzhi-666 commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacebf2ccpgqc7lhlxvfvqwpzhrlib2npuqofy3xd3isr3n4z6pkpucc

Address

f1kluvacbdczzmzaicduhsnwnuyd2q2jisikkdija

Datacap Allocated

400.00TiB

Signer Address

f1pszcrsciyixyuxxukkvtazcokexbn54amf7gvoq

Id

f548b29e-b067-4184-a8ff-9daa89ae96fb

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebf2ccpgqc7lhlxvfvqwpzhrlib2npuqofy3xd3isr3n4z6pkpucc

psh0691 commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceb6hl62l6igyxpqdql4xq6tedbee32l5cuhyios7mz6uupc4x53wi

Address

f1kluvacbdczzmzaicduhsnwnuyd2q2jisikkdija

Datacap Allocated

400.00TiB

Signer Address

f1qdko4jg25vo35qmyvcrw4ak4fmuu3f5rif2kc7i

Id

f548b29e-b067-4184-a8ff-9daa89ae96fb

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceb6hl62l6igyxpqdql4xq6tedbee32l5cuhyios7mz6uupc4x53wi