search

filecoin-project / filecoin-plus-large-datasets

Hub for client applications for DataCap at a large scale
109 stars 62 forks source link

[DataCap Application] MyTrade #386

Closed David-MyTrade closed 1 year ago

David-MyTrade commented 2 years ago

Large Dataset Notary Application

To apply for DataCap to onboard your dataset to Filecoin, please fill out the following.

Core Information

Please respond to the questions below by replacing the text saying "Please answer here". Include as much detail as you can in your answer.

Project details

Share a brief history of your project and organization.

Founded in 2020,MyTrade is a next generation DEX that looks and feels like a centralized exchange with a wide variety of quality tradable assets.

What is the primary source of funding for this project?

Commercial revenue of our own company.

What other projects/ecosystem stakeholders is this project associated with?

No, we are the only entity that engaged in this project.

Use-case details

Describe the data being stored onto Filecoin

Transaction data, history records of candlestick chart, user data and big data from billions of orders for AI training

Where was the data in this dataset sourced from?

As a centralized exchange, we have transaction records and relevant system file from over 10 chains in both DEX and CEX transactions; history records of candlestick chart for users and investors to analyze the market; user data and their behavior records for machine learning and data from orders for AI training

Can you share a sample of the data? A link to a file, an image, a table, etc., are good ways to do this. 

Sure. We've uploaded several samples.
[app_sum_action.csv](https://github.com/filecoin-project/filecoin-plus-large-datasets/files/8804617/app_sum_action.csv)
[app_user_action.csv](https://github.com/filecoin-project/filecoin-plus-large-datasets/files/8804618/app_user_action.csv)
[k_line_minute_matic_usdc_mytrade.csv](https://github.com/filecoin-project/filecoin-plus-large-datasets/f
[Release.csv](https://github.com/filecoin-project/filecoin-plus-large-datasets/files/8804622/Release.csv)
iles/8804619/k_line_minute_matic_usdc_mytrade.csv)

Confirm that this is a public dataset that can be retrieved by anyone on the Network (i.e., no specific permissions or access rights are required to view the data).

Yes, we confirm that the data we owned is public.

What is the expected retrieval frequency for this data?

2-3 times a year, or less retrieval frequency.

For how long do you plan to keep this dataset stored on Filecoin?

We are going to keep this dataset on Filecoin for 2 years.

DataCap allocation plan

In which geographies (countries, regions) do you plan on making storage deals?

All regions.

How will you be distributing your data to storage providers? Is there an offline data transfer process?

Both online and offline are available for us. SPs should have minimum 1Gbps bandwidth to get the online deal from us.

How do you plan on choosing the storage providers with whom you will be making deals? This should include a plan to ensure the data is retrievable in the future both by you and others.

SP should have at least 10x filecoin as mortgage

How will you be distributing deals across storage providers?

We’d like to making deals with 5-8 storage providers. In that case, each provider will storage up to 12.5% of our data. Storage provider from Filecoin community are also welcomed.

Do you have the resources/funding to start making deals as soon as you receive DataCap? What support from the community would help you onboard onto Filecoin?

Of course we have sufficient funds to start this project. We hope we can make contact with storage provides with technical skills from filecoin community.
large-datacap-requests[bot] commented 2 years ago

Thanks for your request!

Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!
large-datacap-requests[bot] commented 2 years ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

David-MyTrade commented 2 years ago

I've finished my issue for 6 days. @galen-mcandrew @dkkapur @Kevin-FF-USA

David-MyTrade commented 2 years ago

Can I get some response?

David-MyTrade commented 2 years ago

Please approve my issue. @galen-mcandrew @dkkapur @Kevin-FF-USA

Sunnyiscoming commented 2 years ago

@MyTrade-David Hey. Could you send an email to filplus@fil.org with your official domain in order to confirm your identity?

David-MyTrade commented 2 years ago

MTE1 Hi @Sunnyiscoming , I've finished it.

David-MyTrade commented 2 years ago

Hello every one, any update here?

large-datacap-requests[bot] commented 2 years ago

Thanks for your request!

Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!
large-datacap-requests[bot] commented 2 years ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

galen-mcandrew commented 2 years ago

Datacap Request Trigger

Total DataCap requested

5PiB

Expected weekly DataCap usage rate

200TiB

Client address

f1ffr7uhq7mszotfdybexcnl4i7xw5tqyp5fhqy3y

large-datacap-requests[bot] commented 2 years ago

DataCap Allocation requested

Multisig Notary address

f01858410

Client address

f1ffr7uhq7mszotfdybexcnl4i7xw5tqyp5fhqy3y

DataCap allocation requested

256TiB

MRJAVAZHAO commented 2 years ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceci4plujikr75fn7pwxkd6f5aiyscyn57wuspf5jyomodrcnalux2

Address

f1ffr7uhq7mszotfdybexcnl4i7xw5tqyp5fhqy3y

Datacap Allocated

256.00TiB

Signer Address

f14gme3f52prtyzk6pblogrdd6b6ivp4swc6qmesi

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceci4plujikr75fn7pwxkd6f5aiyscyn57wuspf5jyomodrcnalux2

PluskitOfficial commented 2 years ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacedoomlqatzn4kxuyvrxu53w3hz6au2id7jvtyeo36ksr5zggwtatu

Address

f1ffr7uhq7mszotfdybexcnl4i7xw5tqyp5fhqy3y

Datacap Allocated

256.00TiB

Signer Address

f1tgnlhtcmhwipfm7thsftxhn5k52velyjlazpvka

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedoomlqatzn4kxuyvrxu53w3hz6au2id7jvtyeo36ksr5zggwtatu

kevzak commented 2 years ago

Hello @David-MyTrade - I'm Kevin from the Client Success Team. I saw you were recently granted DataCap and began onboarding data. I wanted to reach out as you getting started to offer any support as needed. Let me know if you have any questions or issues.

Also, feel free to post a message in #fil-plus slack channel. Thank you!

David-MyTrade commented 2 years ago

@kevzak Thanks Kevin!

large-datacap-requests[bot] commented 2 years ago

DataCap Allocation requested

Request number 2

Multisig Notary address

f01858410

Client address

f1ffr7uhq7mszotfdybexcnl4i7xw5tqyp5fhqy3y

DataCap allocation requested

512TiB

large-datacap-requests[bot] commented 2 years ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f1ffr7uhq7mszotfdybexcnl4i7xw5tqyp5fhqy3y

Last two approvers

@PluskitOfficial & MRJAVAZHAO

Rule to calculate the allocation request amount

10% of total dc amount requested

DataCap allocation requested

512TiB

Total DataCap granted for client so far

256TiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

4.75PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
5722 4 256TiB 34.32 58.96TiB
Destore2023 commented 2 years ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceba67ryntkp7iifgj3wxl6pjn4cgcplwfzo7ds2e5qdktcqufqn3q

Address

f1ffr7uhq7mszotfdybexcnl4i7xw5tqyp5fhqy3y

Datacap Allocated

512.00TiB

Signer Address

f1yh6q3nmsg7i2sys7f7dexcuajgoweudcqj2chfi

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceba67ryntkp7iifgj3wxl6pjn4cgcplwfzo7ds2e5qdktcqufqn3q

MetaWaveInfo commented 2 years ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacebbtc6so7alwvrzfnyjmrknymvjwp73kjju7kvtmalpkmrrmhkvko

Address

f1ffr7uhq7mszotfdybexcnl4i7xw5tqyp5fhqy3y

Datacap Allocated

512.00TiB

Signer Address

f1ktlkcxnmzxcdaoqfsunrg3vocfbmgv4n3mrn74a

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebbtc6so7alwvrzfnyjmrknymvjwp73kjju7kvtmalpkmrrmhkvko

large-datacap-requests[bot] commented 2 years ago

DataCap Allocation requested

Request number 3

Multisig Notary address

f01858410

Client address

f1ffr7uhq7mszotfdybexcnl4i7xw5tqyp5fhqy3y

DataCap allocation requested

1PiB

large-datacap-requests[bot] commented 2 years ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f1ffr7uhq7mszotfdybexcnl4i7xw5tqyp5fhqy3y

Last two approvers

MetaWaveInfo & swatchliu

Rule to calculate the allocation request amount

20% of total dc amount requested

DataCap allocation requested

1PiB

Total DataCap granted for client so far

768TiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

4.25PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
23669 8 512TiB 21.92 13.65TiB
PluskitOfficial commented 2 years ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaced4mpl2hon75xnvyoueykhlz4paws6j2iwn5d4feaj2cahyk3ngbg

Address

f1ffr7uhq7mszotfdybexcnl4i7xw5tqyp5fhqy3y

Datacap Allocated

1.00PiB

Signer Address

f1tgnlhtcmhwipfm7thsftxhn5k52velyjlazpvka

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaced4mpl2hon75xnvyoueykhlz4paws6j2iwn5d4feaj2cahyk3ngbg

MatrixStorage commented 2 years ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacedtvbe6ya472c6x5hscryv2ghz5td4c5j65sjhvacivmr34jxzn6i

Address

f1ffr7uhq7mszotfdybexcnl4i7xw5tqyp5fhqy3y

Datacap Allocated

1.00PiB

Signer Address

f1tbxqwjxfyv7swsdin4einirlsfquv3vnmlapley

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedtvbe6ya472c6x5hscryv2ghz5td4c5j65sjhvacivmr34jxzn6i

BDE-io commented 2 years ago

@David-MyTrade Hi! Great to see you have gotten approval for DataCap. If you are looking for storage providers to store these data, please visit #bigdata-exchange on Filecoin Slack or reply here.

large-datacap-requests[bot] commented 2 years ago

DataCap Allocation requested

Request number 4

Multisig Notary address

f01858410

Client address

f1ffr7uhq7mszotfdybexcnl4i7xw5tqyp5fhqy3y

DataCap allocation requested

2PiB

large-datacap-requests[bot] commented 2 years ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f1ffr7uhq7mszotfdybexcnl4i7xw5tqyp5fhqy3y

Last two approvers

MatrixStorage & PluskitOfficial

Rule to calculate the allocation request amount

40% of total dc amount requested

DataCap allocation requested

2PiB

Total DataCap granted for client so far

1.75PiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

3.25PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
47281 15 1PiB 22.12 163.59TiB
1475Notary commented 2 years ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceacwlshanncdmhskttj5sa5rrvvq4nkqeruaavpu6egbae76stz4i

Address

f1ffr7uhq7mszotfdybexcnl4i7xw5tqyp5fhqy3y

Datacap Allocated

2.00PiB

Signer Address

f1ofq4mngy7ggcp755pfquq2gphjjnlydolf6awtq

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceacwlshanncdmhskttj5sa5rrvvq4nkqeruaavpu6egbae76stz4i

UnionLabs2020 commented 2 years ago

bafy2bzaceayxla6cyhr4hcbmpdzoewemgzketwmhtvjkam3wyxhlyo4jbjs6e

System error occurred, approved manually.

large-datacap-requests[bot] commented 2 years ago

Thanks for your request!

Heads up, you’re requesting more than the typical weekly onboarding rate of DataCap!
large-datacap-requests[bot] commented 2 years ago

DataCap Allocation requested

Request number 5

Multisig Notary address

f01858410

Client address

f1ffr7uhq7mszotfdybexcnl4i7xw5tqyp5fhqy3y

DataCap allocation requested

1.25PiB

large-datacap-requests[bot] commented 2 years ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f1ffr7uhq7mszotfdybexcnl4i7xw5tqyp5fhqy3y

Last two approvers

1475Notary & MatrixStorage

Rule to calculate the allocation request amount

80% of total dc amount requested

DataCap allocation requested

1.25PiB

Total DataCap granted for client so far

3.75PiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

1.25PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
115998 16 2PiB 11.88 95.21TiB
BlockMakeronline commented 2 years ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacecjd43s6facptpnbphcebb2myc7kpsa3rli7wfbq5j7c5a557m53i

Address

f1ffr7uhq7mszotfdybexcnl4i7xw5tqyp5fhqy3y

Datacap Allocated

1.25PiB

Signer Address

f1o3twrcpwjtpcd4q36lpq4qmy2qfbgtyy5h6tsty

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecjd43s6facptpnbphcebb2myc7kpsa3rli7wfbq5j7c5a557m53i

MRJAVAZHAO commented 2 years ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacecqcyawgsqnxopgp53qq4aac3wkjuyuzcpnp7xkp4r36m7cbadmxi

Address

f1ffr7uhq7mszotfdybexcnl4i7xw5tqyp5fhqy3y

Datacap Allocated

1.25PiB

Signer Address

f14gme3f52prtyzk6pblogrdd6b6ivp4swc6qmesi

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecqcyawgsqnxopgp53qq4aac3wkjuyuzcpnp7xkp4r36m7cbadmxi

large-datacap-requests[bot] commented 2 years ago

The issue reached the total datacap requested. This should be closed

filplus-checker commented 1 year ago

DataCap and CID Checker Report[^1]

If this is the first time a provider takes verified deal, it will be marked as new.

For most of the datacap application, below restrictions should apply.

⚠️ 30.16% of total deal sealed by f01889046 are duplicate data.

⚠️ 73.99% of total deal sealed by f01895778 are duplicate data.

⚠️ 83.49% of total deal sealed by f01880896 are duplicate data.

⚠️ 75.89% of total deal sealed by f01845679 are duplicate data.

⚠️ f01845679 has unknown IP location.

⚠️ 84.59% of total deal sealed by f01879880 are duplicate data.

⚠️ 84.96% of total deal sealed by f01880894 are duplicate data.

⚠️ 89.67% of total deal sealed by f01885260 are duplicate data.

⚠️ 57.86% of total deal sealed by f01885280 are duplicate data.

⚠️ 78.92% of total deal sealed by f01868890 are duplicate data.

⚠️ 52.90% of total deal sealed by f01880898 are duplicate data.

Provider Location Total Deals Sealed Percentage Unique Data Duplicate Deals
f01893290 Singapore, Singapore, SG 443.81 TiB 11.56% 391.44 TiB 11.80%
f01896469 Singapore, Singapore, SG 436.78 TiB 11.38% 400.38 TiB 8.34%
f01895891 Singapore, Singapore, SG 434.28 TiB 11.31% 396.78 TiB 8.63%
f01895928 Singapore, Singapore, SG 381.88 TiB 9.95% 381.88 TiB 0.00%
f01889046 Ashburn, Virginia, US 351.81 TiB 9.17% 245.72 TiB 30.16%
f01895778 Singapore, Singapore, SG 350.88 TiB 9.14% 91.25 TiB 73.99%
f01895707 Singapore, Singapore, SG 344.00 TiB 8.96% 281.91 TiB 18.05%
f01889480 Boardman, Oregon, US 226.81 TiB 5.91% 226.81 TiB 0.00%
f01880896 Singapore, Singapore, SG 163.16 TiB 4.25% 26.94 TiB 83.49%
f01845679 Unknown 145.69 TiB 3.80% 35.13 TiB 75.89%
f01879880 Singapore, Singapore, SG 128.00 TiB 3.33% 19.72 TiB 84.59%
f01880894 Singapore, Singapore, SG 127.78 TiB 3.33% 19.22 TiB 84.96%
f01885260new Hong Kong, Central and Western, HK 85.31 TiB 2.22% 8.81 TiB 89.67%
f01885280 Hong Kong, Central and Western, HK 61.63 TiB 1.61% 25.97 TiB 57.86%
f01868890 Boardman, Oregon, US 43.00 TiB 1.12% 9.06 TiB 78.92%
f01900713 Seoul, Seoul, KR 32.00 TiB 0.83% 32.00 TiB 0.00%
f01895715 Seoul, Seoul, KR 31.22 TiB 0.81% 31.22 TiB 0.00%
f01916487 Seoul, Seoul, KR 30.56 TiB 0.80% 30.56 TiB 0.00%
f01880898 Singapore, Singapore, SG 19.97 TiB 0.52% 9.41 TiB 52.90%

Provider Distribution

Deal Data Replication

The below table shows how each many unique data are replicated across storage providers.

⚠️ 94.74% of deals are for data replicated across less than 4 storage providers.

Unique Data Size Total Deals Made Number of Providers Deal Percentage
2.42 PiB 3.30 PiB 1 87.97%
5.41 TiB 24.47 TiB 2 0.64%
27.72 TiB 235.53 TiB 3 6.14%
17.19 TiB 147.13 TiB 4 3.83%
5.47 TiB 54.63 TiB 5 1.42%

Replication Distribution

Deal Data Shared with other Clients

The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.

⚠️ CID sharing has been observed.

Other Client Application Total Deals Affected Unique CIDs Verifier
f1tgii4xgcp6um4n2w7eqaw6bwvnvyii2u7cjgzka Meson.Network 444.16 TiB 2,472 LDN v3 multisig
f1727w2vwjctfo7hflr5trgqkl3c7texh7pl4grzq GMverse 122.84 TiB 1,486 LDN v3 multisig
f1dpgqn57cl5wqijiyv3256nids2ox3fms2mg3oay All Blue 109.78 TiB 1,013 LDN v3 multisig
f1zb6pgkktdbyy7zxfob6gripqxuc25ukf35cc7fq Maxpic PhotoGraphic Studio 90.03 TiB 808 LDN v3 multisig
f1u522dt3zabkgbxxzecl77wgv473yvpecxh6t6zq Huifan livestream 79.19 TiB 618 LDN v3 multisig
f1hik4fc3wvck2jchtufrnfnzmmskw2nyezlbsr3q NFTSCAN 57.31 TiB 404 LDN v3 multisig
f1muygjb5zowppbhr7wnmdreqdoiyyanfm7fe54dy MappingFunk Protocol 45.66 TiB 495 LDN v3 multisig
f1ki4cjk27ypzjsuzkvvqzs6xobaweuoxfdcnpqhy TimeQuant 45.41 TiB 853 LDN v3 multisig
f14abwn2goturifmt27s2bssoe3fup2b3npkgfzui KONGFU VR 35.81 TiB 293 LDN v3 multisig
f1ivsvpljx4ovp2tth73pllkxmumrudemks623iia TIS Inc. group 22.38 TiB 183 LDN v3 multisig
f1clwd2dooy2cflfilhzeq2ycl544b3heqsiwhjrq FiboAI 19.06 TiB 346 LDN v3 multisig
f3q7ablez3jqkcjukwbzaql7lmbx4ldouu66nexpd
cfvu6kgho3v6gricckt77cgr46tdre2l4zmvha7bs
u7qq		 MatrixStorage 7.94 TiB 135 LDN # 72
f1ojo3wo24zkeovndlxfpqmlgzlbysg5fiukmup4a Titansoft 5.19 TiB 23 LDN v3 multisig
f3skkellc7wegakh2blqeu4kkrlzuqy2siymwli7s
ec6eq77c2v4kzgz5ozgnasjl5r52ckameba5kds7h
djda		 Meizhai Technology 4.81 TiB 99 LDN v3 multisig
f1tivtdkq34mnfzso63wrr2xh6r2zo7aebao4jfla China travel service(HongKong) limited 3.13 TiB 21 LDN v3 multisig
f3woqxpu6ekmj43nmpcv7j2pgu6lejxtzgxpzl6f2
vrueoqlzjntakyhdkghymyffbzfbsio6dvfmy643x
4y7q		 RICH ST PETE LLC 1.88 TiB 24 LDN v3 multisig
f1qjrlejxv5a73kxurwtxyrni6ji7orm74zeeetiy Mooc 512.00 GiB 9 LDN v3 multisig
f1yswits4hd4zu6n2pl7nk7cspcuieuzl7btjn5ia TaoPaiPai 448.00 GiB 6 LDN # 54
f1bb2z36lpq3pnwiiowiraagpzqnpow4bonjacx7a Hola Space 224.00 GiB 4 LDN v3 multisig
f1dx7ljly4vmk5x2bn5ng4jpbqnuvozrz2phw42qy CoinPhD 128.00 GiB 4 LDN v3 multisig

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 14 days, so for now it is being closed. Please feel free to contact the Fil+ Gov team to re-open the application if it is still being processed. Thank you!