search

filecoin-project / filecoin-plus-large-datasets

Hub for client applications for DataCap at a large scale
110 stars 62 forks source link

[DataCap Application] <EVOCOM> - <Cross-chain Metaverse Social Platform> #696

Closed cdcdx closed 1 year ago

cdcdx commented 2 years ago

Large Dataset Notary Application

To apply for DataCap to onboard your dataset to Filecoin, please fill out the following.

Core Information

Please respond to the questions below by replacing the text saying "Please answer here". Include as much detail as you can in your answer.

Project details

Share a brief history of your project and organization.

We believe that blockchain and social networking must be indispensable in metaverse ecosystem, and our goal is to provide users with a highly open world, and enable them to participate in various ways through cross platform technology. To give users a highly immersive experience, Evocom avatars will correspond to a specific occupation, so as to gather groups with the same hobbies, skills and resources. Keep in mind this happens cross-chain, which means a larger user base, and all these together will make Evocom one of the coolest and most active communities!
Digital lands in Evocom are permanently owned by relevant community members. Lands are mainly divided into two categories: commercial and residential. As an important means of production, users can arrange various economic activities with lands, and new NFTs may be generated. For instance, houses built can purchased or rent for highly customized business activities, or as own private space to carry out meet-ups.
Based on the closed-loop of production-construction-consumption, development team will help to build economic system in early stage, and also work with community to build a complete set of economic ecosystem and maintain the development. While and after the formation of economic system, avatar NFTs will play key role in the world of Evocom.

What is the primary source of funding for this project?

ourselves

What other projects/ecosystem stakeholders is this project associated with?

No

Use-case details

Describe the data being stored onto Filecoin

video,pictures,data,logfile

Where was the data in this dataset sourced from?

Own Servers.

Can you share a sample of the data? A link to a file, an image, a table, etc., are good ways to do this. 

https://www.e-vo.io/data/EVOCOM_BP.pdf
https://www.youtube.com/watch?v=Z_ARNZAVEWg
https://www.youtube.com/watch?v=JUPyNYYQ5fo
https://www.youtube.com/watch?v=5tg_THnz0zA
https://drive.google.com/file/d/1mYJ6tEaceeqC7eZrgamVdBMM7jdMdDHf/view?usp=sharing

Confirm that this is a public dataset that can be retrieved by anyone on the Network (i.e., no specific permissions or access rights are required to view the data).

Yes.

What is the expected retrieval frequency for this data?

4-6 times a year.

For how long do you plan to keep this dataset stored on Filecoin?

Most of data is required to stored permanently.

DataCap allocation plan

In which geographies (countries, regions) do you plan on making storage deals?

Asia.

How will you be distributing your data to storage providers? Is there an offline data transfer process?

We plan to transfer data offline。

How do you plan on choosing the storage providers with whom you will be making deals? This should include a plan to ensure the data is retrievable in the future both by you and others.

We're selecting the SPs with high reputation on slack  . They have the ability to store deals at a very fast pace and a high success rate.

How will you be distributing deals across storage providers?

We plan to find more than 5 SPs and distribute the deals equally.
It is planned to package 70% in Hong Kong, 30% in other regions. Now we have contacted f01885111. Other service providers in contact have no ID for the time being

Do you have the resources/funding to start making deals as soon as you receive DataCap? What support from the community would help you onboard onto Filecoin?

We are contacting SPs and don't need community help at this time.
large-datacap-requests[bot] commented 2 years ago

Thanks for your request! Everything looks good. :ok_hand:

A Governance Team member will review the information provided and contact you back pretty soon.

raghavrmadya commented 2 years ago

What's your relationship as the applicant with EVOCOM?

cdcdx commented 2 years ago

What's your relationship as the applicant with EVOCOM?

Thanks for the reply, I am the developer of the EVOCOM project.

Sunnyiscoming commented 2 years ago

Can you provide more data samples to prove that you have 5 PB data already?How many copies will you store? Can you provide more detailed information about other storage providers participated in this program, such as you can list SPs you have contacted with at present? Could you send an email to filplus-app-review@fil.org with your official domain in order to confirm your identity? Email name should includes the issue id #696.

Sunnyiscoming commented 2 years ago

image

cdcdx commented 2 years ago

Can you provide more data samples to prove that you have 5 PB data already?How many copies will you store? Can you provide more detailed information about other storage providers participated in this program, such as you can list SPs you have contacted with at present? Could you send an email to filplus-app-review@fil.org with your official domain in order to confirm your identity? Email name should includes the issue id #696.

This project will be launched soon, and all data generated in the future will be stored in the FIL project. Contact SPs has f01885111/f01851988.

Please receive the verification email from admin@e-vo.io

Sunnyiscoming commented 2 years ago

Can you provide more data samples to prove that you have 5 PB data already?How many copies will you store?

cdcdx commented 2 years ago

Can you provide more data samples to prove that you have 5 PB data already?How many copies will you store?

https://www.e-vo.io/data/EVOCOM_BP.pdf https://www.youtube.com/watch?v=Z_ARNZAVEWg https://www.youtube.com/watch?v=JUPyNYYQ5fo https://www.youtube.com/watch?v=5tg_THnz0zA https://drive.google.com/file/d/1mYJ6tEaceeqC7eZrgamVdBMM7jdMdDHf/view?usp=sharing

These video data are samples, which are placed on youtube for convenience. These are all files related to this project, I can upload more if needed. For safety data at least 3 backups.

cdcdx commented 2 years ago

image

Since we are asia users, Twitter has blocked our account, and we are currently applying for unblocking.

You can also see our other accounts. Discord: https://discord.com/invite/HPfj2HYWNV
Telegram: https://t.me/EvocomOfficial

Sunnyiscoming commented 1 year ago

This project will be launched soon, and all data generated in the future will be stored in the FIL project. Large dataset is applied for existing dataset not for dataset in the future. How many data do you have at present? Can you describe the composition of 5 PB data? Please provide several data samples for each component data type.

Sunnyiscoming commented 1 year ago

I have not received the verification email from admin@e-vo.io Email name should includes the issue id https://github.com/filecoin-project/filecoin-plus-large-datasets/issues/696. Can you send to filplus-app-review@fil.org one more time?

cdcdx commented 1 year ago

I have not received the verification email from admin@e-vo.io Email name should includes the issue id #696. Can you send to filplus-app-review@fil.org one more time?

image

cdcdx commented 1 year ago

I have not received the verification email from admin@e-vo.io Email name should includes the issue id #696. Can you send to filplus-app-review@fil.org one more time?

sql

image This is the database file of the project, which is large and can only provide screenshots, not table information.

video

https://drive.google.com/file/d/126TByOxlz_ZH52zbiyF2djgWaERvNS88/view?usp=sharing https://drive.google.com/file/d/1UmsFW74Xje_P76FjgBlDHoYH3on2qWLs/view?usp=sharing

file

https://drive.google.com/file/d/14VMDG9fAGRZNM88HOxKvR9ZcdFqTgw7F/view?usp=sharing https://drive.google.com/file/d/15gsp_fYj1di5Ihhgl588IQKRZy9GMZ49/view?usp=sharing https://drive.google.com/file/d/1HTbjs77MZogiGEIKmWtwU-ldQnVtV5bd/view?usp=sharing

cdcdx commented 1 year ago

This project will be launched soon, and all data generated in the future will be stored in the FIL project. Large dataset is applied for existing dataset not for dataset in the future. How many data do you have at present? Can you describe the composition of 5 PB data? Please provide several data samples for each component data type.

The project is currently in the testing stage, and the data is not that large. The test data is estimated to be 1P, and a large amount of data will come in when it is officially launched.

Sunnyiscoming commented 1 year ago

Can you describe the composition of 5 PB data?

cdcdx commented 1 year ago

Can you describe the composition of 5 PB data?

In evocom, we provide a large amount of UGC content, which is created by users to enrich the metaverse content such as: Users can design costumes for in-game characters, and submit corresponding model files to the server for purchase and use by other users; Users can carry out secondary development on the basis of the game editor we provide, adding a lot of additional gameplay or content to the Metaverse; Users can use their own virtual characters to broadcast live in the metaverse world, and the live broadcast process will be stored on the server and provide playback functions; Users with land NFTs can build their own houses, and the furniture in the houses is also part of the UGC content. Users with home improvement design permissions can design furniture, decorations, and home appliances, and submit corresponding models and animation files to store on the server. for purchase and use by other users; Users with role customization rights can store their own character body shape and face shape data to the server for other users to purchase and use; The user interaction content generated in the game will also be stored in different forms for rolling back and solving problems during the operation process, including but not limited to: user movement, chat, construction, work, transactions and other interactive behaviors;

raghavrmadya commented 1 year ago

You previously submitted this application which was closed for no response. Can you explain the relationship b/w this application and prev app - https://github.com/filecoin-project/filecoin-plus-large-datasets/issues/436 ?

cdcdx commented 1 year ago

You previously submitted this application which was closed for no response. Can you explain the relationship b/w this application and prev app - #436 ?

The company has been engaged in the blockchain business and has many projects, Envato is a project 2 years ago, and EVO is a current project.

cdcdx commented 1 year ago

You previously submitted this application which was closed for no response. Can you explain the relationship b/w this application and prev app - #436 ?

436 is because it was too slow to wait for a reply, and I forgot after waiting. It was closed when I found out, so I re-applied for the current project.

raghavrmadya commented 1 year ago

Datacap Request Trigger

Total DataCap requested

2PiB

Expected weekly DataCap usage rate

50TiB

Client address

f1upoqjjco3fyt2g3j35hhn2zdfak32jqavwbtyvi

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Multisig Notary address

f02049625

Client address

f1upoqjjco3fyt2g3j35hhn2zdfak32jqavwbtyvi

DataCap allocation requested

25TiB

kernelogic commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzaceb6cek4vxz72r5qkjdrcy5mq2rdizvzgowtjfo6rft25nijb3nzwo

Address

f1upoqjjco3fyt2g3j35hhn2zdfak32jqavwbtyvi

Datacap Allocated

25.00TiB

Signer Address

f1yjhnsoga2ccnepb7t3p3ov5fzom3syhsuinxexa

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceb6cek4vxz72r5qkjdrcy5mq2rdizvzgowtjfo6rft25nijb3nzwo

psh0691 commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceb7cb22w6gg5zajsimqsqmxbnzxsutnfbvknhbav3v37dbztqwgny

Address

f1upoqjjco3fyt2g3j35hhn2zdfak32jqavwbtyvi

Datacap Allocated

25.00TiB

Signer Address

f1qdko4jg25vo35qmyvcrw4ak4fmuu3f5rif2kc7i

Id

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceb7cb22w6gg5zajsimqsqmxbnzxsutnfbvknhbav3v37dbztqwgny

BDE-io commented 1 year ago

@cdcdx Hi! Great to see you have gotten approval for DataCap. If you are looking for storage providers to store these data or have any questions, please visit #bigdata-exchange on Filecoin Slack or reply here.

We have strong demand from a diverse group of SPs, who are actively looking to onboard more data.

filplus-checker commented 1 year ago

DataCap and CID Checker Report[^1]

If this is the first time a provider takes verified deal, it will be marked as new.

For most of the datacap application, below restrictions should apply.

⚠️ f01926635 has sealed 100.00% of total datacap.

⚠️ All storage providers are located in the same region.

Provider Location Total Deals Sealed Percentage Unique Data Duplicate Deals
f01926635 Hong Kong, Central and Western, HK 16.00 GiB 100.00% 16.00 GiB 0.00%

Provider Distribution

Deal Data Replication

The below table shows how each many unique data are replicated across storage providers.

⚠️ 100.00% of deals are for data replicated across less than 4 storage providers.

Unique Data Size Total Deals Made Number of Providers Deal Percentage
16.00 GiB 16.00 GiB 1 100.00%

Replication Distribution

Deal Data Shared with other Clients

The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

cdcdx commented 1 year ago

DataCap and CID Checker Report1

  • Organization: EVOCOM
  • Client: f1upoqjjco3fyt2g3j35hhn2zdfak32jqavwbtyvi

Storage Provider Distribution

The below table shows the distribution of storage providers that have stored data for this client.

If this is the first time a provider takes verified deal, it will be marked as new.

For most of the datacap application, below restrictions should apply.

  • Storage provider should not exceed 25% of total datacap.
  • Storage provider should not be storing duplicate data for more than 20%.
  • Storage provider should have published its public IP address.
  • All storage providers should be located in different regions.

⚠️ f01926635 has sealed 100.00% of total datacap.

⚠️ All storage providers are located in the same region.

Provider Location Total Deals Sealed Percentage Unique Data Duplicate Deals f01926635 Hong Kong, Central and Western, HK 16.00 GiB 100.00% 16.00 GiB 0.00% Provider Distribution

Deal Data Replication

The below table shows how each many unique data are replicated across storage providers.

  • No more than 25% of unique data are stored with less than 4 providers.

⚠️ 100.00% of deals are for data replicated across less than 4 storage providers.

Unique Data Size Total Deals Made Number of Providers Deal Percentage 16.00 GiB 16.00 GiB 1 100.00% Replication Distribution

Deal Data Shared with other Clients

The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.

✔️ No CID sharing has been observed.

Footnotes

  1. To manually trigger this report, add a comment with text checker:manualTrigger ↩

Sorry for the delay, the order transaction has already started.

raulk-develop commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report[^1]

Storage Provider Distribution

The below table shows the distribution of storage providers that have stored data for this client.

If this is the first time a provider takes verified deal, it will be marked as new.

For most of the datacap application, below restrictions should apply.

Since this is the 3rd allocation, the following restrictions have been relaxed:

⚠️ f01926635 has sealed 87.13% of total datacap.

⚠️ All storage providers are located in the same region.

Provider Location Total Deals Sealed Percentage Unique Data Duplicate Deals
f01926635 Hong Kong, Central and Western, HK
OneAsia Network Limited		 21.80 TiB 87.13% 21.80 TiB 0.00%
f01885088 Hong Kong, Central and Western, HK
OneAsia Network Limited		 3.22 TiB 12.87% 3.22 TiB 0.00%

Provider Distribution

Deal Data Replication

The below table shows how each many unique data are replicated across storage providers.

Since this is the 3rd allocation, the following restrictions have been relaxed:

⚠️ 100.00% of deals are for data replicated across less than 3 storage providers.

Unique Data Size Total Deals Made Number of Providers Deal Percentage
18.58 TiB 18.58 TiB 1 74.27%
3.22 TiB 6.44 TiB 2 25.73%

Replication Distribution

Deal Data Shared with other Clients

The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.

However, this could be possible if all below clients use same software to prepare for the exact same dataset or they belong to a series of LDN applications for the same dataset.

⚠️ CID sharing has been observed.

Other Client Application Total Deals Affected Unique CIDs Approvers
f1x7wsqpj6waymzzfqmu4hh32tyc4pbbqnpwy2ucq Glif auto verified 32.00 GiB 1 Unknown

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 2

Multisig Notary address

f02049625

Client address

f1upoqjjco3fyt2g3j35hhn2zdfak32jqavwbtyvi

DataCap allocation requested

50TiB

Id

b3c7cf36-5c41-4612-8884-f5f8074fc93e

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f1upoqjjco3fyt2g3j35hhn2zdfak32jqavwbtyvi

Last two approvers

psh0691 & kernelogic

Rule to calculate the allocation request amount

100% of weekly dc amount requested

DataCap allocation requested

50TiB

Total DataCap granted for client so far

25TiB

Datacap to be granted to reach the total amount requested by the client (2PiB)

1.97PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
800 2 25TiB 87.13 16GiB
filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report[^1]

Storage Provider Distribution

The below table shows the distribution of storage providers that have stored data for this client.

If this is the first time a provider takes verified deal, it will be marked as new.

For most of the datacap application, below restrictions should apply.

Since this is the 3rd allocation, the following restrictions have been relaxed:

⚠️ f01926635 has sealed 87.13% of total datacap.

⚠️ All storage providers are located in the same region.

Provider Location Total Deals Sealed Percentage Unique Data Duplicate Deals
f01926635 Hong Kong, Central and Western, HK
OneAsia Network Limited		 21.80 TiB 87.13% 21.80 TiB 0.00%
f01885088 Hong Kong, Central and Western, HK
OneAsia Network Limited		 3.22 TiB 12.87% 3.22 TiB 0.00%

Provider Distribution

Deal Data Replication

The below table shows how each many unique data are replicated across storage providers.

Since this is the 3rd allocation, the following restrictions have been relaxed:

⚠️ 100.00% of deals are for data replicated across less than 3 storage providers.

Unique Data Size Total Deals Made Number of Providers Deal Percentage
18.58 TiB 18.58 TiB 1 74.27%
3.22 TiB 6.44 TiB 2 25.73%

Replication Distribution

Deal Data Shared with other Clients

The below table shows how many unique data are shared with other clients. Usually different applications owns different data and should not resolve to the same CID.

However, this could be possible if all below clients use same software to prepare for the exact same dataset or they belong to a series of LDN applications for the same dataset.

⚠️ CID sharing has been observed.

Other Client Application Total Deals Affected Unique CIDs Approvers
f1x7wsqpj6waymzzfqmu4hh32tyc4pbbqnpwy2ucq Glif auto verified 32.00 GiB 1 Unknown

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

cryptowhizzard commented 1 year ago

Hi,

You are storing everything with one organization. Why is it that you don't follow on the rules of FIL+ ?

Scherm­afbeelding 2023-01-27 om 14 08 07

cdcdx commented 1 year ago

Hi,

You are storing everything with one organization. Why is it that you don't follow on the rules of FIL+ ?

Scherm­afbeelding 2023-01-27 om 14 08 07

The amount of data in the early stage is relatively small, and the subsequent data will be stored in different places

cryptowhizzard commented 1 year ago

Thanks for that quick reply.

Can you tell me who the sp’s are for the second tranche of data and how many TB you will send to them (approx)

cdcdx commented 1 year ago

This time we need about 40T quota. We are still actively looking for sp. It is difficult to find reliable sps in different regions. The first time I used DC quotas was inexperienced, so I gave all the quotas to one sp. Later we will Pay attention to this matter, and spread the quota among sps in different regions.

lvschouwen commented 1 year ago

@cdcdx I think this is not how it should work. First provide the community a list of SP(s) (MinerIDs) where you plan to seal the next quote on. Then I suggest the notaries give you half of what you request and that can only be used to seal in a different location to demonstratie you are able to store this according to the rules of FIL+.

We cannot allow the misuse of datacap in the FIL+ community go any further.

cdcdx commented 1 year ago

@cdcdx I think this is not how it should work. First provide the community a list of SP(s) (MinerIDs) where you plan to seal the next quote on. Then I suggest the notaries give you half of what you request and that can only be used to seal in a different location to demonstratie you are able to store this according to the rules of FIL+.

We cannot allow the misuse of datacap in the FIL+ community go any further.

Well, this time we must strictly follow the rules

lvschouwen commented 1 year ago

@cdcdx I think this is not how it should work. First provide the community a list of SP(s) (MinerIDs) where you plan to seal the next quote on. Then I suggest the notaries give you half of what you request and that can only be used to seal in a different location to demonstratie you are able to store this according to the rules of FIL+. We cannot allow the misuse of datacap in the FIL+ community go any further.

Well, this time we must strictly follow the rules

Indeed. Looking forward to the list or the name (and MinerID(s)) of the SP(s) you will be working with to seal the next allocation in a different region 😄!

Until that time I would suggest that you will not be granted the next trench of datacap.

cryptowhizzard commented 1 year ago

Hi @cdcdx

Have you find new SP's already and are you ready to continiue?

As f01926635 and f01885088 share the same IP address you need 3! new SP's to start a new tranche of datacap.

I would like to get this LDN going again. Especially since i verified your data stored and the data matches the description of what you told us you were storing.

cdcdx commented 1 year ago

Hi @cdcdx

Have you find new SP's already and are you ready to continiue?

As f01926635 and f01885088 share the same IP address you need 3! new SP's to start a new tranche of datacap.

I would like to get this LDN going again. Especially since i verified your data stored and the data matches the description of what you told us you were storing.

Thank you for your reply, I will first find a few storage miner partners to meet the needs of off-site storage.

cdcdx commented 1 year ago

Hi @cdcdx

Have you find new SP's already and are you ready to continiue?

As f01926635 and f01885088 share the same IP address you need 3! new SP's to start a new tranche of datacap.

I would like to get this LDN going again. Especially since i verified your data stored and the data matches the description of what you told us you were storing.

We have contacted the new SP. The node number is f0399346. Any more information?

cdcdx commented 1 year ago

@cryptowhizzard hello, Our quota hasn't arrived yet, could you please take a look at the reason?

cdcdx commented 1 year ago

@cryptowhizzard @lvschouwen It's been a long time, please take a look. Thanks

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 14 days, so for now it is being closed. Please feel free to contact the Fil+ Gov team to re-open the application if it is still being processed. Thank you!

aggregation-and-compliance-bot[bot] commented 9 months ago
Client f01934115 does not follow the datacap usage rules. More info here. This application has been failing the requirements for 7 days. Please take appropiate action to fix the following DataCap usage problems. Criteria Treshold Reason
Percent of used DataCap stored with top provider < 75 The percent of Data from the client that is stored with their top provider is 100%. This should be less than 75%