filecoin-project / filecoin-plus-large-datasets

Hub for client applications for DataCap at a large scale
109 stars 62 forks source link

[DataCap Application] VshareCloud #2333

Open egoleecode opened 6 months ago

egoleecode commented 6 months ago

Data Owner Name

VshareCloud

What is your role related to the dataset

Data Preparer

Data Owner Country/Region

Hong Kong

Data Owner Industry

IT & Technology Services

Website

https://vshare.cloud

Social Media

https://t.me/vsharebetter (Telegram)

Total amount of DataCap being requested

2 PiB

Expected size of single dataset (one copy)

300 GiB

Number of replicas to store

3

Weekly allocation of DataCap requested

5 TiB

On-chain address for first allocation

f1xhu34dnkrzxeictv4vq6aoqorxiuczyuoawokai

Data Type of Application

Public, Open Commercial/Enterprise

Custom multisig

Identifier

n/a

Share a brief history of your project and organization

VshareCloud is an innovative open-source distributed storage and computing platform, designed to offer an efficient, scalable, and cost-effective solution for the big data and cloud computing sectors. Leveraging advanced IPFS distributed technology, VshareCloud can seamlessly operate across a variety of hardware and network environments, supporting a wide range of application scenarios from small businesses to large data centers. Through in-depth research on IPFS and unique data management and processing mechanisms, VshareCloud optimizes data storage, access, and computation processes, thereby enhancing system performance, reducing latency, and ensuring data security and integrity.We are also committed to developing more Filecoin/IPFS applications to help Filecoin/IPFS technology better integrate into people's lives.

Is this project associated with other projects/ecosystem stakeholders?

Yes

If answered yes, what are the other projects/ecosystem stakeholders

https://fil.org/ecosystem-projects/vsharecloud/

Describe the data being stored onto Filecoin

As a member of the Filecoin ecosystem, as stated in (https://gateway.ipns.tech/ipns/docs.vshare.cloud/whitepaper/WhitePaper_en/TechnicalArchitecture#data-region-division-and-order-matching-rules), we will use Filecoin as a data backup region, encrypting customer data and storing it in the Filecoin network. Moreover, as we advance the ecosystem with AI and distributed computing, we will generate many large data sets. It is impractical to store all these data solely with our resources. We hope to empower the Filecoin network while also increasing the availability of network storage capacity.

Where was the data currently stored in this dataset sourced from

My own storage infra

If you answered "Other" in the previous question, enter the details here

n/a

If you are a data preparer, what is your location (City and Country)

Hong Kong

If you are a data preparer, how will the data be prepared? Please include tooling used and technical details?

For private content (such as customer data), we will use a method similar to the one found at https://github.com/VshareCloud-Project/Filecoin-Storage-Tool/ , where we encrypt and package the data using openssl and zstd before splitting it into volumes. For open data sets, we will directly package and split them into volumes (although most compression algorithms have a general effect on AI model weights and data sets). After the data set is split, we will use Boost for CommP calculations, converting it into .car files. After initiating an offline deal, we will use our IPFS-based distribution network for transmission, and the data will be delivered to the Storage Provider (SP) to download from the IPFS network and import into the nodes Boostd, further importing the data into sectors and completing the deal.

If you are not preparing the data, who will prepare the data? (Provide name and business)

n/a

Has this dataset been stored on the Filecoin network before? If so, please explain and make the case why you would like to store this dataset again to the network. Provide details on preparation and/or SP distribution.

n/a

Please share a sample of the data

https://gateway.ipns.tech/ipfs/QmfC5KT8UP9Avc8MHxVoT9j7CFTZDZ4AqctY2ouNhztke6 https://gateway.ipns.tech/ipfs/QmZ51Vb9aCgUZPXva71be9hD8FuWnd8Ks4qg7AmGtdFPEK https://gateway.ipns.tech/ipfs/QmeMa2yRpaxZzX8qZ7knqgsY22wz7o7MSkEaRA5PcJ2F13

Confirm that this is a public dataset that can be retrieved by anyone on the Network

Yes

If you chose not to confirm, what was the reason

n/a

What is the expected retrieval frequency for this data

Monthly

For how long do you plan to keep this dataset stored on Filecoin

More than 3 years

In which geographies do you plan on making storage deals

Asia other than Greater China, North America, Europe

How will you be distributing your data to storage providers

IPFS

How do you plan to choose SP

Slack

If you answered "Others" in the previous question, what is the tool or platform you plan to use

n/a

If you already have a list of storage providers to work with, fill out their names and provider IDs below

n/a

How do you plan to make deals to your storage providers

Boost client

If you answered "Others/custom tool" in the previous question, enter the details here

n/a

Can you confirm that you will follow the Fil+ guideline

Yes

Application created via filplus.storage

data-programs commented 5 months ago
KYC

This user’s identity has been verified through filplus.storage