DataCap Application - Filedrive

stph51 commented 3 days ago

Version

1

DataCap Applicant

FileDrive Labs

Project ID

001

Data Owner Name

FileDrive Labs

Data Owner Country/Region

China

Data Owner Industry

Life Science / Healthcare

Website

https://filedrive.io

Social Media Handle

@FileDrive

Social Media Type

Slack

What is your role related to the dataset

Data Preparer

Total amount of DataCap being requested

2PiB

Expected size of single dataset (one copy)

500TiB

Number of replicas to store

4

Weekly allocation of DataCap requested

500TiB

On-chain address for first allocation

f3sxnchdtve2hkucqiey4iamw5fuac43svaj5vxhdy7qyrbpqo2gi5vswcfvgzimwslsmjplbgiba4viubxhcq

Data Type of Application

Public, Open Dataset (Research/Non-Profit)

Custom multisig

[X] Use Custom Multisig

Identifier

No response

Share a brief history of your project and organization

FileDrive Labs has always defined ourselves as tool developers and infrastructure builders in the Filecoin ecosystem.    From 2019, we continuously focus on technical solutions and development based on IPFS protocol and the Filecoin network and do our best to contribute to the community.
Over 80% of our team are qualified engineers, and half of them have more than 10-year development experience in multiple industries, including Communication, the Internet, and blockchain.
Since 2020, we have participated in Slingshot Competition, become one of the top teams, and stored over 5 PiB useful data from public datasets to the Filecoin network.
To contribute to the Filecoin Community, we developed an open-source data prep tool Graphsplit, FIL+ project dashboard filplus.info and storage provider discovery platform filfind,info.
Besides, we have also hold weekly online virtual events named FileDrive Meetup from March 2022, which aims to provide a platform for community members to grasp the latest trends of the Filecoin network and our work and research.

Please check the following links for more details.
- GitHub: https://github.com/filedrive-team
- Twitter: https://twitter.com/FileDrive1
- Eventbrite: https://www.eventbrite.hk/o/filedrive-labs-42456337463
- YouTube Channel: https://www.youtube.com/channel/UCxcZC1dtBUlQvZY7DX13W1w
- Medium: https://medium.com/@FileDrive1

Is this project associated with other projects/ecosystem stakeholders?

No

If answered yes, what are the other projects/ecosystem stakeholders

No response

Describe the data being stored onto Filecoin

for example, smithsonian Open Access, the Smithsonian’s mission is the "increase and diffusion of knowledge" and has been collecting since 1846. The Smithsonian, through its efforts to digitize its multidisciplinary collections, has created millions of digital assets and related metadata describing the collection objects. On February 25th, 2020, the Smithsonian released over 2.8 million CC0 interdisciplinary 2-D and 3-D images, related metadata, and additionally, research data from researches across the Smithsonian. The 2.8 million "open access" collections are a subset of the Smithsonian’s 155 million objects, 2.1 million library volumes and 156,000 cubic feet of archival collections held in 19 museums, 9 research centers, libraries, archives and the National Zoo. Digitization of collections is ongoing.
Where was the data currently stored in this dataset sourced from
AWS Cloud

If you answered "Other" in the previous question, enter the details here
No response

If you are a data preparer. What is your location (Country/Region)
China

If you are a data preparer, how will the data be prepared? Please include tooling used and technical details?
Graphsplit
If you are not preparing the data, who will prepare the data? (Provide name and business)
No response

Has this dataset been stored on the Filecoin network before? If so, please explain and make the case why you would like to store this dataset again to the network. Provide details on preparation and/or SP distribution.
No
Please share a sample of the data
https://registry.opendata.aws/smithsonian-open-access/
Confirm that this is a public dataset that can be retrieved by anyone on the Network
 I confirm
If you chose not to confirm, what was the reason
No response

What is the expected retrieval frequency for this data
Yearly

For how long do you plan to keep this dataset stored on Filecoin
1 to 1.5 years

In which geographies do you plan on making storage deals
Greater China, Asia other than Greater China, North America, Australia (continent)

How will you be distributing your data to storage providers
Cloud storage (i.e. S3)

How did you find your storage providers
Slack, Others

If you answered "Others" in the previous question, what is the tool or platform you used
Weixin
Please list the provider IDs and location of the storage providers you will be working with.
Canada, Vancouver: f03188440
Dubai: f03190614
Japan, Tokyo: f03190616
Singapore：f02984331 
Singapore：f02883857
How do you plan to make deals to your storage providers
Droplet client

If you answered "Others/custom tool" in the previous question, enter the details here
No response

Can you confirm that you will follow the Fil+ guideline
Yes

@datacap-botDatacap Bot
Contributor
datacap-bot bot commented 2 weeks ago
Application is waiting for allocator review

@datacap-bot datacap-bot bot added validated waiting for allocator review labels 2 weeks ago
@datacap-bot datacap-bot bot mentioned this issue 2 weeks ago
Datacap for FileDrive Labs #16
 Merged
@ipfsforcezuofu
Owner
ipfsforcezuofu commented 2 weeks ago
@stph51 Since it's your first time applying for DC with us, we can only assign 1 PiB initially to ensure compliance. It will be scheduled as 63t, 125t, 250t, and 562t. If this arrangement works for you, please email jiemezhang@gmail.com with information about your organization and SPs for KYB and KYC. Thank you for your collaboration.

@stph51
Author
stph51 commented 2 weeks ago
@ipfsforcezuofu Thank you for your response. Could you please verify the information I sent to you via email?

@ipfsforcezuofu
Owner
ipfsforcezuofu commented 2 weeks ago
@stph51 The materials for your organization and SPs have been received and successfully verified. The KYB and KYC processes are now complete. I'm going to assign the first batch 63t.

@datacap-botDatacap Bot
Contributor
datacap-bot bot commented 2 weeks ago
Datacap Request Trigger
Total DataCap requested

3PiB

Expected weekly DataCap usage rate

250TiB

DataCap Amount - First Tranche

63TiB

Client address

f3uutkfpsrwph4e47znxeq3pf2yywz7l77hnr7ppoo3k3ohowx72ropumnmc3k7v54x3hq2oaik6pi2n2le5pa

@datacap-botDatacap Bot
Contributor
datacap-bot bot commented 2 weeks ago
DataCap Allocation requested
Multisig Notary address
Client address
f3uutkfpsrwph4e47znxeq3pf2yywz7l77hnr7ppoo3k3ohowx72ropumnmc3k7v54x3hq2oaik6pi2n2le5pa

DataCap allocation requested
63TiB

Id
47fda476-57a5-4182-b3fe-35220200fbc3

@datacap-bot datacap-bot bot added ready to sign and removed validated waiting for allocator review labels 2 weeks ago
@datacap-botDatacap Bot
Contributor
datacap-bot bot commented 2 weeks ago
Application is ready to sign

@datacap-botDatacap Bot
Contributor
datacap-bot bot commented 2 weeks ago
Request Approved
Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network
bafy2bzacecfnaj3kyzznpe4mysdigt2dmotgtqwm4m3fdl4ozghoql7byh72y

Address
f3uutkfpsrwph4e47znxeq3pf2yywz7l77hnr7ppoo3k3ohowx72ropumnmc3k7v54x3hq2oaik6pi2n2le5pa

Datacap Allocated
63TiB

Signer Address
f1x4nh2yvv2o2wwr4f7l7ocuenz7trdv7z5oqlgni

Id
47fda476-57a5-4182-b3fe-35220200fbc3

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecfnaj3kyzznpe4mysdigt2dmotgtqwm4m3fdl4ozghoql7byh72y
@datacap-botDatacap Bot
Contributor
datacap-bot bot commented 2 weeks ago
Application is Granted

@datacap-bot datacap-bot bot added granted and removed ready to sign labels 2 weeks ago
@datacap-botDatacap Bot
Contributor
datacap-bot bot commented last week
Client used 75% of the allocated DataCap. Consider allocating next tranche.

@datacap-bot datacap-bot bot added Refill needed and removed granted labels last week
@ipfsforcezuofu
Owner
ipfsforcezuofu commented last week
checker:manualTrigger

@datacap-botDatacap Bot
Contributor
datacap-bot bot commented last week
DataCap and CID Checker Report1
No active deals found for this client.

Footnotes
To manually trigger this report, add a comment with text checker:manualTrigger ↩

@ipfsforcezuofu
Owner
ipfsforcezuofu commented last week
@stph51 Could you explain why there are no active deals for this client?

@stph51
Author
stph51 commented last week
@ipfsforcezuofu We're using Droplet DDO to place orders, but as I understand it, SPARK does not yet support their retrieval.

@datacap-botDatacap Bot
Contributor
datacap-bot bot commented last week
Application is in Refill

@datacap-bot datacap-bot bot added Refill and removed Refill needed labels last week
@datacap-bot datacap-bot bot mentioned this issue last week
Datacap for FileDrive Labs #18
 Merged
@datacap-botDatacap Bot
Contributor
datacap-bot bot commented last week
Request Approved
Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network
bafy2bzaceahbgs5o6aflx2bwqh45ut7m4bpny5uqvo3tlgn3samcqt3x4ga4m

Address
f3uutkfpsrwph4e47znxeq3pf2yywz7l77hnr7ppoo3k3ohowx72ropumnmc3k7v54x3hq2oaik6pi2n2le5pa

Datacap Allocated
125TiB

Signer Address
f1x4nh2yvv2o2wwr4f7l7ocuenz7trdv7z5oqlgni

Id
8bfc4baa-2fb5-4d6c-8c6a-37aee355bed5

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceahbgs5o6aflx2bwqh45ut7m4bpny5uqvo3tlgn3samcqt3x4ga4m
@datacap-bot datacap-bot bot removed the Refill label last week
10 hidden items
Load more…
@datacap-bot datacap-bot bot added Refill and removed Refill needed labels last week
@datacap-bot datacap-bot bot mentioned this issue last week
Datacap for FileDrive Labs #19
 Merged
@datacap-botDatacap Bot
Contributor
datacap-bot bot commented last week
Request Approved
Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network
bafy2bzaced5qqfebq7t425gwgqk37iik7zz33o3gfj7iwb4ewmerllxnncwce

Address
f3uutkfpsrwph4e47znxeq3pf2yywz7l77hnr7ppoo3k3ohowx72ropumnmc3k7v54x3hq2oaik6pi2n2le5pa

Datacap Allocated
250TiB

Signer Address
f1x4nh2yvv2o2wwr4f7l7ocuenz7trdv7z5oqlgni

Id
a39c7754-d786-4684-908c-f081e997d316

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaced5qqfebq7t425gwgqk37iik7zz33o3gfj7iwb4ewmerllxnncwce
@datacap-botDatacap Bot
Contributor
datacap-bot bot commented last week
Application is Granted

@datacap-bot datacap-bot bot added granted and removed Refill labels last week
@ipfsforcezuofu
Owner
ipfsforcezuofu commented 5 days ago
checker:manualTrigger

@datacap-botDatacap Bot
Contributor
datacap-bot bot commented 5 days ago
DataCap and CID Checker Report Summary1
Storage Provider Distribution
✔️ Storage provider distribution looks healthy.

⚠️ 50.00% of Storage Providers have retrieval success rate less than 75%.

Deal Data Replication
✔️ Data replication looks healthy.

Deal Data Shared with other Clients2
✔️ No CID sharing has been observed.

Full report
Click here to view the CID Checker report.

Footnotes
To manually trigger this report, add a comment with text checker:manualTrigger ↩

To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ... ↩

@ipfsforcezuofu
Owner
ipfsforcezuofu commented 5 days ago
@stph51 Could you explain the low retrieval rate for SP f02883857?

@stph51
Author
stph51 commented 5 days ago
@ipfsforcezuofu This SP is using Boost Non-DDO to place orders. I noticed this issue this morning as well and got response from SP an error message of Boost. They are working on analyzing the issue. Please continue assigning DC today to meet the demand for this weekend. Thank you.
图片

@datacap-botDatacap Bot
Contributor
datacap-bot bot commented 5 days ago
Client used 75% of the allocated DataCap. Consider allocating next tranche.

@datacap-bot datacap-bot bot added Refill needed and removed granted labels 5 days ago
@datacap-botDatacap Bot
Contributor
datacap-bot bot commented 5 days ago
Application is in Refill

@datacap-bot datacap-bot bot added Refill and removed Refill needed labels 5 days ago
@datacap-bot datacap-bot bot mentioned this issue 5 days ago
Datacap for FileDrive Labs #20
 Merged
@datacap-botDatacap Bot
Contributor
datacap-bot bot commented 5 days ago
Request Approved
Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network
bafy2bzacecddfhgco4vhgezxgaweech7v6zghg3mrcewitnzoedulfm3serkg

Address
f3uutkfpsrwph4e47znxeq3pf2yywz7l77hnr7ppoo3k3ohowx72ropumnmc3k7v54x3hq2oaik6pi2n2le5pa

Datacap Allocated
562TiB

Signer Address
f1x4nh2yvv2o2wwr4f7l7ocuenz7trdv7z5oqlgni

Id
f7fea3f0-eca4-484e-a852-8f75bff7592e

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacecddfhgco4vhgezxgaweech7v6zghg3mrcewitnzoedulfm3serkg
@datacap-botDatacap Bot
Contributor
datacap-bot bot commented 5 days ago
Application is Granted

@datacap-bot datacap-bot bot added granted and removed Refill labels 5 days ago
@ipfsforcezuofu
Owner
ipfsforcezuofu commented 5 days ago
checker:manualTrigger

@datacap-botDatacap Bot
Contributor
datacap-bot bot commented 5 days ago
DataCap and CID Checker Report Summary1
Storage Provider Distribution
✔️ Storage provider distribution looks healthy.

⚠️ 50.00% of Storage Providers have retrieval success rate less than 75%.

Deal Data Replication
✔️ Data replication looks healthy.

Deal Data Shared with other Clients2
✔️ No CID sharing has been observed.

Full report
Click here to view the CID Checker report.

Footnotes
To manually trigger this report, add a comment with text checker:manualTrigger ↩

To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ... ↩

@datacap-botDatacap Bot
Contributor
datacap-bot bot commented 3 days ago
Client used 75% of the allocated DataCap. Consider allocating next tranche.

@datacap-bot datacap-bot bot added Refill needed and removed granted labels 3 days ago
@filecoin-watchdog filecoin-watchdog mentioned this issue 19 hours ago
Community Review of IPFS Force Allocator filecoin-project/Allocator-Governance#168
Open
@ipfsforcezuofu
Owner
ipfsforcezuofu commented 1 hour ago
@stph51

You claim that one copy is 250 TiB with 4 replicas, yet you requested 3 PiB. Could you explain the 2 PiB discrepancy?

@stph51
Author
stph51 commented 1 hour ago
@ipfsforcezuofu

To be honest, our actual storage demand is 3 PiB. However, after reviewing your first client, we learned that the maximum DC you might assign is 1 PiB. Therefore, we lowered our target in the first batch, hoping to apply for the remaining 2 PiB at a later time.

@ops-github-ky

Add a comment
Comment

Add your comment here...

Remember, contributions to this repository should follow our GitHub Community Guidelines.
Assignees
No one assigned
Labels
Refill needed
Projects
None yet
Milestone
No milestone
Development
No branches or pull requests

Notifications
Customize
You’re not receiving notifications from this thread.
2 participants
@ipfsforcezuofu

Where was the data currently stored in this dataset sourced from

AWS Cloud

If you answered "Other" in the previous question, enter the details here

No response

If you are a data preparer. What is your location (Country/Region)

China

If you are a data preparer, how will the data be prepared? Please include tooling used and technical details?

Graphsplit

If you are not preparing the data, who will prepare the data? (Provide name and business)

No response

Has this dataset been stored on the Filecoin network before? If so, please explain and make the case why you would like to store this dataset again to the network. Provide details on preparation and/or SP distribution.

No

Please share a sample of the data

https://registry.opendata.aws/smithsonian-open-access/

Confirm that this is a public dataset that can be retrieved by anyone on the Network

[X] I confirm

If you chose not to confirm, what was the reason

No response

What is the expected retrieval frequency for this data

Yearly

For how long do you plan to keep this dataset stored on Filecoin

1 to 1.5 years

In which geographies do you plan on making storage deals

Greater China, Asia other than Greater China, North America, Australia (continent)

How will you be distributing your data to storage providers

Cloud storage (i.e. S3)

How did you find your storage providers

Slack, Others

If you answered "Others" in the previous question, what is the tool or platform you used

Weixin

Please list the provider IDs and location of the storage providers you will be working with.

f02984331       Singapore
f02883857       Singapore
Other SPs will be provided later.

How do you plan to make deals to your storage providers

Droplet client

If you answered "Others/custom tool" in the previous question, enter the details here

No response

Can you confirm that you will follow the Fil+ guideline

Yes

datacap-bot[bot] commented 3 days ago

Application is waiting for allocator review

NDLABS-Leo commented 2 days ago

Hello, @stph51 Thank you for your application ~

I am aware that Filedrive is an ecosystem builder, but since you are using a personal GitHub account, I hope you can provide some compelling evidence to prove that you are representing the Filedrive entity.

Additionally, considering that the data being applied for is public and has been stored on the Filecoin network before, what is the reason for applying again in this case?

Regarding the data, how are you currently handling it?

Can the project start immediately?

Do you have plans for collaboration with storage providers (SPs)?

Apologies for the number of questions, I hope you don’t mind.

stph51 commented 2 days ago

@NDLABS-Leo

Thank you for your quick response. The data we're applying for the DC hasn't been stored on Filecoin before. We're using Droplet DDO to place the orders. We have two SPs on board already, and two more will be available soon. We can start the process immediately once the DC is ready. Could you share an email address with me so I can send you more information about the enterprise, SP, and my representation?

NDLABS-Leo commented 2 days ago

@stph51 Sure, I would like to get to know the four SPs we will be working with before the project starts. This will allow me to review their credibility in advance.

Additionally, xiazhe@ndlabs.io is my email address.

stph51 commented 2 days ago

@NDLABS-Leo I've sent the application materials to you via email. Could you please verify? Thanks!

NDLABS-Leo commented 2 days ago

@stph51

Thank you for your cooperation. I have received the email and appreciate that you thoughtfully included the SP address proof documents. To adhere to the community's disclosure principles, we will display non-sensitive information in the form of images.

This is a note to the community: Regarding the business license section, due to privacy concerns, it will not be disclosed. If anyone needs to review it, please contact me privately.

stph51 commented 1 day ago

@NDLABS-Leo Could you please add the following two SPs? Thank you! f03196401 Osaka, Japan f03196399 Kuala Lumpur, Malaysia

NDLABS-Leo commented 1 day ago

@stph51 I have received the list of SPs you plan to collaborate with. Please disclose any changes in a timely manner. f03196401 Osaka, Japan f03196399 Kuala Lumpur, Malaysia f02984331 Singapore f02883857 Singapore

NDLABS-Leo commented 1 day ago

f03196401 Osaka, Japan -- New node. f03196399 Kuala Lumpur, Malaysia -- New node. f02984331 Singapore -- 203.55.176.10 f02883857 Singapore -- 15.235.187.119

Node address verification is normal.

datacap-bot[bot] commented 1 day ago

Datacap Request Trigger

Total DataCap requested

2PiB

Expected weekly DataCap usage rate

500TiB

DataCap Amount - First Tranche

250TiB

Client address

f3sxnchdtve2hkucqiey4iamw5fuac43svaj5vxhdy7qyrbpqo2gi5vswcfvgzimwslsmjplbgiba4viubxhcq

datacap-bot[bot] commented 1 day ago

DataCap Allocation requested

Multisig Notary address

Client address

f3sxnchdtve2hkucqiey4iamw5fuac43svaj5vxhdy7qyrbpqo2gi5vswcfvgzimwslsmjplbgiba4viubxhcq

DataCap allocation requested

250TiB

Id

1ea5eaa8-d68a-4bde-81fa-6d10960e2d21

datacap-bot[bot] commented 1 day ago

Application is ready to sign

datacap-bot[bot] commented 1 day ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceb3j52vrclwerd3xy6bkjeqchbwsq44ye2py5jbmvpsbx7ch6yyko

Address

f3sxnchdtve2hkucqiey4iamw5fuac43svaj5vxhdy7qyrbpqo2gi5vswcfvgzimwslsmjplbgiba4viubxhcq

Datacap Allocated

250TiB

Signer Address

f1yayfsv6whu3rheviucvventj3y6t542xfpb47ei

Id

1ea5eaa8-d68a-4bde-81fa-6d10960e2d21

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceb3j52vrclwerd3xy6bkjeqchbwsq44ye2py5jbmvpsbx7ch6yyko

datacap-bot[bot] commented 1 day ago

Application is Granted

NDLABS-Leo / Allocator-Pathway-ND-CLOUD