search

Destore2023 / MetaPathways-Bookkeeping

For Filecoin Allocator
0 stars 0 forks source link

[DataCap Application] <Hunan Tumode Technology> - <04-2025-Guangxi> #78

Open caebala opened 1 month ago

caebala commented 1 month ago

Version

1

DataCap Applicant

Hunan Tumode Technology

Project ID

2

Data Owner Name

Hunan Tumode Technology

Data Owner Country/Region

China

Data Owner Industry

Information, Media & Telecommunications

Website

https://space.bilibili.com/3546816977045647

Social Media Handle

https://space.bilibili.com/3546816977045647

Social Media Type

Other

What is your role related to the dataset

Dataset Owner

Total amount of DataCap being requested

10PiB

Expected size of single dataset (one copy)

1PiB

Number of replicas to store

10

Weekly allocation of DataCap requested

3PiB

On-chain address for first allocation

f1omefxqlrcbf6wvobuh3dmenfwyqevaeajsjagnq

Data Type of Application

Public, Open Dataset (Research/Non-Profit)

Custom multisig

Identifier

No response

Share a brief history of your project and organization

After completing our trip around Hainan Island, we planned a one month tourism and office trip to Guangxi Zhuang Autonomous Region, passing through Guilin, Yangshuo, Hechi, Liuzhou, Nanning, Chongzuo, Fangchenggang, and Beihai, and finally returning to Changsha, Hunan

Is this project associated with other projects/ecosystem stakeholders?

No

If answered yes, what are the other projects/ecosystem stakeholders

Describe the data being stored onto Filecoin

Some short video clips of traveling work, including videos, photos, etc.

Where was the data currently stored in this dataset sourced from

My Own Storage Infra

If you answered "Other" in the previous question, enter the details here

If you are a data preparer. What is your location (Country/Region)

China

If you are a data preparer, how will the data be prepared? Please include tooling used and technical details?

All tools inside singularity
Here are some commands.

singularity prep create test /mnt/10.0.8.31/disk1/0/202408/cars/test/ /mnt/md0/test/
singularity prep create disk6 /mnt/10.0.8.31/disk6 /mnt/mergerfs

singularity prep list
singularity prep status MyData

singularity repl start  disk1  -csv /tmp -s 10 -d 528 minerID wallet
singularity repl start disk1 -csv /tmp  minerID wallet

singularity  repl list -v
singularity  repl status -v +id

If you are not preparing the data, who will prepare the data? (Provide name and business)

myself

Has this dataset been stored on the Filecoin network before? If so, please explain and make the case why you would like to store this dataset again to the network. Provide details on preparation and/or SP distribution.

no

Please share a sample of the data

https://space.bilibili.com/3546816977045647

Confirm that this is a public dataset that can be retrieved by anyone on the Network

If you chose not to confirm, what was the reason

What is the expected retrieval frequency for this data

Monthly

For how long do you plan to keep this dataset stored on Filecoin

More than 3 years

In which geographies do you plan on making storage deals

Greater China, Asia other than Greater China, North America, South America, Europe

How will you be distributing your data to storage providers

HTTP or FTP server, Shipping hard drives

How did you find your storage providers

Partners, Slack

If you answered "Others" in the previous question, what is the tool or platform you used

Please list the provider IDs and location of the storage providers you will be working with.

f02822088 Thailand
f03377777 Thailand
f03377773 Vietnam
f03377778 Vietnam
f03277453 Malaysia
f03499999 HK
f03500000 HK
f03520147 Jilin
f03499888 Guangdong
f03373733 Guangdong
f03373337 Guangdong
f03373373 Guangdong

How do you plan to make deals to your storage providers

Boost client, Singularity

If you answered "Others/custom tool" in the previous question, enter the details here

Can you confirm that you will follow the Fil+ guideline

Yes

datacap-bot[bot] commented 1 month ago

Application is waiting for allocator review

datacap-bot[bot] commented 1 month ago

Similarity Report

This application is similar to the following applications:

Destore2023/MetaPathways-Bookkeeping

hash889900/HashTeam

Destore2023 commented 1 month ago

@caebala Hello, can you please explain about the content from bot? Why is your application similar to another application?

caebala commented 1 month ago

Noticed 2 things about the bot prompt

Similar stored data description Similar data set sample

Our last dataset was generated from a trip to Hainan in 2024, this one is from a trip to Guangxi in April 2025, they both have similar data types, but the data content is completely different

The dataset samples are all references to our social media space, which you can see is always updated with our short videos!

Destore2023 commented 1 month ago

@caebala Can you provide any evidence to prove the difference between the data of this application and data of another application? We are working on help storing more unique data in filecoin network and we should prevent any duplicate dataset.

caebala commented 1 month ago

Previous dataset was taken in '24 and collected ready in January of this year, and as you can see the filename also contains the time

Image

This time the data was taken in March-April and collected and prepared during this month, and the file name also contains the time

Image

Please share a sample of the data https://space.bilibili.com/3546816977045647

This is our social media personal space, here you can see the videos we've posted, and below that it also contains when and where they were posted!

Image

Destore2023 commented 1 month ago

@caebala ok. You should separate your dataset when you begin your storage plan to avoid storing duplicate data. Please fill in this form. https://www.wenjuan.com/s/qAVFfuN/

caebala commented 1 month ago

@caebala ok. You should separate your dataset when you begin your storage plan to avoid storing duplicate data. Please fill in this form. https://www.wenjuan.com/s/qAVFfuN/

Image

Completed

Destore2023 commented 1 month ago

@caebala Got it. Image

Destore2023 commented 1 month ago

Please check the data during storage to avoid duplicate storage. Welcome to use datacap to help you with your storage! Please take the storage process seriously and use datacap in a careful way. We will check cid report from time to time. Please focus on retrieval and replicas.

Are you sure you know how to select sp to ensure good retrieval? @caebala

caebala commented 1 month ago

Are you sure you know how to select sp to ensure good retrieval? @caebala

Sure, but it's understood that the retrieval rate is still being fixed due to IPNI issues, so it's probably not going to be very high

Destore2023 commented 1 month ago

@caebala Do the best you can and if you have any problem about your storage, please tell us as soon. We will approve your application and allocate 2.5PiB as the first round allocation under our rules.

caebala commented 1 month ago

Got it，thanks！

datacap-bot[bot] commented 1 month ago

Datacap Request Trigger

Total DataCap requested

10PiB

Expected weekly DataCap usage rate

3PiB

DataCap Amount - First Tranche

2814749767106560 B

Client address

f1omefxqlrcbf6wvobuh3dmenfwyqevaeajsjagnq

datacap-bot[bot] commented 1 month ago

DataCap Allocation requested

Multisig Notary address

Client address

f1omefxqlrcbf6wvobuh3dmenfwyqevaeajsjagnq

DataCap allocation requested

2.50 PiB

Id

a19dda81-5e34-4337-933f-c9d20a68971a

datacap-bot[bot] commented 1 month ago

Application is ready to sign

datacap-bot[bot] commented 1 month ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacecfbr4s3hswnhjr4mm7bluisy3lwf5qj4fvqr24fubwuzzwfn7ssu

Address

f1omefxqlrcbf6wvobuh3dmenfwyqevaeajsjagnq

Datacap Allocated

2.50 PiB

Signer Address

f1rppfznglfb7uyn3k6sfzeh47yq54ptvia5ixwsq

Id

a19dda81-5e34-4337-933f-c9d20a68971a

You can check the status here https://filfox.info/en/message/bafy2bzacecfbr4s3hswnhjr4mm7bluisy3lwf5qj4fvqr24fubwuzzwfn7ssu

datacap-bot[bot] commented 1 month ago

Application is Granted

datacap-bot[bot] commented 1 month ago

Client used 75% of the allocated DataCap. Consider allocating next tranche.

caebala commented 1 month ago

checker:manualTrigger

datacap-bot[bot] commented 1 month ago

DataCap Client Report Summary [^1]

Client address: f1omefxqlrcbf6wvobuh3dmenfwyqevaeajsjagnq Client ID: f03601497 Report ID: 47698 Generated at: Mon, 26 May 2025 03:04:25 GMT (23 hours ago) [^2]

Report checks

✔️ Storage providers are located in different regions

✔️ Storage provider distribution looks healthy

✔️ Storage provider duplication looks healthy

✔️ Storage provider locations looks healthy

⚠️55.56% of storage providers have retrieval success rate equal to zero

⚠️100.00% of storage providers have retrieval success rate less than 75%

✔️ Low replica percentage is 8.54%

✔️ No CID sharing has been observed

✔️ Storage providers IPNI reporting looks healthy (1/2)

✔️ Storage providers IPNI reporting looks healthy (2/2)

✔️ Client receiving datacap from one allocator

✔️ 11.88% of deals have less than allocator-defined 5+ replicas

Full report

Click here to view the full report [^1]: To manually trigger this report, add a comment with text checker:manualTrigger [^2]: New report will be generated only if the latest one is older than 30 hours

caebala commented 1 month ago

@Destore2023 hi Can we start the next round of approvals?

Destore2023 commented 1 month ago

@caebala Can you explain about your retrieval? Some sps' retrieval is 0.

caebala commented 1 month ago

I understand that the ipni issue in recent months has resulted in 0 retrievals until now and is still being fixed, probably due to the fact that all these SP miners were created at the time of the ipni outage and the data hasn't been synced up in time so the current retrievals are 0 or not up to standard

But I got SP to provide the web interface for boostd that they each provide, and it shows a record of successful retrieval

Image

Image

Destore2023 commented 1 month ago

@caebala Thank you for your explanation. Please keep focusing on your storing progress.

Destore2023 commented 1 month ago

@caebala Consider about some new sps' retrieval, we plan to allocate 800TiB first. Hope to see some improve from them.

datacap-bot[bot] commented 1 month ago

Application is in Refill

datacap-bot[bot] commented 1 month ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacedzkooxb3m6rv4hscwxb4rsvardtrc2cfk4sw5mkp373p7uyly3la

Address

f1omefxqlrcbf6wvobuh3dmenfwyqevaeajsjagnq

Datacap Allocated

800 TiB

Signer Address

f1rppfznglfb7uyn3k6sfzeh47yq54ptvia5ixwsq

Id

cd87569a-dee6-4373-a134-d03c1751d115

You can check the status here https://filfox.info/en/message/bafy2bzacedzkooxb3m6rv4hscwxb4rsvardtrc2cfk4sw5mkp373p7uyly3la

datacap-bot[bot] commented 1 month ago

Application is Granted

caebala commented 1 month ago

thanks

caebala commented 1 month ago

checker:manualTrigger

datacap-bot[bot] commented 1 month ago

DataCap Client Report Summary [^1]

Client address: f1omefxqlrcbf6wvobuh3dmenfwyqevaeajsjagnq Client ID: f03601497 Report ID: 47951 Generated at: Tue, 27 May 2025 03:00:26 GMT (22 hours ago) [^2]

Report checks

✔️ Storage providers are located in different regions

✔️ Storage provider distribution looks healthy

✔️ Storage provider duplication looks healthy

✔️ Storage provider locations looks healthy

⚠️55.56% of storage providers have retrieval success rate equal to zero

⚠️100.00% of storage providers have retrieval success rate less than 75%

✔️ Low replica percentage is 5.21%

✔️ No CID sharing has been observed

✔️ Storage providers IPNI reporting looks healthy (1/2)

✔️ Storage providers IPNI reporting looks healthy (2/2)

✔️ Client receiving datacap from one allocator

✔️ 9.54% of deals have less than allocator-defined 5+ replicas

Full report

Click here to view the full report [^1]: To manually trigger this report, add a comment with text checker:manualTrigger [^2]: New report will be generated only if the latest one is older than 30 hours

caebala commented 1 month ago

checker:manualTrigger

datacap-bot[bot] commented 1 month ago

DataCap Client Report Summary [^1]

Client address: f1omefxqlrcbf6wvobuh3dmenfwyqevaeajsjagnq Client ID: f03601497 Report ID: 48466 Generated at: Wed, 28 May 2025 03:04:24 GMT (22 hours ago) [^2]

Report checks

✔️ Storage providers are located in different regions

✔️ Storage provider distribution looks healthy

✔️ Storage provider duplication looks healthy

✔️ Storage provider locations looks healthy

⚠️55.56% of storage providers have retrieval success rate equal to zero

⚠️100.00% of storage providers have retrieval success rate less than 75%

✔️ Low replica percentage is 4.02%

✔️ No CID sharing has been observed

✔️ Storage providers IPNI reporting looks healthy (1/2)

✔️ Storage providers IPNI reporting looks healthy (2/2)

✔️ Client receiving datacap from one allocator

✔️ 6.92% of deals have less than allocator-defined 5+ replicas

Full report

Click here to view the full report [^1]: To manually trigger this report, add a comment with text checker:manualTrigger [^2]: New report will be generated only if the latest one is older than 30 hours

caebala commented 1 month ago

checker:manualTrigger

datacap-bot[bot] commented 1 month ago

DataCap Client Report Summary [^1]

Client address: f1omefxqlrcbf6wvobuh3dmenfwyqevaeajsjagnq Client ID: f03601497 Report ID: 48719 Generated at: Thu, 29 May 2025 03:00:20 GMT (22 hours ago) [^2]

Report checks

✔️ Storage providers are located in different regions

✔️ Storage provider distribution looks healthy

✔️ Storage provider duplication looks healthy

✔️ Storage provider locations looks healthy

⚠️55.56% of storage providers have retrieval success rate equal to zero

⚠️100.00% of storage providers have retrieval success rate less than 75%

✔️ Low replica percentage is 5.11%

✔️ No CID sharing has been observed

✔️ Storage providers IPNI reporting looks healthy (1/2)

✔️ Storage providers IPNI reporting looks healthy (2/2)

✔️ Client receiving datacap from one allocator

✔️ 9.78% of deals have less than allocator-defined 5+ replicas

Full report

Click here to view the full report [^1]: To manually trigger this report, add a comment with text checker:manualTrigger [^2]: New report will be generated only if the latest one is older than 30 hours

datacap-bot[bot] commented 1 month ago

Client used 75% of the allocated DataCap. Consider allocating next tranche.

Destore2023 commented 1 month ago

checker:manualTrigger

datacap-bot[bot] commented 1 month ago

DataCap Client Report Summary [^1]

Client address: f1omefxqlrcbf6wvobuh3dmenfwyqevaeajsjagnq Client ID: f03601497 Report ID: 51411 Generated at: Thu, 05 Jun 2025 03:00:34 GMT (3 hours ago) [^2]

Report checks

✔️ Storage providers are located in different regions

✔️ Storage provider distribution looks healthy

✔️ Storage provider duplication looks healthy

✔️ Storage provider locations looks healthy

⚠️8 storage providers have retrieval success rate equal to zero

⚠️9 storage providers have retrieval success rate less than 75%

✔️ Low replica percentage is 4.27%

✔️ No CID sharing has been observed

✔️ Storage providers IPNI reporting looks healthy (1/2)

✔️ Storage providers IPNI reporting looks healthy (2/2)

✔️ Client receiving datacap from one allocator

✔️ 12.90% of data have less than allocator-defined 5+ replicas

⚠️3 storage providers are declared in application file but not actually used

✔️ All actual storage providers are declared in application file

Full report

Click here to view the full report [^1]: To manually trigger this report, add a comment with text checker:manualTrigger [^2]: New report will be generated only if the latest one is older than 30 hours

Destore2023 commented 4 weeks ago

@caebala I'll help you talk to the gov team about this problem.

caebala commented 4 weeks ago

Contacts are being made with sp to provide

caebala commented 4 weeks ago

checker:manualTrigger

datacap-bot[bot] commented 4 weeks ago

DataCap Client Report Summary [^1]

Client address: f1omefxqlrcbf6wvobuh3dmenfwyqevaeajsjagnq Client ID: f03601497 Report ID: 53869 Generated at: Wed, 11 Jun 2025 03:04:58 GMT (57 minutes ago) [^2]

Report checks

✔️ Storage providers are located in different regions

✔️ Storage provider distribution looks healthy

✔️ Storage provider duplication looks healthy

✔️ Storage provider locations looks healthy

⚠️5 storage providers have retrieval success rate equal to zero

⚠️9 storage providers have retrieval success rate less than 75%

✔️ Low replica percentage is 4.27%

✔️ No CID sharing has been observed

✔️ Storage providers IPNI reporting looks healthy (1/2)

✔️ Storage providers IPNI reporting looks healthy (2/2)

✔️ Client receiving datacap from one allocator

✔️ 12.90% of data have less than allocator-defined 5+ replicas

⚠️3 storage providers are declared in application file but not actually used

✔️ All actual storage providers are declared in application file

Full report

Click here to view the full report [^1]: To manually trigger this report, add a comment with text checker:manualTrigger [^2]: New report will be generated only if the latest one is older than 30 hours