search

filecoin-project / filecoin-plus-large-datasets

Hub for client applications for DataCap at a large scale
110 stars 62 forks source link

[DataCap Application] <XCstorage> - <V8-Smart Video> #2088

Open xcstoage opened 1 year ago

xcstoage commented 1 year ago

Data Owner Name

xcstorage

What is your role related to the dataset

Dataset Owner

Data Owner Country/Region

China

Data Owner Industry

Information, Media & Telecommunications

Website

https://xcstorage.eth.limo/

Social Media

https://github.com/xcstoage?tab=repositories

Total amount of DataCap being requested

10PiB

Expected size of single dataset (one copy)

2

Number of replicas to store

5

Weekly allocation of DataCap requested

400TiB

On-chain address for first allocation

f3swlpybly37bicagery53iby53xrbld6rvcw3znv5slzs4zg6oaceg5jo4fbhrgrxxamcprzbdfpjmzl4hwlq

Data Type of Application

Public, Open Dataset (Research/Non-Profit)

Custom multisig

Identifier

No response

Share a brief history of your project and organization

XCstorage Smart IoT, established in 2014, is a leading smart space IoT platform and technical service provider in China. We provide a one-stop space intelligence solution centered on the space AIoT platform, including the Internet of Things platform, the middle platform of the Internet of Things application, and SaaS for various scenarios of smart space. Committed to connecting people, equipment, space and services through AIoT technology, creating a digital, online and intelligent space, redefining the operation and management of urban and architectural spaces, covering parks, schools, hospitals, stations, exhibition halls, and urban perception Wait for space.

Is this project associated with other projects/ecosystem stakeholders?

No

If answered yes, what are the other projects/ecosystem stakeholders

No response

Describe the data being stored onto Filecoin

V8-Smart Video

Where was the data currently stored in this dataset sourced from

My Own Storage Infra

If you answered "Other" in the previous question, enter the details here

No response

How do you plan to prepare the dataset

IPFS, lotus

If you answered "other/custom tool" in the previous question, enter the details here

No response

Please share a sample of the data

https://drive.google.com/drive/folders/1sYABdwsUcvHMEayNqfTVXKbtUDznsa6V?usp=drive_link

Confirm that this is a public dataset that can be retrieved by anyone on the Network

If you chose not to confirm, what was the reason

No response

What is the expected retrieval frequency for this data

Weekly

For how long do you plan to keep this dataset stored on Filecoin

1.5 to 2 years

In which geographies do you plan on making storage deals

Greater China, Europe, Australia (continent)

How will you be distributing your data to storage providers

HTTP or FTP server, Shipping hard drives

How do you plan to choose storage providers

Slack, Big Data Exchange, Partners

If you answered "Others" in the previous question, what is the tool or platform you plan to use

No response

If you already have a list of storage providers to work with, fill out their names and provider IDs below

No response

How do you plan to make deals to your storage providers

Boost client, Lotus client, Singularity

If you answered "Others/custom tool" in the previous question, enter the details here

No response

Can you confirm that you will follow the Fil+ guideline

Yes

herrehesse commented 1 year ago

The initial request for 10 PiB using a newly created account and without establishing trust within the community is concerning. I highly recommend close the application and reconsider by starting with a smaller amount to build credibility and trust before making larger requests.

Advising notaries not to engage.

xcstoage commented 1 year ago

The initial request for 10 PiB using a newly created account and without establishing trust within the community is concerning. I highly recommend close the application and reconsider by starting with a smaller amount to build credibility and trust before making larger requests.

Advising notaries not to engage.

We are not new accounts, we have had DC before. Why do you just negate others without checking? I think whether I can get the DC quota I applied for should be decided by the official approval staff. We are capable of doing what we state in our application.

herrehesse commented 1 year ago

We are not new accounts, we have had DC before.

Your account is newly created and does not have any previous datacap requests or history within the FI+ ecosystem.

Why do you just negate others without checking?

I have thoroughly checked and verified the information.

I believe that the decision on whether I can obtain the DC quota I applied for should be made by the authorized approval personnel.

There is no specific "official" staff; instead, the Filecoin+ community and notaries act in the best interest of the network.

We are fully capable of delivering what we have stated in our application.

Do not trust but verify. As mentioned earlier, you should start with a smaller request (+/-100TiB) and establish a reputation before attempting larger amounts, such as 10 PiB.

xcstoage commented 1 year ago

We are not new accounts, we have had DC before.

Your account is newly created and does not have any previous datacap requests or history within the FI+ ecosystem.

Why do you just negate others without checking?

I have thoroughly checked and verified the information.

I believe that the decision on whether I can obtain the DC quota I applied for should be made by the authorized approval personnel.

There is no specific "official" staff; instead, the Filecoin+ community and notaries act in the best interest of the network.

We are fully capable of delivering what we have stated in our application.

Do not trust but verify. As mentioned earlier, you should start with a smaller request (+/-100TiB) and establish a reputation before attempting larger amounts, such as 10 PiB.

Your account is newly created and does not have any previous datacap requests or history within the FI+ ecosystem. I have thoroughly checked and verified the information. https://github.com/filecoin-project/filecoin-plus-client-onboarding/issues/2685 Are you still sure you check all the information? what about the link? why don't you share here? If i can't apply for 10P, i will apply for less DC. But it is not decide by you. I don't know what's your purpose to leave negate message to every application.

Sunnyiscoming commented 1 year ago

Could you send an email to filplus-app-review@fil.org with your official domain in order to confirm your identity? Email name should includes the issue id #2088. Best practice for storing large datasets includes ideally, storing it in 3 or more regions, with 4 or more storage provider operators or owners. You should list Miner ID, Business Entity, Location of sps you will cooperate with.

herrehesse commented 1 year ago

@xcstoage Can you in full detail describe and show the results of your 5 TiB demo? Without this no one should ever be granted 10 PiB as there is no trust or reputation yet.

xcstoage commented 1 year ago

Could you send an email to filplus-app-review@fil.org with your official domain in order to confirm your identity? Email name should includes the issue id #2088. Best practice for storing large datasets includes ideally, storing it in 3 or more regions, with 4 or more storage provider operators or owners. You should list Miner ID, Business Entity, Location of sps you will cooperate with.

image Pls check the mail from XCstorage, Thank you very much.

Sunnyiscoming commented 1 year ago
xcstoage commented 1 year ago
  • Have you prepared enough token for sector pledge?
  • Are you a data preparer? What is your previous experience as a data-preparer? List previous applications and client IDs
  • How will the data be prepared? Please include tooling used and technical details
  • If you are not preparing the data, who will prepare the data? (Name and Business)
  • Has this dataset been stored on Filecoin before? If so, why are you choosing to store it again?
herrehesse commented 1 year ago

@xcstoage,

You are welcome to store your data, which holds great value to you, on Filecoin. However, it is important to note that you are not eligible to receive any datacap for this data, as the data should hold value for the broader community of Filecoin.

Storing data such as "The data from our lots of cameras in the building. It comes from residential communities, apartments, industrial manufacturing parks, public infrastructure buildings" does not provide any significant value to the ecosystem as a whole.

I recommend reaching out to local storage providers for storing your data through paid deals. This will ensure that your specific requirements are met. Thank you for understanding.

Request closure of this application @raghavrmadya

raghavrmadya commented 1 year ago

I'm unable to close an application without giving every client a fair chance. Appreciate community members doing DD. If client can garner notary support, they are welcome to proceed.

xcstoage commented 1 year ago

I'm unable to close an application without giving every client a fair chance. Appreciate community members doing DD. If client can garner notary support, they are welcome to proceed.

Thank you,i will find some supports for the application.

herrehesse commented 1 year ago

@raghavrmadya

So storing CCTV footage is a valuable way of spending datacap to entities?

herrehesse commented 1 year ago

This will never be utilized genuinely; it's merely a tool for individuals to exponentially expand their mining operations.

Sunnyiscoming commented 1 year ago

image

ghost commented 1 year ago

Hello @xcstoage per the new guidelines https://github.com/filecoin-project/notary-governance/issues/922 for Open Dataset applicants, please complete the following Fil+ registration form to identify yourself as the applicant and also please add the contact information of the SP entities you are working with to store copies of the data.

This information will be reviewed by Fil+ Governance team to confirm validity and then the application will be triggered for notary review. Let us know if you have any questions.

xcstoage commented 1 year ago

Hello @xcstoage per the new guidelines filecoin-project/notary-governance#922 for Open Dataset applicants, please complete the following Fil+ registration form to identify yourself as the applicant and also please add the contact information of the SP entities you are working with to store copies of the data.

This information will be reviewed by Fil+ Governance team to confirm validity and then the application will be triggered for notary review. Let us know if you have any questions.

Done

ghost commented 1 year ago

@xcstorage thank you for submitting the registration, it was reviewed. You did not provide any SP contact information. Please confirm SP entities you are working with. We will need proof of location of these SPs you mention.

you can send to: filplus-app-review@fil.org cc @Sunnyiscoming

Sunnyiscoming commented 1 year ago

Please use #2088 as the title of your email.

xcstoage commented 1 year ago

Please use #2088 as the title of your email.

Please use #2088 as the title of your email.

Please check the e-mail. Thanks!

xcstoage commented 1 year ago

@Sunnyiscoming Can we go for the next step?

ghost commented 1 year ago

Confirming that @xcstoage has submitted the following list of SP entities:

ID / Entity / Location f0861588 SDcloud China (confirmed location via email) f0861589 SDcloud China (confirmed location via email) f02229707 NJ xianggang f01912253 NJ xianggang f01832584 ND Labs US,AU

please note: No contact information for NJ or ND Labs Entities - locations not confirmed by our team. Notaries feel free to follow up here as needed.

Also a note to the client @xcstoage - guidelines state that no more than one copy per SP ID and no entity should store more than 30% of DataCap. Please keep that in mind. Thank you.

large-datacap-requests[bot] commented 1 year ago

Deleting comment

@Sunnyiscoming hasn't the permissions to post this comment.

Please, contact the assignee of this issue.

Sunnyiscoming commented 1 year ago

Datacap Request Trigger

Total DataCap requested

10PiB

Expected weekly DataCap usage rate

400TiB

Client address

f3swlpybly37bicagery53iby53xrbld6rvcw3znv5slzs4zg6oaceg5jo4fbhrgrxxamcprzbdfpjmzl4hwlq

xcstoage commented 1 year ago

Confirming that @xcstoage has submitted the following list of SP entities:

ID / Entity / Location f0861588 SDcloud China (confirmed location via email) f0861589 SDcloud China (confirmed location via email) f02229707 NJ xianggang f01912253 NJ xianggang f01832584 ND Labs US,AU

please note: No contact information for NJ or ND Labs Entities - locations not confirmed by our team. Notaries feel free to follow up here as needed.

Also a note to the client @xcstoage - guidelines state that no more than one copy per SP ID and no entity should store more than 30% of DataCap. Please keep that in mind. Thank you.

Thanks for that,we will keep the rules.

xcstoage commented 1 year ago

@Sunnyiscoming So sorry about that, we offer wrong weekly allocation of DataCap requested 10Tib, But the real we want to request is 400TiB. May i know if it can be changed? Thanks so much.

ghost commented 1 year ago

@simonkim0515 any ideas here? Can this be fixed or needs to reapply?

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Multisig Notary address

f02049625

Client address

f3swlpybly37bicagery53iby53xrbld6rvcw3znv5slzs4zg6oaceg5jo4fbhrgrxxamcprzbdfpjmzl4hwlq

DataCap allocation requested

200TiB

Id

13ebda73-8f34-4d14-9631-4d9829cffe1c

cryptowhizzard commented 1 year ago

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacedhfanfbjv4t7wugd5zikgbholq23fnhovswa7zzzacpup7qi5ih6

Address

f3swlpybly37bicagery53iby53xrbld6rvcw3znv5slzs4zg6oaceg5jo4fbhrgrxxamcprzbdfpjmzl4hwlq

Datacap Allocated

200.00TiB

Signer Address

f1krmypm4uoxxf3g7okrwtrahlmpcph3y7rbqqgfa

Id

13ebda73-8f34-4d14-9631-4d9829cffe1c

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedhfanfbjv4t7wugd5zikgbholq23fnhovswa7zzzacpup7qi5ih6

cryptowhizzard commented 1 year ago

KYC done per Notary governance #922 Checked sample data Checked SP's Confirmed open dataset / retrieval on SP's.

Willing to support for first allocation to see how this progresses,

@xcstoage looking forward to the results!

xcstoage commented 1 year ago

KYC done per Notary governance #922 Checked sample data Checked SP's Confirmed open dataset / retrieval on SP's.

Willing to support for first allocation to see how this progresses,

@xcstoage looking forward to the results!

Thanks a lot.

ghost commented 1 year ago

Just to re-confirm the process here @xcstoage - after storage is complete we will ask notaries to:

xcstoage commented 1 year ago

Just to re-confirm the process here @xcstoage - after storage is complete we will ask notaries to:

  • Confirm SP IDs and locations match your plan
  • Confirm data is retrievable and data sample matches said datasets

Yes, we will do that.

sxxfuture-official commented 1 year ago 
f0861588 -> {12D3KooWCcayVSy8mATzV9q7djwehXdyJWqVycamxsJGuSVavV8B: [/ip4/18.204.199.12/tcp/3887]}
f0861589 -> {12D3KooWRsW6ASDL5nbBi9z12BStrxCLYtikwxa7WgP2bUHYgTUm: [/ip4/52.207.234.188/tcp/2221]}
f02229707 -> {12D3KooWAcXgv311ULUBpTuJ6AHqafkTutUARmTVvGc6qbvBspT8: [/ip4/103.214.65.32/tcp/9707]}
f01912253 -> {12D3KooWS585bWCEC7jNk1n7m5PoSkzMjuWugwvDteHH3cSQX9si: [/ip4/18.204.199.12/tcp/2105]}
f01832584 -> {12D3KooWQWxBLPBihzjBmGtJNXjtc9WH2TQT5mw9DtPTZgSi2pn9: [/ip4/3.144.214.77/tcp/2108]}
f01777777 -> {12D3KooWHYC3FfKeSQ64iH7eJerUnf3WxxU1mtcYPndN4nEU4pYn: [/ip4/103.136.146.86/tcp/7777]}
f01740934 -> {12D3KooWKR1HiKvVgLRwQZY8BYJzd27hbjRdGkYUiH1c99P48J9u: [/ip4/128.14.72.189/tcp/23456]}

check all provided SPs are reachable. According to the information provided by the client above, and it is the first round, I will support and pay attention to it.

sxxfuture-official commented 1 year ago

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceadu42gwunua4bdryuq2us5vjxocudek5pwydyrnskfyclazaik2a

Address

f3swlpybly37bicagery53iby53xrbld6rvcw3znv5slzs4zg6oaceg5jo4fbhrgrxxamcprzbdfpjmzl4hwlq

Datacap Allocated

200.00TiB

Signer Address

f1foiomqlmoshpuxm6aie4xysffqezkjnokgwcecq

Id

13ebda73-8f34-4d14-9631-4d9829cffe1c

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceadu42gwunua4bdryuq2us5vjxocudek5pwydyrnskfyclazaik2a

kevzak commented 1 year ago

checker:manualTrigger

ghost commented 1 year ago

checker:manualTrigger

github-actions[bot] commented 1 year ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

xcstoage commented 1 year ago

keep going

xcstoage commented 1 year ago

Statement：Before we start the sealing we want to add more sps to this LDN. ID / Entity / Location f01019009 /ZC /US f01912298/ZC/US f0866680/Green Tech/China

large-datacap-requests[bot] commented 1 year ago

DataCap Allocation requested

Request number 2

Multisig Notary address

f02049625

Client address

f3swlpybly37bicagery53iby53xrbld6rvcw3znv5slzs4zg6oaceg5jo4fbhrgrxxamcprzbdfpjmzl4hwlq

DataCap allocation requested

400TiB

Id

740d8de3-6e35-4f8f-a81d-34404d15d5c4

large-datacap-requests[bot] commented 1 year ago

Stats & Info for DataCap Allocation

Multisig Notary address

f02049625

Client address

f3swlpybly37bicagery53iby53xrbld6rvcw3znv5slzs4zg6oaceg5jo4fbhrgrxxamcprzbdfpjmzl4hwlq

Rule to calculate the allocation request amount

100% of weekly dc amount requested

DataCap allocation requested

400TiB

Total DataCap granted for client so far

200TiB

Datacap to be granted to reach the total amount requested by the client (10PiB)

9.80PiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
0 0 200TiB NaN 200TiB
xcstoage commented 1 year ago

checker:manualTrigger

filplus-checker-app[bot] commented 1 year ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

⚠️ All retrieval success ratios are below 1%.

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

xcstoage commented 11 months ago

checker:manualTrigger

filplus-checker-app[bot] commented 11 months ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

⚠️ All retrieval success ratios are below 1%.

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.

github-actions[bot] commented 11 months ago

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

-- Commented by Stale Bot.

xcstoage commented 11 months ago

going on

xcstoage commented 11 months ago

checker:manualTrigger

filplus-checker-app[bot] commented 11 months ago

DataCap and CID Checker Report Summary[^1]

Retrieval Statistics

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients[^3]

✔️ No CID sharing has been observed.

[^1]: To manually trigger this report, add a comment with text checker:manualTrigger

[^2]: Deals from those addresses are combined into this report as they are specified with checker:manualTrigger

[^3]: To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

Full report

Click here to view the CID Checker report. Click here to view the Retrieval Dashboard. Click here to view the Retrieval report.