NateWebb03 / FilTestRepo

A test repository for allocator application automation
1 stars 0 forks source link

Test app 1092 #1095

Open NateWebb03 opened 5 months ago

NateWebb03 commented 5 months ago

Notary Allocator Pathway Name:

CIDgravity data preparation and onboarding

Organization:

Twinquasar - CIDgravity

Allocator's On-chain addresss:

f1pwityjf7zqokgwpjqple46ma5j5v7lsdfxwsasy

Country of Operation:

France

Region(s) of operation:

Other,South America,North America,Japan,Oceania,Europe,Greater China,Asia minus GCR,Africa

Type of allocator: What is your overall diligence process? Automated (programmatic), Market-based, or Manual (human-in-the-loop at some phase). Initial allocations to these pathways will be capped.

Automatic

Amount of DataCap Requested for allocator for 12 months:

100PiB

Is your allocator providing a unique, new, or diverse pathway to DataCap? How does this allocator differentiate itself from other applicants, new or existing?

This pathway operates as a fully S3 bucket, prioritizing key benefits:

Allocation Process Overview

  1. Registration:
    • The client connects to CIDgravity with its GitHub account and claims a Filecoin address in CIDgravity (signs a challenge).
    • The client register all information KYC information
    • KYC is processed
    • Upon success, the contact is check by an external international KYC service
    • Upon success the client get an s3/webdav environment created and share the key with the CIDgravity team.
  2. Onboarding:
    • The client drop files to the S3/WEbdav enpoints.
    • The data is automatically packed and pushed to Filecoin. The data is distributed over at least 10 different entities
    • CIDgravity keep a local copy of the data (not on Filecoin).
    • When the datacap is as low as 1 TiB, an audit report is created, verifying and logging the allocation for external audit (fil+ etc…)and the next tranche is automatically allocated.

Reporting / Monitoring:

As a member in the Filecoin Community, I acknowledge that I must adhere to the Community Code of Conduct, as well other End User License Agreements for accessing various tools and services, such as GitHub and Slack. Additionally, I will adhere to all local & regional laws & regulations that may relate to my role as a business partner, organization, notary, or other operating entity. * You can read the Filecoin Code of Conduct here: https://github.com/filecoin-project/community/blob/master/CODE_OF_CONDUCT.md

Acknowledgment: Acknowledge

Cient Diligence Section:

This section pertains to client diligence processes.

Who are your target clients?

Individuals learning about Filecoin,Small-scale developers or data owners,Enterprise Data Clients,Other (specified above)

Describe in as much detail as possible how you will perform due diligence on clients.

Corporate Details:

Documentation:

Please specify how many questions you'll ask, and provide a brief overview of the questions.

Will you use a 3rd-party "Know your client" (KYC) service?

yes

Can any client apply to your pathway, or will you be closed to only your own internal clients? (eg: bizdev or self-referral)

Any clients

How do you plan to track the rate at which DataCap is being distributed to your clients?

CIDgravity has direct access to the chain and the preceding datacap allocation epoch before assigning the new one. All allocation will be logs to our tracking DB and transparently shared publicly

Data Diligence

This section will cover the types of data that you expect to notarize.

As a reminder: The Filecoin Plus program defines quality data is all content that meets local regulatory requirements AND • the data owner wants to see on the network, including private/encrypted data • or is open and retrievable • or demonstrates proof of concept or utility of the network, such as efforts to improve onboarding

As an operating entity in the Filecoin Community, you are required to follow all local & regional regulations relating to any data, digital and otherwise. This may include PII and data deletion requirements, as well as the storing, transmitting, or accessing of data.

Acknowledgement: Acknowledge

What type(s) of data would be applicable for your pathway?

Public Open Dataset (Research/Non-Profit),Public Open Commercial/Enterprise,Private Commercial/Enterprise,Private Non-Profit/Social Impact,Other (specified elsewhere)

How will you verify a client's data ownership? Will you use 3rd-party KYB (know your business) service to verify enterprise clients?

No KYB nor data ownership will be performed as this pathway is specifically crafted to prevent collaboration between clients and Service Providers (SPs) in attempting to cheat the system and the block reward mechanism. More below 19.

How will you ensure the data meets local & regional legal requirements?

We will respond to notifications through our Notice and Takedown process. Upon notification, the data will be promptly removed from our platform. No further data processing will occur for this account until clarification is obtained. Additionally, we will inform the responsible Service Providers (SPs) storing the content without delay.

What types of data preparation will you support or require?

We provide a complete pipeline with a S3 and Webdav connector to Filecoin. The pipeline rely on a mix of OSS tools + CIDgravity

What tools or methodology will you use to sample and verify the data aligns with your pathway?

N/A

Data Distribution

This section covers deal-making and data distribution.

As a reminder, the Filecoin Plus program currently defines distributed onboarding as multiple physical locations AND multiple storage provider entities to serve client requirements.

Recommended Minimum: 3 locations, 4 to 5 storage providers, 5 copies

How many replicas will you require to meet programmatic requirements for distribution?

2+

What geographic or regional distribution will you require?

Taking into account that the client do not decide which miner will store the data. We have the guarantee it will be widly distributed through SPs The client has no role in selecting the data location. The data will be distributed across all regions, allowing for up to 10 copies as per the client's preference. Our track record includes successfully onboarding datasets to 25 different miners, as documented here: GitHub Link. For private data, clients may have specific constraints regarding the data location; we can further tailor this to accommodate their needs.

How many Storage Provider owner/operators will you require to meet programmatic requirements for distribution?

2+

Do you require equal percentage distribution for your clients to their chosen SPs? Will you require preliminary SP distribution plans from the client before allocating any DataCap?

CIDgravity's algorithm is designed to leverage the best reputation for the selected client. The algorithm ensures the distribution of data across as many Service Providers (SPs) as possible. Our estimation indicates that easily reaching 20 SPs is achievable through this approach, optimizing the distribution for enhanced reliability and availability.

What tooling will you use to verify client deal-making distribution?

CIDgravity will keep track of deals, compare them with the Filecoin Chain, and make the audit results public.

How will clients meet SP distribution requirements?

We initiate the deal on behalf of the client, ensuring that the distribution will be respected.

As an allocator, do you support clients that engage in deal-making with SPs utilizing a VPN?

Yes, we do

DataCap Allocation Strategy

In this section, you will explain your client DataCap allocation strategy.

Keep in mind the program principle over Limited Trust Over Time. Parties, such as clients, start with a limited amount of trust and power. Additional trust and power need to be earned over time through good-faith execution of their responsibilities and transparency of their actions.

Will you use standardized DataCap allocations to clients?

Yes, standardized

Allocation Tranche Schedule to clients:

• First: 10TiB • Second:10TiB • Third:10TiB • Fourth:10TiB • Max per client overall: No limit

Will you use programmatic or software based allocations?

Yes, standardized and software based

What tooling will you use to construct messages and send allocations to clients?

CIDgravity is already plugged to the filecoin chain. It will support to send the message natively

Describe the process for granting additional DataCap to previously verified clients.

Datacap Exhaustion Check: - When the Datacap reaches 1TiB, the API ceases to provide information on the next Service Provider (SP) and instead returns an error message: "No more datacap available. Waiting for next tranche validation." Concurrent Datacap Renewal Process: - Simultaneously, the datacap renewal process is initiated. - If the datacap has been consumed as per CIDgravity's request, the next tranche is automatically allocated by sending a message on-chain.

Tooling & Bookkeeping

This program relies on many software tools in order to function. The Filecoin Foundation and PL have invested in many different elements of this end-to-end process, and will continue to make those tools open-sourced. Our goal is to increase adoption, and we will balance customization with efficiency.

This section will cover the various UX/UI tools for your pathway. You should think high-level (GitHub repo architecture) as well as tactical (specific bots and API endoints).

Describe in as much detail as possible the tools used for: • client discoverability & applications • due diligence & investigation • bookkeeping • on-chain message construction • client deal-making behavior • tracking overall allocator health • dispute discussion & resolution • community updates & comms

• client discoverability & applications ð Current CIDGravity onboarding process , with a new section for selecting datacap pathway • due diligence & investigation N/A • bookkeeping All actions will be recorded in the CIDgravity database, and a public WebUI will provide access to these logs. • on-chain message construction Message send direction by CIDgravity • client deal-making behavior We already track any deals since proposed by CIDgravity to onchain status. • tracking overall allocator health Stats will be available. • dispute discussion & resolution Dispute will be done via slack for private and github for public • community updates & comms * We will utilize our Slack channel: #fil-cid-gravity for announcements. These announcements will also be crossposted to all Service Provider (SP) workgroups , #fil-plus and #fil-hobby.

Will you use open-source tooling from the Fil+ team?

To maintain transparency, we will keep our stack’s compliance with the filplus-checker-app.

Where will you keep your records for bookkeeping? How will you maintain transparency in your allocation decisions?

We are committed to full transparency by publicly disclosing the following information through our portal:

Risk Mitigation, Auditing, Compliance

This framework ensures the responsible allocation of DataCap by conducting regular audits, enforcing strict compliance checks, and requiring allocators to maintain transparency and engage with the community. This approach safeguards the ecosystem, deters misuse, and upholds the commitment to a fair and accountable storage marketplace.

In addition to setting their own rules, each notary allocator will be responsible for managing compliance within their own pathway. You will need to audit your own clients, manage interventions (such as removing DataCap from clients and keeping records), and respond to disputes.

Describe your proposed compliance check mechanisms for your own clients.

As previously outlined, adherence to our datacap consumption guidances is mandatory. Any deviation from these guidelines will result in the automatic suspension of the account. Clients seeking a deeper analysis and account reactivation will be subject to a fee.

Describe your process for handling disputes. Highlight response times, transparency, and accountability mechanisms.

Disputes between clients and CIDgravity are handled through the outlined process via Slack. Disputes involving Allocators and CIDgravity will be managed through the community-defined process on Slack and GitHub.

Detail how you will announce updates to tooling, pathway guidelines, parameters, and process alterations.

Part of the CIDgravity annoucement already in place and as descibed above.

How long will you allow the community to provide feedback before implementing changes?

Regarding security, how will you structure and secure the on-chain notary address? If you will utilize a multisig, how will it be structured? Who will have administrative & signatory rights?

The entire process will be fully automated. Instead of utilizing a multisig, the signatory key will be encrypted with a passphrase known exclusively to Julien NOEL.

Will you deploy smart contracts for program or policy procedures? If so, how will you track and fund them?

Not planned yet.

Monetization

While the Filecoin Foundation and PL will continue to make investments into developing the program and open-sourcing tools, we are also striving to expand and encourage high levels of service and professionalism through these new Notary Allocator pathways. These pathways require increasingly complex tooling and auditing platforms, and we understand that Notaries (and the teams and organizations responsible) are making investments into building effective systems.

It is reasonable for teams building services in this marketplace to include monetization structures. Our primary guiding principles in this regard are transparency and equity. We require these monetization pathways to be clear, consistent, and auditable.

Outline your monetization models for the services you provide as a notary allocator pathway.

- XXX USD for KYC Clearance
- X% of the monthly transaction with a minimum of X$/TiB

Describe your organization's structure, such as the legal entity and other business & market ventures.

CIDgravity is a solution developed by Twin Quasar. A French company leader in the Filecoin ecosystem / PLN. Since 2021

Where will accounting for fees be maintained?

Bank

If you've received DataCap allocation privileges before, please link to prior notary applications.

We’ve been notary since 2021 round 1. Notary Round 1 : https://github.com/filecoin-project/notary-governance/issues/5 Notary Round 2 : https://github.com/filecoin-project/notary-governance/issues/136 Notary Round 3 : https://github.com/filecoin-project/notary-governance/issues/468 Notary Round 4 : https://github.com/filecoin-project/notary-governance/issues/739

How are you connected to the Filecoin ecosystem? Describe your (or your organization's) Filecoin relationships, investments, or ownership.

Twin Quasar provides top-tier solutions, delivering infrastructure and open-source tooling designed for storage providers and Filecoin ecosystem partners as well as seamless data onboarding and Filecoin+ services. Strategically located in Paris, our facilities are directly connected to our 12,000km fiber backbone network. Explore our Tier 3 colocation services, managed services, IaaS, and Filecoin expertise, all marked by a first-class 100% client satisfaction rate, and run on 100% renewable energy.

How are you estimating your client demand and pathway usage? Do you have existing clients and an onboarding funnel?

We already have 2 prospects identified that could be interested in this pathway