Comparision of SODA / GAIA-X / IDSA goals

[noelmcloughlin]

Issue/Feature Description:

Compare SODA goals with GAIA-X (Europe) and IDSA and share the notes

[noelmcloughlin]

---

SODA Architecture: https://github.com/sodafoundation/architecture-analysis/blob/master/SODAArchitectureAndProjects.pdf

---

FOCUS: Data Mobility: Seamless data tiering, replication, migration ad archiving. Data Protection: Snapshots for efficient data protection and recovery Data lifecycle: combines different storage resources on-premise, multi-cloud to build tiers Unified Storage Platform: Abstract multi-vendor storage (Kubernetes, VMWare, OpenStack), extensible. Cloud-native Storage: Persistent storage to Kubernetes, SODA CSI Driver Data Governance: Common data governance framework from edge to core to the cloud (data regularity) Data Orchestration: data orchestration for IoT, big data, machine learning, (multi-storage/cloud) Data Energy: Profile, analyze, optimize energy (ROI)

Projects serviced by SODA incubator program.

CORE ARCH/PROJECTS: API: common unified data/storage interface Controller: Control services Dock: Connect hetrogeneous storage backends NBP: Industry Integration Point Multi-Cloud: Cloiud-Vendor Agnostic interface

• Native Projects:
  -- member: YIG, LinStor, Zenko, -- Potential: Minio, MooseFS, Titron OS, OpenIQ, Gluster

ECO ARCH/PROJECTS: Delfin: Infrastructure Manager
Orchestration: Intelligent Workflow automation Anomaly: Predictive Analysis for Delfin/TTelemetry data Dashboard: GUI Dashboard Reference (showoff features) documentation Integrated SODA docs Examples: Use Case demos and prototypes.

• Eco projects: -- members: OpenSDS, KubeEdge -- Potential: Other Projects

SODA Data Framework: Architecture

Core Projects: API, Dock, Controller, Multicloud, Plugins, Delfin Key Features:

• Policy-based storage provisioning with profiles
• Dynamic Kubernetes persistent storage with SODA CSI driver
• Integration with VMware and OpenStack
• S3 multicloud data control for AWS, Azure, Google Cloud, local Ceph S3 g/w
• Heterogeneous vendor stoarge: OpenStack, CSI driver support
• Telemetry, automation, anomaly detection, etc.

---

GAIA-X Architecture: https://www.data-infrastructure.eu/GAIAX/Redaktion/EN/Publications/gaia-x-technical-architecture.pdf

---

Goals: Digital Sovereignty, Federation, Self-Description, Policies

PRINCIPLES: Openness and Transparency: Public Specifications Interoperability: Interactions Federated systems federated systems of autonomous Providers Authenticity and Trust: Identity and Trust systems

GUIDELINES: Secure by-design: security technology Privacy by design: privacy regulations Enabling federation, distribution, and decentralization Usage-friendliness and simplicity: State-of-the-art user experience, open standards, and protocols, etc. Machine-Processability: Machine-readable artifacts and API Semantic representation: GAIA Data Model, Semantics of Ecosystem

ARCHITECTURE Data Ecosystem and the Infrastructure Ecosystem (European Data Strategy)

• Node
• Data Spaces
• Advances Smart services in verticals
• Participants Roles: Service Provider and/or Service Consumer
• Services (Cloud): Data and Node
• Ecosystems common and solid foundation (Policy rules, Architecture of Standards, and interconnectivity)

FEDERATION SERVICES

• Identity and Trust,
• Federated Catalogue,
• Sovereign Data Exchange,
• Compliance

CORE ARCHITECTURE

• Services and Nodes
• Data Assets
• Consumer and Provider
• Self-Description -- Uses: discovery, evaluation, integration, monitoring, contract negotiation; properties: -- Properties: digital, agnostic, schema, interoperation, flexible, navigable, expressive -- Gaia-X Self Description Graph: typed relations, set of relation triples -- Attribute categories: Providers, Consumers, Services, Nodes
• Catalog Federation
• Policies and Usage control -- Data-centric -- Policy-driven workload control
  • Interconnection and Networking (data ecosystem, Infra-ecosystem) -- CSP, HPC, SSC, EDGE
  • Monitoring and Metering -- Logging and auditing -- Metering

IDENTITY Lifecycle process

• Onboarding
• Maintaining
• Offboarding

In the GAIA-X Federated Identity framework, SODA is Provider and/or Consumer.

SERVICE CLASSES:

• qualities: noteworthy, security, performance, resilience, sustainability
• GAIA-X federated, distributed, decentralized, and trustworthy architecture

GAIA-X ECOSYSTEMS

1. Infra Eco-system (CSP, HPC, Sector, Edge, Backbones)
2. Data Eco-system (Data Provider, Data Consumer, Service Provider)

DATA SPACES

• Stakeholders (Data Provider, Data Owner, Data Consumer, Providers of Advanced Smart Services)
• Standards for Interoperability (i.e. SODA API)
• Federated Ecosystem

INFO SECURITY DATA Secure and trusted data services

1. Shared Responsibility for Participants
2. Access Control between Participants
3. Compliance
4. Federated Catalogue
5. Data protection (GDPR)
6. Assurance

ONBOARDING & CERTIFICATION Onboarding a Provider and Consumer to GAIA-X Onboarding Services and Nodes to GAIA-X

• basic assurance
• higher levels
• Modularity (use existing schemes/systems)

Use Cases (Spaces) Energy Health Industry 4.0/SMD Agriculture Mobility Public Sector Smart Living Finance

---

INTERNATIONAL DATA SPACES ASSOCIATION (IDSA) https://www.internationaldataspaces.org/wp-content/uploads/2019/03/IDS-Reference-Architecture-Model-3.0.pdf

---

• IDSA -- LAYERS -- PERSPECTIVES

IDSA REFERENCE ARCHITECTURE MODEL

• Business Layer -- IDS Roles -- Category 1: Core Participant -- Category 2: Intermediary -- Category 3: Software / Service Provider -- Category 4: Governance Body -- Digital Identities -- Participant -- Certification -- Certification Authority -- Usage Contracts -- legal -- technical

• Functional Layer -- Trust -- roles -- identity -- users -- Security and Data Sovereignty -- Authenticate and Authorization -- Usage Policies & Enforcement -- Trustworthy Communication & secure-by-design -- Technical Certification

  -- Ecosystem of Data -- data source description, -- brokering, -- vocabularies, -- operation, -- data exchange,

  -- Data processing and transformation, -- data app implementation, -- providing data apps, -- installing and supporting apps,

  -- Data Markets: -- Clearing & Billing, -- Usage restrictions and governance, -- Legal aspects

• Process Layer -- Onboarding, -- Exchanging Data, -- Publishing and using Data Apps

• Information Layer -- Scope, -- Model Representation, -- Configuration Model -- Conceptual representation of a digital resource in the IDS -- Vocabularies: Data App Interfaces,

• System Layer -- connector architecture, -- Broker -- Data Apps and App Store

ISDA PERSPECTIVES

• Security

  • aspects
  • principles
  • concepts

• Certification

  • aspects
  • process
  • certification of participants and core components

• Governance

  • aspects
  • data governance
  • economic good
  • data ownership
  • soverneignty
  • quality
  • provenance

Ecosystems are characterized by the fact that no member is capable of creating innovation on its own. Instead, the ecosystem as a whole needs to team up

Data Sharing Ecosystems

• Material Sciences
• Energy
• Manufacturing and Logistics
• Health Care
• Smart Cities

Data Sovereignty as a key capability Data as an Economic Good Industrial Cloud Platforms Big Data and Artificial Intelligence Industrial Internet of Things Blockchain

Data-Driven Use Cases

• Data Integration, Knowledge Extraction (data lake)
• Secure Data Exchange, Data sovereignty (IDS)
• Data Consistency, Data transparency (blockchain)

Enterprise Architecture Smart Service Scenarios Spaces: Mobility, Healthcare, Logistics, Production, Energy, Other Service and Product Innovations Smart Data Services (Alerting, Monitoring, data quality, etc) IDS Basic Data Services (Information, fusion, mapping, aggregation, etc) Internet of Things - Broadbank Infrastructure - 5G Real-time Area - Sensors and Actuators - Devices

---

COMMON LANGUAGE?

---

Nodes:

• SODA Application Platforms/Clients is GAIA-X Participant Consumer/Provider
• SODA Data Framework is GAIA-X Participant Service
• SODA Storage becomes GAIA-X Participant Consumer/Provider

Notes for SODA-Installer Redesign...

PROVISIONER TOP MODEL

Foundation

• cncf
• Linux
• Soda
• Gaia
• idsa

Relation

• Graduated
• Incubating
• Sandbox
• Member
• non-Member

License

• Open
• Not-Open

[noelmcloughlin]

Provisioner model prototype: https://github.com/noelmcloughlin/uniprovisioner/blob/main/soda/defaults.yaml