This repository contains the code for a Kubernetes operator that manages Vertica Analytic Database. The operator uses a custom resource definition (CRD) to automate administrative tasks for a Vertica database.
To deploy the operator and a Kubernetes cluster in a local test environment that requires minimal resources, see DEVELOPER.md.
See Containerized Environments for supported plaform information, including version, communal storage, and managed services support.
The VerticaDB operator automates tasks and monitors the state of your Vertica on Kubernetes deployment. It uses an admission controller webhook to verify any state changes to resource objects. Install the operator with OperatorHub.io or Helm charts.
OperatorHub.io is an operator registry for environments that use the Operator Lifecycle Manager (OLM). For installation instructions, go to the VerticaDB Operator page and select the Install button.
The Vertica Helm chart includes the operator and the admission controller. Additionally, the Helm chart installs the CRD if it is not currently installed.
The Helm chart provides the following customization options:
For complete installation instructions, see Installing the VerticaDB Operator.
After the operator is installed and running, create a Vertica deployment by generating a custom resource (CR). The operator adds watches to the API server so that it is notified whenever a CR in the same namespace changes.
Launching a new Vertica deployment with the operator is simple. Below is the minimal required CR configuration:
apiVersion: vertica.com/v1beta1
kind: VerticaDB
metadata:
name: vertica-sample
spec:
communal:
path: "s3://<bucket-name>/<key-name>"
endpoint: http://path/to/endpoint
credentialSecret: s3-creds
subclusters:
- name: defaultsubcluster
size: 3After this manifest is applied, the operator creates the necessary objects in Kubernetes, sets up the config directory in each pod, and creates an Eon Mode database in the communal path.
For a comprehensive custom resource example, see VerticaDB CR.
Use configuration parameters to customize your Vertica on Kubernetes deployment. For a full list of parameters and their definitions, see Custom Resource Definition Parameters.
A pod is an ephemeral Kubernetes object that requires access to external storage to persist data between life cycles. Vertica on Kubernetes persists data with the following:
/home/dbadmin/local-data, and has specific StorageClass and storage format type requirements.For details about local volume mounts, StorageClass requirements, and custom volume mounts, see Containerized Vertica on Kubernetes.
Vertica on Kubernetes manages subclusters by workload, which allows you to fine-tune your workload with one of the following scaling strategies:
For details about manually sizing subclusters for new workloads, see Subclusters on Kubernetes.
After you create a subcluster, you can use the VerticaAutoscaler to automatically scale subclusters or pods when resource metrics reach specified triggers. For instructions on automatically scaling existing subclusters with VerticaAutoscaler, see VerticaAutoscaler CRD.
External clients can target specific subclusters to handle their workload. Each subcluster has its own service object that you can configure to manage client connections. Use the subclusters[i].serviceName parameter to name a service object so that you can assign a single service object to one or more subclusters.
By default, the subcluster service object is set to ClusterIP, which load balances internal traffic across the pods in the subcluster. To allow connections from outside of the Kubernetes cluster, set the subclusters[i].serviceType parameter to NodePort or LoadBalancer.
For an overview about Vertica on Kubernetes and Service Objects, see Containerized Vertica on Kubernetes.
For a detailed implementation example, see VerticaDB CR.
The operator can migrate an existing Eon Mode database into Kubernetes. The operator revives the existing database into a set of Kubernetes objects that mimics the setup of the database. Vertica provides vdb-gen, a standalone program that you can run against a live database to create the CR.
See Generating a Custom Resource from an Existing Eon Mode Database for detailed steps.
By default, the CR uses the Community Edition (CE) license. The CE license limits the number pods in a cluster to 3, and the dataset size to 1TB.
Add your own license to extend your cluster past the CE limits. See VerticaDB CRD for details about adding your own license as a Secret in the same namespace as the operator.
Vertica recommends incremental upgrade paths. See Upgrading Vertica on Kubernetes for details about Vertica server version upgrades for a custom resource.
Vertica supports Red Hat OpenShift, a hybrid cloud platform that adds security features and additional support to Kubernetes clusters.
The VerticaDB operator is available for download in the OpenShift OperatorHub. It is compatible with OpenShift versions 4.8 and higher.
OpenShift manages security with Security Context Constraints (SCCs). You need to use the 'anyuid' SCC to manage the security of the Veriica pods.
For details about Vertica on OpenShift, see Red Hat OpenShift integration.
Vertica integrates with Prometheus to collect time series metrics on the VerticaDB operator. Configure Prometheus to authorize connections using a role-based access (RBAC) sidecar proxy, or expose the metrics to external clients with an HTTP endpoint.
For more information, see Prometheus Integration.
For additional details on the internals of Vertica, see the Vertica Documentation.
For details about setting up an environment to develop and run tests, see DEVELOPER.md.
vertica-kubernetes is open source code and is under the Apache 2.0 license, but it requires that you install the Vertica server RPM. If you do not have a Vertica server RPM, you can use the free Vertica Community Edition (CE) server RPM. The Vertica Community Edition server RPM is not an open source project, but it is free with certain limits on capacity. For more information about these limitations, see the Vertica Community Edition End User License Agreement.