Stackable Operator for Apache ZooKeeper

The Stackable Operator for Apache ZooKeeper is a Kubernetes Operator for deploying and managing Apache ZooKeeper ensembles. Apache ZooKeeper is an open-source distributed coordination service that facilitates synchronization, configuration management and leader election in distributed systems. ZooKeeper is often used for these tasks in the Apache Hadoop ecosystem. Within the Stackable Platform, the Stackable Operators for Apache HBase, Apache Hadoop HDFS, Apache Kafka, Apache NiFi and Apache Druid depend on the ZooKeeper Operator.

Getting started

Get started with Apache ZooKeeper and the Stackable Operator by following the Getting started guide, it will guide you through the installation process. Afterwards, consult the Usage guide to learn more about configuring ZooKeeper for your needs. You can also deploy a demo to see an example deployment of ZooKeeper together with other data products.

Operator model

The Operator manages two custom resources: ZookeeperCluster and ZookeeperZnode. ZooKeeper only has a single process that it runs, so the cluster resource only has a single corresponding role called server.

A diagram depicting the Kubernetes resources created by the Stackable Operator for Apache ZooKeeper

For every role group the Operator creates a ConfigMap and StatefulSet which can have multiple replicas (Pods). Every role group is accessible through its own Service, and there is a Service for the whole Cluster.

The Operator creates a service discovery ConfigMap for the ZooKeeper instance, as well as for each ZNode. The discovery ConfigMaps contain information on how to connect to ZooKeeper. The ZNode discovery ConfigMap give access information for the ZNode. Learn more about ZNodes.

Dependencies

Apache ZooKeeper and the Stackable Operator have no dependencies besides the Stackable Commons Operator, Stackable Secret Operator and Stackable Listener Operator.

Demos

Apache ZooKeeper is a dependency of Apache HBase, Apache Hadoop HDFS, Apache Kafka and Apache NiFi, thus any demo that uses one or more of these components will also deploy a ZooKeeper ensemble. Here is the list of the demos that include ZooKeeper:

Supported Versions

The Stackable Operator for Apache ZooKeeper currently supports the following versions of ZooKeeper:

  • 3.9.1

  • 3.8.3 (deprecated)

  • 3.8.4 (LTS)