Multi-Architecture for SDP (Experimental)

This is an experimental feature of the Stackable Data Platform (SDP) and still under development.

Early access

SDP release 23.11.0 has been ported to the ARM64 architecture. These images are stored within the stackable-experimental organization in our Docker repository.

Available releases

The only release currently available for ARM64 is the early access version mentioned above.

Each product image is built using ARM-specific tags to keep them distinct from development/nightly images. In the future they may be bundled as a manifest list using an automated workflow.

Operators

According to our installation guide you can install ARM64 operators e.g. for the commons operator as follows:

helm install commons-operator stackable-stable/commons-operator --namespace stackable-operators --create-namespace --version=23.11.0 --set image.repository=docker.stackable.tech/stackable-experimental/commons-operator

By declaring --set image.repository=docker.stackable.tech/stackable-experimental/commons-operator you will overwrite the image selected by default with one located in the organization stackable-experimental. The other operators can be installed in the same way.

Products

The Product image selection mechanism allows the user to choose a specific product image and/or a different repository, which may be relevant for e.g. air-gapped environments or when using a mirrored repository. To choose an ARM64 image specify the image in the custom field as follows:

spec:
  image:
    custom: docker.stackable.tech/stackable-experimental/kafka:3.5.1-stackable23.11.0
    productVersion: 3.5.1

Only 23.11.0 is working at this moment.

Prepared demos

Usually stackablectl would install all required operators for a demo automatically. But stackablectl is not yet aware of multiple architectures so it would install the x86 operators. Therefore, if you want to install a demo, you need to always use the --skip-release flag for stackablectl. See the example in this section.

It is possible to run SDP demos on ARM64 architecture, but due to the changes that are necessary we have provided a separate branch to make this easier. Please follow the instructions below to run a demo on ARM.

You will need access to a Kubernetes Cluster and to have the stackablectl command-line tool installed.

1. Clone the demo repository

git clone git@github.com:stackabletech/demos.git

2. Checkout ARM64 demo branch (release 23.11.0)

cd demos && git pull && git checkout spike/demos-on-arm

3. Install stackable operators (release 23.11.0)

This executes a script where all operators with version 23.11.0 are installed. You can omit this step and only install operators you want by copying the corresponding helm command.

./arm.sh

4. Install your demo with stackablectl (e.g. nifi-kafka-druid-earthquake-data)

stackablectl demo install nifi-kafka-druid-earthquake-data --skip-release -s stacks/stacks-v2.yaml -d demos/demos-v2.yaml