This is a third article in our Running Kafka in Kubernetes publication. Refer to https://medium.com/kafka-in-kubernetes/automating-storage-provisioning-41034e570928 to see the previous article. MotivationKafka uses Zookeeper to manage service discovery for Kafka Brokers that form the cluster. Zookeeper sends changes of the topology to Kafka, so each node in

MotivationTo achieve an automation of the storage provisioning in Kubernetes, we deploy our application using StatefulSet, and paired with Volume Claim Template. The backbone of Volume Claim Template is Storage Class. A StorageClass provides a way for administrators to describe the “classes” of storage they offer. Different classes might map

This article is the first one in the Running Kafka in Kubernetes publication. In this article, you will see the how setup a new Rancher cluster with 2 nodes, and configure NFS mount on each of those nodes. EC2 InstancesWe use EC2 in Oregon region for all our servers. Here