Unless you’ve been living under a rock, I’m sure you know about Kubernetes – one of the vastly successful open source project for container orchestration. And for those of us, who work with any sort of Data Platform, in all likelihood, must have come across the ubiquitous Data Streaming platform – Kafka.
I’ve written a couple of posts around how you can run Kafka on Kubernetes using Operator Pattern – I tried using the Strimzi Operator but there are several operators that do the same. Do check out the complete post here
The second post is around setting up monitoring & alerting for Kafka using Prometheus & Grafana on Kubernetes. Hard to be impartial here, so I’ve used Azure Kubernetes Service or AKS for my setup but the same steps would work for every Kubernetes distribution. You can find the complete detailed post here.
I hope you enjoy these tutorials and they would be useful for you in your journey of running Kafka on Kubernetes.