Skip to content

NimTechnology

Trình bày các công nghệ CLOUD một cách dễ hiểu.

  • Kubernetes & Container
    • Docker
    • Kubernetes
      • Ingress
      • Pod
    • Helm Chart
    • OAuth2 Proxy
    • Isito-EnvoyFilter
    • Apache Kafka
      • Kafka
      • Kafka Connect
      • Lenses
    • Vault
    • Longhorn – Storage
    • VictoriaMetrics
    • MetalLB
    • Kong Gateway
  • CI/CD
    • ArgoCD
    • ArgoWorkflows
    • Argo Events
    • Spinnaker
    • Jenkins
    • Harbor
    • TeamCity
    • Git
      • Bitbucket
  • Coding
    • DevSecOps
    • Terraform
      • GCP – Google Cloud
      • AWS – Amazon Web Service
      • Azure Cloud
    • Golang
    • Laravel
    • Python
    • Jquery & JavaScript
    • Selenium
  • Log, Monitor & Tracing
    • DataDog
    • Prometheus
    • Grafana
    • ELK
      • Kibana
      • Logstash
  • BareMetal
    • NextCloud
  • Toggle search form

[Kafka] Install kafka and zookeeper cluster on kubernetes.

Posted on February 13, 2022April 3, 2022 By nim No Comments on [Kafka] Install kafka and zookeeper cluster on kubernetes.

Mới đây mình research ra các cái kafka trên k8s khá tiện
https://docs.bitnami.com/tutorials/deploy-scalable-kafka-zookeeper-cluster-kubernetes/

Link helm:
https://charts.bitnami.com/bitnami

Nó gồm 1 phần:
– Install zookeeper.
– Install Kafka.

Contents

Toggle
  • 1) Install zookeeper
  • 2) Install kafka on kubernetes.
  • 3) Custom
    • 3.1) Public Kafka service to Access Kafka brokers from outside the cluster.

1) Install zookeeper

values.yaml

replicaCount: 3
auth:
  enabled: false
allowAnonymousLogin: true
Đây là hình em trên argocd

Nếu bạn có sài lọnghorn thì ko cần quan tâm đến pvc. Khoẻ re.

2) Install kafka on kubernetes.

values.yaml

zookeeper:
  enabled: false
replicaCount: 3
externalZookeeper:
  servers: zookeeper

Bạn để ý là mình lựu chọn mode cài zookeeper riêng.

zookeeper:
enabled: false
‘

Mình cần khai báo hostname, IP của zookeeper hoặc service name của zookeeper trên k8s

externalZookeeper:
  servers: zookeeper

3) Custom

3.1) Public Kafka service to Access Kafka brokers from outside the cluster.

Bạn có thể tham khảo link này trước:
https://github.com/bitnami/charts/tree/master/bitnami/kafka#accessing-kafka-brokers-from-outside-the-cluster

Và values.yaml của anh em sẽ như bên dưới!

replicaCount: 3
externalAccess:
  enabled: true
  service: 
    type: NodePort
  autoDiscovery: 
    enabled: true
serviceAccount:
  create: true
rbac:
  create: true
Khi này thì kafka sẽ public external service thông qua NodePort

Giờ bạn connect vào node port đó là xong.
Nếu bạn hiểu kĩ hơn kafka đã làm gì thí show config là hiểu liền

Apache Kafka, Kafka

Post navigation

Previous Post: [Kafka/Schema-registry] Installing Schema-registry to use for the Kafka and Kafka-connect model
Next Post: [Kafka-connect] Streaming the data of MySQL throughs Kafka-connect and Debezium plugin.

More Related Articles

[Kafka-connect] Single Message Transform: lesson 4 – RegexRouter – change topic name. Apache Kafka
[Kafka-connect] Streaming the data of MySQL throughs Kafka-connect and Debezium plugin. Apache Kafka
[Kafka] UI control Kafka, Kafka-connect, … It’s akhq.io Apache Kafka
[Kafka] Kafka Console Producer CLI. Apache Kafka
[Kafka-connect]Single Message Transform: lesson 3 – Flatten and LongConverter Apache Kafka
[Kafka] This is how you produce and consume messages with Kafka Kafka

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Tham Gia Group DevOps nhé!
Để Nim có nhiều động lực ra nhiều bài viết.
Để nhận được những thông báo mới nhất.

Recent Posts

  • [Azure] The subscription is not registered to use namespace ‘Microsoft.ContainerService’ May 8, 2025
  • [Azure] Insufficient regional vcpu quota left May 8, 2025
  • [WordPress] How to add a Dynamic watermark on WordPress. May 6, 2025
  • [vnet/Azure] VNet provisioning via Terraform. April 28, 2025
  • [tracetcp] How to perform a tracert command using a specific port. April 3, 2025

Archives

  • May 2025
  • April 2025
  • March 2025
  • February 2025
  • January 2025
  • December 2024
  • November 2024
  • October 2024
  • September 2024
  • August 2024
  • July 2024
  • June 2024
  • May 2024
  • April 2024
  • March 2024
  • February 2024
  • January 2024
  • December 2023
  • November 2023
  • October 2023
  • September 2023
  • August 2023
  • July 2023
  • June 2023
  • May 2023
  • April 2023
  • March 2023
  • February 2023
  • January 2023
  • December 2022
  • November 2022
  • October 2022
  • September 2022
  • August 2022
  • July 2022
  • June 2022
  • May 2022
  • April 2022
  • March 2022
  • February 2022
  • January 2022
  • December 2021
  • November 2021
  • October 2021
  • September 2021
  • August 2021
  • July 2021
  • June 2021

Categories

  • BareMetal
    • NextCloud
  • CI/CD
    • Argo Events
    • ArgoCD
    • ArgoWorkflows
    • Git
      • Bitbucket
    • Harbor
    • Jenkins
    • Spinnaker
    • TeamCity
  • Coding
    • DevSecOps
    • Golang
    • Jquery & JavaScript
    • Laravel
    • NextJS 14 & ReactJS & Type Script
    • Python
    • Selenium
    • Terraform
      • AWS – Amazon Web Service
      • Azure Cloud
      • GCP – Google Cloud
  • Kubernetes & Container
    • Apache Kafka
      • Kafka
      • Kafka Connect
      • Lenses
    • Docker
    • Helm Chart
    • Isito-EnvoyFilter
    • Kong Gateway
    • Kubernetes
      • Ingress
      • Pod
    • Longhorn – Storage
    • MetalLB
    • OAuth2 Proxy
    • Vault
    • VictoriaMetrics
  • Log, Monitor & Tracing
    • DataDog
    • ELK
      • Kibana
      • Logstash
    • Fluent
    • Grafana
    • Prometheus
  • Uncategorized
  • Admin

Copyright © 2025 NimTechnology.