Skip to content

NimTechnology

Trình bày các công nghệ CLOUD một cách dễ hiểu.

  • Kubernetes & Container
    • Docker
    • Kubernetes
      • Ingress
    • Helm Chart
    • Isito-EnvoyFilter
    • Apache Kafka
      • Kafka
      • Kafka Connect
      • Lenses
    • Vault
    • Longhorn – Storage
    • VictoriaMetrics
    • MetalLB
    • Kong Gateway
  • CI/CD
    • ArgoCD
    • ArgoWorkflows
    • Spinnaker
    • Jenkins
    • Harbor
    • TeamCity
    • Git
      • Bitbucket
  • Coding
    • Terraform
      • GCP – Google Cloud
      • AWS – Amazon Web Service
    • Golang
    • Laravel
    • Python
    • Jquery & JavaScript
    • Selenium
  • Log & Monitor
    • DataDog
    • Prometheus
    • Grafana
    • ELK
      • Kibana
      • Logstash
  • BareMetal
    • NextCloud
  • Toggle search form

[Kafka] Install kafka and zookeeper cluster on kubernetes.

Posted on February 13, 2022April 3, 2022 By nim No Comments on [Kafka] Install kafka and zookeeper cluster on kubernetes.

Mới đây mình research ra các cái kafka trên k8s khá tiện
https://docs.bitnami.com/tutorials/deploy-scalable-kafka-zookeeper-cluster-kubernetes/

Link helm:
https://charts.bitnami.com/bitnami

Nó gồm 1 phần:
– Install zookeeper.
– Install Kafka.

Contents

  • 1) Install zookeeper
  • 2) Install kafka on kubernetes.
  • 3) Custom
    • 3.1) Public Kafka service to Access Kafka brokers from outside the cluster.

1) Install zookeeper

values.yaml

replicaCount: 3
auth:
  enabled: false
allowAnonymousLogin: true
Đây là hình em trên argocd

Nếu bạn có sài lọnghorn thì ko cần quan tâm đến pvc. Khoẻ re.

2) Install kafka on kubernetes.

values.yaml

zookeeper:
  enabled: false
replicaCount: 3
externalZookeeper:
  servers: zookeeper

Bạn để ý là mình lựu chọn mode cài zookeeper riêng.

zookeeper:
enabled: false
‘

Mình cần khai báo hostname, IP của zookeeper hoặc service name của zookeeper trên k8s

externalZookeeper:
  servers: zookeeper

3) Custom

3.1) Public Kafka service to Access Kafka brokers from outside the cluster.

Bạn có thể tham khảo link này trước:
https://github.com/bitnami/charts/tree/master/bitnami/kafka#accessing-kafka-brokers-from-outside-the-cluster

Và values.yaml của anh em sẽ như bên dưới!

replicaCount: 3
externalAccess:
  enabled: true
  service: 
    type: NodePort
  autoDiscovery: 
    enabled: true
serviceAccount:
  create: true
rbac:
  create: true
Khi này thì kafka sẽ public external service thông qua NodePort

Giờ bạn connect vào node port đó là xong.
Nếu bạn hiểu kĩ hơn kafka đã làm gì thí show config là hiểu liền

Apache Kafka, Kafka

Post navigation

Previous Post: [Kafka/Schema-registry] Installing Schema-registry to use for the Kafka and Kafka-connect model
Next Post: [Kafka-connect] Streaming the data of MySQL throughs Kafka-connect and Debezium plugin.

More Related Articles

[Kafka] Thiết kế và Testing Cluster kafka HA trên k8 Kafka
[Kafka/MSK] Install kafka or MSK on aws through terraform. AWS - Amazon Web Service
[Kafka-connect] Streaming the data of Postgresql through Kafka-connect and Debezium plugin. Apache Kafka
[Kafka-connect] Single Message Transform: lesson 1 – InsertField in Sink Apache Kafka
[Kafka-connect] Single Message Transform: lesson 9 – Cast Apache Kafka
[Lenses/kafka] Fix the problem “Cannot extract connector information from the configuration provided” when creating connector Kafka-connect Apache Kafka

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Tham Gia Group DevOps nhé!
Để Nim có nhiều động lực ra nhiều bài viết.
Để nhận được những thông báo mới nhất.

Recent Posts

  • [Prometheus/Grafana] Install Prometheus and Grafana on ubuntu. March 27, 2023
  • [Kong Gateway] WebSocket connection failed March 26, 2023
  • [Nextcloud] Can’t download files to have a size bigger than 2Gi on NextCloud – RaspBerry March 24, 2023
  • [Datadog] Using DataDog to monitor all services on kubernetes March 19, 2023
  • [Metrics Server] Failed to make webhook authorizer request: the server could not find the requested resource March 17, 2023

Archives

  • March 2023
  • February 2023
  • January 2023
  • December 2022
  • November 2022
  • October 2022
  • September 2022
  • August 2022
  • July 2022
  • June 2022
  • May 2022
  • April 2022
  • March 2022
  • February 2022
  • January 2022
  • December 2021
  • November 2021
  • October 2021
  • September 2021
  • August 2021
  • July 2021
  • June 2021

Categories

  • BareMetal
    • NextCloud
  • CI/CD
    • ArgoCD
    • ArgoWorkflows
    • Git
      • Bitbucket
    • Harbor
    • Jenkins
    • Spinnaker
    • TeamCity
  • Coding
    • Golang
    • Jquery & JavaScript
    • Laravel
    • Python
    • Selenium
    • Terraform
      • AWS – Amazon Web Service
      • GCP – Google Cloud
  • Kubernetes & Container
    • Apache Kafka
      • Kafka
      • Kafka Connect
      • Lenses
    • Docker
    • Helm Chart
    • Isito-EnvoyFilter
    • Kong Gateway
    • Kubernetes
      • Ingress
    • Longhorn – Storage
    • MetalLB
    • Vault
    • VictoriaMetrics
  • Log & Monitor
    • DataDog
    • ELK
      • Kibana
      • Logstash
    • Grafana
    • Prometheus
  • Uncategorized
  • Admin

Copyright © 2023 NimTechnology.