Skip to content

NimTechnology

Trình bày các công nghệ CLOUD một cách dễ hiểu.

  • Kubernetes & Container
    • Docker
    • Kubernetes
      • Ingress
      • Pod
    • Helm Chart
    • OAuth2 Proxy
    • Isito-EnvoyFilter
    • Apache Kafka
      • Kafka
      • Kafka Connect
      • Lenses
    • Vault
    • Longhorn – Storage
    • VictoriaMetrics
    • MetalLB
    • Kong Gateway
  • CI/CD
    • ArgoCD
    • ArgoWorkflows
    • Argo Events
    • Spinnaker
    • Jenkins
    • Harbor
    • TeamCity
    • Git
      • Bitbucket
  • Coding
    • DevSecOps
    • Terraform
      • GCP – Google Cloud
      • AWS – Amazon Web Service
      • Azure Cloud
    • Golang
    • Laravel
    • Python
    • Jquery & JavaScript
    • Selenium
  • Log, Monitor & Tracing
    • DataDog
    • Prometheus
    • Grafana
    • ELK
      • Kibana
      • Logstash
  • BareMetal
    • NextCloud
  • Toggle search form

Category: Apache Kafka

[Azure/Event Hub/Kafka] Using Event Hub instead of Kafka on the Azure Cloud.

Posted on May 22, 2025May 22, 2025 By nim No Comments on [Azure/Event Hub/Kafka] Using Event Hub instead of Kafka on the Azure Cloud.
[Azure/Event Hub/Kafka] Using Event Hub instead of Kafka on the Azure Cloud.

Đâu tiên nếu chúng ta chưa đăng ký sử dụng Event Hub sẽ bị lỗi trên.Chúng ta sẽ thực hiện đăng ký như sau: Bạn tìm đến eventhub click vào: Tiếp theo thì bạn sẽ chọn Subscription và Resource groupNamespace name nó là tên của event-hub rồi chọn region Pricing tier: chúng ta có rất…

Read More “[Azure/Event Hub/Kafka] Using Event Hub instead of Kafka on the Azure Cloud.” »

Azure Cloud, Kafka

Message Prioritization in Kafka

Posted on March 4, 2024March 4, 2024 By nim No Comments on Message Prioritization in Kafka
Message Prioritization in Kafka

Copy from: https://udayabharathi.medium.com/message-prioritization-in-kafka-105f712dcf8a Hello there! If you’re familiar with Kafka. And if you understand the internals, then you might wonder how to implement message prioritization in Kafka. Because, the way it works, this use case is simply not directly possible with Kafka. If you are actually new to Kafka, then be sure to stick with…

Read More “Message Prioritization in Kafka” »

Kafka

How to code a tool to connect Kafka by Golang

Posted on December 27, 2023December 31, 2023 By nim No Comments on How to code a tool to connect Kafka by Golang
How to code a tool to connect Kafka by Golang

1) Overview Bạn cần viết 1 application để connect vào kafka bằng Golang. Chúng ta có 2 lựa chọn:https://github.com/confluentinc/confluent-kafka-gohttps://github.com/IBM/sarama Hãy tìm hiểu về sơ về cách thức hoạt động và ưu nhược điểm của 2 package trên. confluent-kafka-go Key Features: sarama Key Features: Comparison and Considerations Hoặc bạn có thể tham khảo link này:https://www.reddit.com/r/golang/comments/olrd34/confluentkafkago_or_shopifysarama/ Example…

Read More “How to code a tool to connect Kafka by Golang” »

Golang, Kafka

[Kafka/Strimzi] Install kafka cluster on k8s by Strimzi

Posted on December 26, 2023December 26, 2023 By nim No Comments on [Kafka/Strimzi] Install kafka cluster on k8s by Strimzi
[Kafka/Strimzi] Install kafka cluster on k8s by Strimzi

Bạn đang sợ hữu 1 cluster k8s. Và bạn muốn cài kafka lên đó.Mình đã có hướng dẫn cài bạn ở 1 bài trước đó Giờ bạn có thể cài kafka thông qua strimzi. Nó là 1 operator. Tiếp theo là bạn sẽ sử dụng dụng file để tạo ra 1 simple kafka. vì mình…

Read More “[Kafka/Strimzi] Install kafka cluster on k8s by Strimzi” »

Kafka

IBM MQ -> RabbitMQ -> Kafka ->Pulsar: How do message queue architectures evolve?

Posted on October 10, 2023 By nim No Comments on IBM MQ -> RabbitMQ -> Kafka ->Pulsar: How do message queue architectures evolve?
IBM MQ -> RabbitMQ -> Kafka ->Pulsar: How do message queue architectures evolve?

Nguồn: https://blog.bytebytego.com/i/137744340/ibm-mq-rabbitmq-kafka-pulsar-how-do-message-queue-architectures-evolve IBM MQ IBM MQ được ra mắt vào năm 1993. Ban đầu nó được gọi là MQSeries và được đổi tên thành WebSphere MQ vào năm 2002. Nó được đổi tên thành IBM MQ vào năm 2014. IBM MQ là một sản phẩm rất thành công, được sử dụng rộng rãi trong ngành…

Read More “IBM MQ -> RabbitMQ -> Kafka ->Pulsar: How do message queue architectures evolve?” »

Kafka Connect

[Kafka] This is how you produce and consume messages with Kafka

Posted on October 6, 2023 By nim No Comments on [Kafka] This is how you produce and consume messages with Kafka
[Kafka] This is how you produce and consume messages with Kafka

Một bức anh hay về kafka

Kafka

Wins from Effective Kafka Monitoring at Adobe: Stability, Performance, and Cost Savings

Posted on December 21, 2022 By nim No Comments on Wins from Effective Kafka Monitoring at Adobe: Stability, Performance, and Cost Savings
Wins from Effective Kafka Monitoring at Adobe: Stability, Performance, and Cost Savings

https://blog.developer.adobe.com/wins-from-effective-kafka-monitoring-at-adobe-stability-performance-and-cost-savings-a3ecb701ee5b Co-author: Eugen Nicolae Cojan As the father of quality management W. Edwards Deming, put it: “Without data, you are just another person with an opinion.” This post combines real-world issues faced by our team and our approach to addressing them. It also shares the key metrics to start monitoring Kafka client implementations effectively. Case studies…

Read More “Wins from Effective Kafka Monitoring at Adobe: Stability, Performance, and Cost Savings” »

Kafka

[Kafka/MSK] Install kafka or MSK on aws through terraform.

Posted on November 2, 2022July 18, 2024 By nim 2 Comments on [Kafka/MSK] Install kafka or MSK on aws through terraform.
[Kafka/MSK] Install kafka or MSK on aws through terraform.

1) Creating VPC Đầu tiên mình sẽ tạo vpc 2) Creating Security Group. 3) Declare variable and Create Kafka by terraform on AWS Tiếp đến là tạo msk hay còn gọi là kafka on aws Nếu bạn bị lỗi bên dưới Bạn phải khai báo:client_authentication_unauthenticated_enabled = true bạn cần chú ý số number_of_nodes nó phải…

Read More “[Kafka/MSK] Install kafka or MSK on aws through terraform.” »

AWS - Amazon Web Service, Kafka

[Kafka] How many partitions are enough in a topic on Kafka?

Posted on October 3, 2022March 4, 2024 By nim No Comments on [Kafka] How many partitions are enough in a topic on Kafka?
[Kafka] How many partitions are enough in a topic on Kafka?

Chúng ta cần set bao nhiều partion là phù hợp. Số partition không vượt quá số tổng CPU của các node vật lý.Số partition bằng 2 x nodeSố partitions = số pod trên k8s Bạn có thể tham khảo thêm bài viết này: https://viblo.asia/p/005-bao-nhieu-partition-la-du-cho-mot-topic-trong-apache-kafka-V3m5WQxQZO7

Kafka

[Lenses] Insert data or Push messages to Kafka via Lenses.

Posted on June 13, 2022 By nim No Comments on [Lenses] Insert data or Push messages to Kafka via Lenses.
[Lenses] Insert data or Push messages to Kafka via Lenses.

Bên mình sài lenses thì hôm này code 1 tool tự động reset các connector bị lỗi:API reference:https://api.lenses.io/ https://lenses.io/blog/2019/11/four-ways-to-produce-data-kafka-lenses/

Lenses

Posts pagination

1 2 … 5 Next
Tham Gia Group DevOps nhé!
Để Nim có nhiều động lực ra nhiều bài viết.
Để nhận được những thông báo mới nhất.

Recent Posts

  • [WordPress] Hướng dấn gửi mail trên WordPress thông qua gmail. June 15, 2025
  • [Bitbucket] Git Clone/Pull/Push with Bitbucket through API Token. June 12, 2025
  • [Teamcity] How to transfer the value from pipeline A to pipeline B June 9, 2025
  • [Windows] Remove the process that consumes too much CPU. June 3, 2025
  • Deploying Web-Based File Managers: File Browser and KubeFileBrowser with Docker and Kubernetes June 3, 2025

Archives

  • June 2025
  • May 2025
  • April 2025
  • March 2025
  • February 2025
  • January 2025
  • December 2024
  • November 2024
  • October 2024
  • September 2024
  • August 2024
  • July 2024
  • June 2024
  • May 2024
  • April 2024
  • March 2024
  • February 2024
  • January 2024
  • December 2023
  • November 2023
  • October 2023
  • September 2023
  • August 2023
  • July 2023
  • June 2023
  • May 2023
  • April 2023
  • March 2023
  • February 2023
  • January 2023
  • December 2022
  • November 2022
  • October 2022
  • September 2022
  • August 2022
  • July 2022
  • June 2022
  • May 2022
  • April 2022
  • March 2022
  • February 2022
  • January 2022
  • December 2021
  • November 2021
  • October 2021
  • September 2021
  • August 2021
  • July 2021
  • June 2021

Categories

  • BareMetal
    • NextCloud
  • CI/CD
    • Argo Events
    • ArgoCD
    • ArgoWorkflows
    • Git
      • Bitbucket
    • Harbor
    • Jenkins
    • Spinnaker
    • TeamCity
  • Coding
    • DevSecOps
    • Golang
    • Jquery & JavaScript
    • Laravel
    • NextJS 14 & ReactJS & Type Script
    • Python
    • Selenium
    • Terraform
      • AWS – Amazon Web Service
      • Azure Cloud
      • GCP – Google Cloud
  • Kubernetes & Container
    • Apache Kafka
      • Kafka
      • Kafka Connect
      • Lenses
    • Docker
    • Helm Chart
    • Isito-EnvoyFilter
    • Kong Gateway
    • Kubernetes
      • Ingress
      • Pod
    • Longhorn – Storage
    • MetalLB
    • OAuth2 Proxy
    • Vault
    • VictoriaMetrics
  • Log, Monitor & Tracing
    • DataDog
    • ELK
      • Kibana
      • Logstash
    • Fluent
    • Grafana
    • Prometheus
  • Uncategorized
  • Admin

Copyright © 2025 NimTechnology.