Skip to content

NimTechnology

Trình bày các công nghệ CLOUD một cách dễ hiểu.

  • Kubernetes & Container
    • Docker
    • Kubernetes
      • Ingress
    • Helm Chart
    • Isito-EnvoyFilter
    • Apache Kafka
      • Kafka
      • Kafka Connect
      • Lenses
    • Vault
    • Longhorn – Storage
    • VictoriaMetrics
  • CI/CD
    • ArgoCD
    • ArgoWorkflows
    • Spinnaker
    • Jenkins
  • Coding
    • Terraform
      • GCP – Google Cloud
      • AWS – Amazon Web Service
    • Golang
    • Laravel
    • Jquery & JavaScript
    • Git
    • Selenium
  • Log & Monitor
    • Prometheus
    • Grafana
    • ELK
      • Kibana
      • Logstash
  • BareMetal
  • Toggle search form

[Lenses/kafka] Fix the problem “Cannot extract connector information from the configuration provided” when creating connector Kafka-connect

Posted on February 23, 2022April 3, 2022 By nim No Comments on [Lenses/kafka] Fix the problem “Cannot extract connector information from the configuration provided” when creating connector Kafka-connect

Nếu bạn sửa dụng kafka-connect mà sẽ cần add thêm rất nhiều plugin vào server kafka-connect.
Mình đang gặp vấn đề có 1 vài plugin lenses ko thể validate được.

Ví dụ như plugin này: MongoDB Connector (Source and Sink)

khi mình create 1 connector có hiện tượng sau:

Cannot extract connector information from the configuration provided.
Lenses kafka
Lenses can’t validate a few plugin of Kafka-connect

Có 1 người anh chỉ mình:
https://docs.lenses.io/5.0/configuration/static/options/topology/#configure-lenses-to-load-a-custom-connector

chúng ta cần Configure Lenses to load a custom connector

Nếu bạn chạy docker compose thì

version: '3'
services:
  lenses:
    image: lensesio/lenses:latest
    container_name: lenses
    ...
    environment:
      ...
      LENSES_CONNECTORS_INFO: |
        [
            {
            class.name = "com.splunk.kafka.connect.SplunkSinkConnector"
            name = "Splunk Sink",
            instance = "splunk.hec.uri"
            sink = true,
            extractor.class = "io.lenses.config.kafka.connect.SimpleTopicsExtractor"
            icon = "splunk.png",
            description = "Stores Kafka data in Splunk"
            docs = "https://github.com/splunk/kafka-connect-splunk",
            author = "Splunk"
            },
            {
            class.name = "io.debezium.connector.sqlserver.SqlServerConnector"
            name = "CDC MySQL"
            instance = "database.hostname"
            sink = false,
            property = "database.history.kafka.topic"
            extractor.class = "io.lenses.config.kafka.connect.SimpleTopicsExtractor"
            icon = "debezium.png"
            description = "CDC data from RDBMS into Kafka"
            docs = "//debezium.io/docs/connectors/mysql/",
            author = "Debezium"
            }
        ]
    ...

LENSES_CONNECTORS_INFO

[
  {
  class.name = "com.mongodb.kafka.connect.MongoSourceConnector"
  name = "MongoSourceConnector"
  instance = "mongo.source.offical"
  sink = false
  extractor.class = "io.lenses.config.kafka.connect.SimpleTopicsExtractor"
  icon= "mongodb.png"
  description = "Mongo Offical source connector"
  author = "Mongodb team"
  property = "topic"
  }
]

với deployment trên kubenetes thì cũng y chang nhé các bạn.
Mình sài rancher nên easy lắm

Nhiều anh em sẽ hỏi là sao biêt được tên của file icon.

mình dùng thủ thuật tìm số ảnh có sẵn he
hiện tại thi ở như trong ảnh
Apache Kafka, Lenses

Post navigation

Previous Post: [Kafka] UI control Kafka, Kafka-connect, … It’s akhq.io
Next Post: [Kafka-connect] Single Message Transform: lesson 4 – RegexRouter – change topic name.

More Related Articles

[Kafka-connect] Install lenses to manage Kafka. Apache Kafka
[Kafka] Kafka Console Producer CLI. Apache Kafka
[Kafka-connect] Streaming the data of MongoDB through Kafka-connect into topic Kafka. Apache Kafka
[Kafka-connect] A few APIs are helpful in Kafka-connect. Apache Kafka
[Kafka-connect] Single Message Transform: lesson 9 – Cast Apache Kafka
[Kafka-connect] Single Message Transform: lesson 1 – InsertField in Sink Apache Kafka

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Tham Gia Group DevOps nhé!
Để Nim có nhiều động lực ra nhiều bài viết.
Để nhận được những thông báo mới nhất.

Recent Posts

  • [Argocd/Vault] Integrate Vault inside Argocd by the plugin July 1, 2022
  • [Vault] Using Service Acount of Kubernetes to login Vault system. June 28, 2022
  • Protected: My Assignment  June 24, 2022
  • [Spinnaker] Spinnaker writes too many logs – Reduce spinnaker log level June 22, 2022
  • [Jenkins] Jobs will be created automatically by Jenkins Job Builder June 20, 2022

Archives

  • July 2022
  • June 2022
  • May 2022
  • April 2022
  • March 2022
  • February 2022
  • January 2022
  • December 2021
  • November 2021
  • October 2021
  • September 2021
  • August 2021
  • July 2021
  • June 2021

Categories

  • BareMetal
  • CI/CD
    • ArgoCD
    • ArgoWorkflows
    • Jenkins
    • Spinnaker
  • Coding
    • Git
    • Golang
    • Jquery & JavaScript
    • Laravel
    • Selenium
    • Terraform
      • AWS – Amazon Web Service
      • GCP – Google Cloud
  • Kubernetes & Container
    • Apache Kafka
      • Kafka
      • Kafka Connect
      • Lenses
    • Docker
    • Helm Chart
    • Isito-EnvoyFilter
    • Kubernetes
      • Ingress
    • Longhorn – Storage
    • Vault
    • VictoriaMetrics
  • Log & Monitor
    • ELK
      • Kibana
      • Logstash
    • Grafana
    • Prometheus
  • Uncategorized
  • Admin

Copyright © 2022 NimTechnology.