Skip to content

NimTechnology

Trình bày các công nghệ CLOUD một cách dễ hiểu.

  • Kubernetes & Container
    • Docker
    • Kubernetes
      • Ingress
      • Pod
    • Helm Chart
    • OAuth2 Proxy
    • Isito-EnvoyFilter
    • Apache Kafka
      • Kafka
      • Kafka Connect
      • Lenses
    • Vault
    • Longhorn – Storage
    • VictoriaMetrics
    • MetalLB
    • Kong Gateway
  • CI/CD
    • ArgoCD
    • ArgoWorkflows
    • Argo Events
    • Spinnaker
    • Jenkins
    • Harbor
    • TeamCity
    • Git
      • Bitbucket
  • Coding
    • DevSecOps
    • Terraform
      • GCP – Google Cloud
      • AWS – Amazon Web Service
      • Azure Cloud
    • Golang
    • Laravel
    • Python
    • Jquery & JavaScript
    • Selenium
  • Log, Monitor & Tracing
    • DataDog
    • Prometheus
    • Grafana
    • ELK
      • Kibana
      • Logstash
  • BareMetal
    • NextCloud
  • Toggle search form

[Coralogix] Filter or Custom log when using Coralogix.

Posted on December 8, 2023December 12, 2023 By nim No Comments on [Coralogix] Filter or Custom log when using Coralogix.

trường hợp là như thế này.

team bạn push log lên coralogix. trong body nó có 1 trường là time_ms = xxx
Team muốn nhờ devops based on that value để vẽ lên one graph

trong coralogix có 1 tính năng là Log Parsing Rules

Bạn có thể tách nó ra thành 1 field.

Bạn sẽ chọn extract

time\_ms=(?P<time_ms>\d+)

Giở bạn cần test bằng copy 1 sample log, bằng cách dưới.

Giờ bạn quay lại parsing rule and recheck:

Tiếp đến bạn nhấn save.

sau thời gian đợi có log mới đã push lên thì time_ms đã có 1 field

—> continue …

How to find out the right regEx

Mình sẽ cho bạn một cái promt:

Only generate regex pattern to extract number of 'time_ms' to a JSON field. 

-example log: {"resource":{"attributes":{"k8s.container.name":"argocd-application-controller","k8s.container.restart_count":"0","k8s.namespace.name":"argocd","k8s.node.name":"k8s-worker1","k8s.pod.name":"argocd-application-controller-0","k8s.pod.uid":"543d7e96-3488-4c27-adc3-e7afdae0c3f7","k8s.statefulset.name":"argocd-application-controller"}},"scope":{"attributes":{}},"logRecord":{"attributes":{"cluster_name":"nimtechnology-k0s","log.file.path":"\/var\/log\/pods\/argocd_argocd-application-controller-0_543d7e96-3488-4c27-adc3-e7afdae0c3f7\/argocd-application-controller\/0.log","log.iostream":"stderr","logtag":"F","time":"2023-12-08T01:17:35.733171764Z"},"body":"time=\"2023-12-08T01:17:35Z\" level=info msg=\"Reconciliation completed\" application=argocd\/kubecost dedup_ms=0 dest-name= dest-namespace=kubecost dest-server=\"https:\/\/kubernetes.default.svc\" diff_ms=723 fields.level=2 git_ms=204 health_ms=2 live_ms=11 patch_ms=14 setop_ms=0 settings_ms=0 sync_ms=0 time_ms=1085","observedTimeUnixNano":1701998255880908107,"timeUnixNano":1701998255733171764}}

-example regex: op_msg\s+(?P<op_msg>\d+)

Bạn sử dụng chatgpt để tìm ra regex hợp lý.

Log, Monitor & Tracing

Post navigation

Previous Post: [Monitoring] Understanding Different Types of Metrics in Monitoring Systems: Gauge, Counter, Histogram, and Summary
Next Post: [Script] Create a large file with a depth of 50 folders and 100,000 child files; the max size is 1GB.

More Related Articles

[Elastic] Install Elasticsearch through package manager. ELK
[OpenVPN] How do you monitor Your OpenVPN-Server via Prometheus and Grafana Grafana
[Prometheus] TIP – Custom Prometheus Log, Monitor & Tracing
[coralogix/OpenTelemetry] Monitor Your K8s by Coralogix and OpenTelemetry Collector. Log, Monitor & Tracing
[Grafana] Graph(old) – Hiện thị chart và table thông tin Grafana
[Grafana] Hướng dấn tạo Menu Dropdown trên Grafana Grafana

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Tham Gia Group DevOps nhé!
Để Nim có nhiều động lực ra nhiều bài viết.
Để nhận được những thông báo mới nhất.

Recent Posts

  • [AWS/EKS] Cache Docker image to accelerate EKS container deployment. July 10, 2025
  • [Laravel] Laravel Helpful June 26, 2025
  • [VScode] Hướng dẫn điều chỉnh font cho terminal June 20, 2025
  • [WordPress] Hướng dấn gửi mail trên WordPress thông qua gmail. June 15, 2025
  • [Bitbucket] Git Clone/Pull/Push with Bitbucket through API Token. June 12, 2025

Archives

  • July 2025
  • June 2025
  • May 2025
  • April 2025
  • March 2025
  • February 2025
  • January 2025
  • December 2024
  • November 2024
  • October 2024
  • September 2024
  • August 2024
  • July 2024
  • June 2024
  • May 2024
  • April 2024
  • March 2024
  • February 2024
  • January 2024
  • December 2023
  • November 2023
  • October 2023
  • September 2023
  • August 2023
  • July 2023
  • June 2023
  • May 2023
  • April 2023
  • March 2023
  • February 2023
  • January 2023
  • December 2022
  • November 2022
  • October 2022
  • September 2022
  • August 2022
  • July 2022
  • June 2022
  • May 2022
  • April 2022
  • March 2022
  • February 2022
  • January 2022
  • December 2021
  • November 2021
  • October 2021
  • September 2021
  • August 2021
  • July 2021
  • June 2021

Categories

  • BareMetal
    • NextCloud
  • CI/CD
    • Argo Events
    • ArgoCD
    • ArgoWorkflows
    • Git
      • Bitbucket
    • Harbor
    • Jenkins
    • Spinnaker
    • TeamCity
  • Coding
    • DevSecOps
    • Golang
    • Jquery & JavaScript
    • Laravel
    • NextJS 14 & ReactJS & Type Script
    • Python
    • Selenium
    • Terraform
      • AWS – Amazon Web Service
      • Azure Cloud
      • GCP – Google Cloud
  • Kubernetes & Container
    • Apache Kafka
      • Kafka
      • Kafka Connect
      • Lenses
    • Docker
    • Helm Chart
    • Isito-EnvoyFilter
    • Kong Gateway
    • Kubernetes
      • Ingress
      • Pod
    • Longhorn – Storage
    • MetalLB
    • OAuth2 Proxy
    • Vault
    • VictoriaMetrics
  • Log, Monitor & Tracing
    • DataDog
    • ELK
      • Kibana
      • Logstash
    • Fluent
    • Grafana
    • Prometheus
  • Uncategorized
  • Admin

Copyright © 2025 NimTechnology.