Skip to content

LogMan.io Event Deduplication Configuration

Model

To start the application, include it in model and click on Apply button.

/Site/model.yaml
define:
  type: rc/model

services:
  lmio-ededup:
    - <node>  # Replace with name of the node

Example

LMIO Ededup requires following dependencies:

  • Apache ZooKeeper
  • Apache Kafka

This is the minimalistic example of the LogMan.io Event Deduplication configuration:

[web]
listen = :28964

[zookeeper]
servers=zookeeper-1:2181,zookeeper-2:2181,zookeeper-3:2181

[kafka]
bootstrap_servers=kafka-1:9092,kafka-2:9092,kafka-3:9092

Frames

Frames are network interfaces that listen for incoming connections. By default, LMIO Ededup has one frame configured that listens on port 8964. You can change the listening address and port by setting the listen parameter in the [frame] section of the configuration file.

[frame]
listen=:8964

Time window

Time window is the time period during which duplicate events are identified and removed.

The default time windows is 5 minutes. You can change it by setting the window parameter in the [general] section of the configuration file. The value is a duration string, e.g., 10s, 5m, 1h.

[general]
window=5m