stream-compress

Stream Compresses event data stream.

Unlike decompression processors, the compression algorithm must be selected. Optionally the compression level can be specified for algotithms which support it (example Zstandard with level 0). The following compression post-processors are supported. Each format can be configured as a postprocessor.

In contrast to the Compression preprocessor, which compresses the entire event data as a single blob the stream-compress postprocessor compresses the event data stream of events until the stream is marked as finished. Supported formats:

Name	Algorithm / Format
xz2	Xz2 level 9 (default)
zstd	Zstandard (defaults to level 0)

Example configuration:

Xz compression example with compression level:

postprocessors = [
  {
    "name": "stream-compress",
    "config": {
      "algotithm":"xz2",
      "level": 3
    }
  }
]

Xz compression example without compression level defaults to level 9:

postprocessors = [
  {
    "name": "stream-compress",
    "config": {
      "algorithm":"xz2"
    }
  }
]

Xz compression when wrong compression level is specified gives an Err.