A Kafka sink that emits bounded structured records and periodic counters to stdout for inspection in WME Worker Runtime.
Use Docker Compose from GitHub, branch main, with a Kafka input. CONSUMER_GROUP_ID is required; give concurrent manifests unique groups if each should see all records.
Parameters: CONSUMER_GROUP_ID, AUTO_OFFSET_RESET (earliest), LOG_FORMAT (json or text), comma-separated INCLUDE_FIELDS, MAX_VALUE_LENGTH (1000), and SUMMARY_INTERVAL_SECONDS (30). Values are bounded and configuration is never logged.
Example input: {"assetId":"pump-1","metric":"temperature","value":42}. The runtime log includes its partition, offset, and selected value fields.
Development: pip install -r requirements-dev.txt && ruff check . && pytest; then docker compose config && docker compose build.
Apache-2.0 licensed.