KxSystems/kafka ↗
Created May 3, 2024 · View the KxSystems/kafka repository page
kdb+ to Apache Kafka adapter, for pub/sub
Want this for your repo?
Render a free sample of any GitHub repo in seconds.
Contributors
11
Lines of Code
459
From
May 31, 2017
To
Apr 29, 2024
About KxSystems/kafka
kfk is a thin wrapper library that connects kdb+, a high-performance time-series database, to Apache Kafka for publish-subscribe messaging. Built as part of Kx Systems' Fusion interface collection, it wraps the librdkafka C API to enable kdb+ applications to produce and consume Kafka messages seamlessly.
The interface is written in C and supports 32- and 64-bit macOS and Linux, as well as 64-bit Windows. It allows developers working with kdb+ to integrate event streaming capabilities, making it possible to ingest real-time data from Kafka topics or publish kdb+ data to Kafka for downstream consumption. The project includes comprehensive API documentation, installation guides, and example setups to help users get started.
kfk is distributed under an Apache 2.0 license and is actively maintained by Kx Systems. The project documentation references performance tuning strategies from librdkafka's wiki, emphasizing that users can configure numerous options to optimize latency and throughput based on their specific deployment requirements.
