Apache Kafka
Apache Kafka is a distributed streaming platform that:
- Lets you publish and subscribe to streams of records. In this respect it is similar to a message queue or enterprise messaging system.
- Lets you store streams of records in a fault-tolerant way.
- Lets you process streams of records as they occur.
Installation
Install the kafka package.
Start kafka.service, which should also automatically start/enable zookeeper@kafka.service as well.
Confluent Platform
To use the Confluent Platform or Confluent Server, install the confluent-platformAUR package. confluent-platformAUR install the following services:
- ksqlDB -
confluent-ksqldb.service - Schema Registry -
confluent-schema-registry.service - REST Proxy -
confluent-kafka-rest.service - Confluent Control Center -
confluent-control-center.service - Confluent Server -
confluent-server.service
Usage
For usage see official documentation
Clients
- C - librdkafka-gitAUR
- PHP - php-rdkafkaAUR
- Python - https://github.com/dpkp/kafka-python
- .Net - https://github.com/confluentinc/confluent-kafka-dotnet
- Go - https://github.com/confluentinc/confluent-kafka-go
For additional clients, see the official client list.