atoti_kafka.KafkaStream

final class atoti_kafka.KafkaStream

Consume a Kafka topic and stream its records in the table.

The records’ key deserializer default to StringDeserializer.

The records’ message must be a JSON object with columns’ name as keys.

See also

The other DataStream implementations.

batch_duration: timedelta = datetime.timedelta(seconds=1)

Time spent batching received events before publishing them to the table in a single transaction.

bootstrap_server: str

host[:port] that the consumer should contact to bootstrap initial cluster metadata.

consumer_config: Mapping[str, str] = {}

Mapping containing optional parameters to set up the KafkaConsumer.

The list of available params can be found here.

group_id: str

The name of the consumer group to join.

topic: str

Topic to subscribe to.