week_6_stream_processing

Introduction to Kafka

Slides

• Video: Intro to Kafka
• Video: Configuration Terms
• Video: Avro and schema registry

Configuration

Please take a look at all configuration from kafka here.

Docker

Starting cluster

docker-compose up

Command line for Kafka

Create topic

./bin/kafka-topics.sh --create --topic demo_1 --bootstrap-server localhost:9092 --partitions 2

KStreams

• Slides
• Concepts

• Video: KStream basics
• Video: KStream Join and windowing
• Video: KStream advance features

Python Faust

• Faust Doc
• KStream vs Faust

JVM library

• Confluent Kafka Stream
• Example

Kafka Connect and KSQL

• Video: Kafka connect and KSQL

Kafka connect

• Blog post

Homework

Form

The homework is mostly theoretical. In the last question you have to provide working code link, please keep in mind that this question is not scored.

Deadline: 14 March, 22:00 CET

Community notes

Did you take notes? You can share them here.

• Notes by Alvaro Navas
• Add your notes here (above this line)