Kafka Streams - 3 blogs
This meta-blog focusses on 3 blogs on Kafka Streams that I wrote way back in 2018, when I was still learning Kafka!
Apache Kafka Streams is a framework for stream data processing. In this blog, we introduce Kafka Streams concepts, streams processor topologies, the Kafka Streams DSL stream and table abstractions and operations, and take a look at one of the DSL operations, Joins, in more detail.
In this blog, we develop a more complex streams application to keep track of the weight of goods in trucks for our Kongo IoT demonstration application. During the journey we encounter topology exceptions, and find a useful streams topology mapping tool to help fix the problems. We also employ some transactional “Magic Pixie Dust” to prevent truck weights from going negative and possibly floating away.
Dr. Black has been murdered in the billiard room with a candlestick! Whodunnit?! There are six suspects and a mansion with multiple rooms. Assuming everyone has a means and a motive for murder, we’ll focus on using Kafka streams to discover who has an alibi (and who doesn’t!) as they move around the mansion.