Sign in

Kai Waehner

The rise of data in motion in the insurance industry is visible across all lines of business, including life, healthcare, travel, vehicle, and others. Apache Kafka changes how enterprises rethink data. This blog post explores use cases and architectures for event streaming. Real-world examples from Generali, Centene, Humana, and Tesla show innovative insurance-related data integration and stream processing in real-time.

(Originally posted on Kai Waehner’s blog: “Data in Motion with Apache Kafka in the Insurance Industry”… Stay informed about new blog posts by subscribing to my newsletter)

Digital Transformation in the Insurance Industry

Most insurance companies have similar challenges:

  • Challenging market environments
  • Stagnating economy
  • Regulatory pressure


Many mission-critical use cases require low latency data processing. Running these workloads close to the edge is mandatory if the applications cannot run in the cloud. This blog post explores architectures for low latency deployments leveraging a combination of cloud-native infrastructure at the edge, such as AWS Wavelength, 5G networks from Telco providers, and event streaming with Apache Kafka to integrate and process data in motion.

The blog post is structured as follows:

  • Definition of “low latency data processing” and the relation to Apache Kafka
  • Cloud-native infrastructure for low latency computing
  • Low latency mission-critical use cases for Apache Kafka and…


This post explores use cases and architectures for processing data in motion with Apache Kafka in Industrial IoT (IIoT) across verticals such as automotive, energy, steel manufacturing, oil&gas, cybersecurity, shipping, logistics. Use cases include predictive maintenance, quality assurance, track and track, real-time locating system (RTLS), asset tracking, customer 360, and more. Examples include BMW, Bosch, Baader, Intel, Porsche, and Devon.

(Originally posted on Kai Waehner’s blog: “Kafka in Industrial IoT and Smart Factory Use Cases”… Stay informed about new blog posts by subscribing to my newsletter)

Why Kafka Is a Key Piece of the Evolution for Industrial IoT and Manufacturing

Industrial IoT was a mess of monolithic and proprietary technologies in the last decades…


Real-time beats slow data in most use cases across industries. The rise of event-driven architectures and data in motion powered by Apache Kafka enables enterprises to build real-time infrastructure and applications. This blog post explores why the Kafka API became the de facto standard API for event streaming like Amazon S3 for object storage, and the tradeoffs of these standards and corresponding frameworks, products, and cloud services.

(Originally posted on Kai Waehner’s blog: “Kafka == De Facto Standard API for Event Streaming”… Stay informed about new blog posts by subscribing to my newsletter)

Event-Driven Architecture: This Time It’s Not A Fad

The Forbes’ article “Event-Driven Architecture: This Time…


Apache Kafka became the de facto standard for event streaming. The open-source community is huge. Various vendors added Kafka and related tooling to their offerings or provide a Kafka cloud service. This blog post uses the car analogy — from the motor engine to the self-driving car — to explore the different Kafka offerings available on the market. I also cover a few other vehicles, meaning (partly) Kafka-compatible technologies. The goal is not a feature-by-feature comparison (that would be outdated the day after the publication). …


Apache Kafka and MQTT are a perfect combination for many IoT use cases. This blog series covers the pros and cons of both technologies. Various use cases across industries, including connected vehicles, manufacturing, mobility services, and smart city are explored. The examples use different architectures, including lightweight edge scenarios, hybrid integrations, and serverless cloud solutions. This post is part five: Smart City and 5G.

(Originally posted on Kai Waehner’s blog: “Kafka and MQTT for Smart City and 5G”… Stay informed about new blog posts by subscribing to my newsletter)

Apache Kafka + MQTT Blog Series

The first blog post explores…


Apache Kafka and MQTT are a perfect combination for many IoT use cases. This blog series covers the pros and cons of both technologies. Various use cases across industries, including connected vehicles, manufacturing, mobility services, and smart city are explored. The examples use different architectures, including lightweight edge scenarios, hybrid integrations, and serverless cloud solutions. This post is part four: Mobility Services and Transportation.

(Originally posted on Kai Waehner’s blog: “Kafka and MQTT for Transportation, Logistics, and Mobility Services (MaaS)”… Stay informed about new blog posts by subscribing to my newsletter)

Apache Kafka + MQTT Blog Series

The first blog…


Apache Kafka and MQTT are a perfect combination for many Industrial IoT use cases. This blog series covers the pros and cons of both technologies. Various use cases across industries, including connected vehicles, manufacturing, mobility services, and smart city are explored. The examples use different architectures, including lightweight edge scenarios, hybrid integrations, and serverless cloud solutions. This post is part three: Manufacturing, Industrial IoT, and Industry 4.0.

(Originally posted on Kai Waehner’s blog: “Kafka and MQTT for Industry 4.0 and Smart Factories”… Stay informed about new blog posts by subscribing to my newsletter)

Apache Kafka + MQTT Blog Series

The…


Apache Kafka and MQTT are a perfect combination for many IoT use cases. This blog series covers the pros and cons of both technologies. Various use cases across industries, including connected vehicles, manufacturing, mobility services, and smart city are explored. The examples use different architectures, including lightweight edge scenarios, hybrid integrations, and serverless cloud solutions. This post is part two: Connected Vehicles and V2X applications.

(Originally posted on Kai Waehner’s blog: “Kafka and MQTT Part 2of 5 — Connected Vehicles and V2X”… Stay informed about new blog posts by subscribing to my newsletter)

Apache Kafka + MQTT Blog Series

The first blog post explores the relation…


Apache Kafka and MQTT are a perfect combination for many IoT use cases. This blog series covers the pros and cons of both technologies. Various use cases across industries, including connected vehicles, manufacturing, mobility services, and smart city are explored. The examples use different architectures, including lightweight edge scenarios, hybrid integrations, and serverless cloud solutions. This post is part one: Overview and Comparison.

(Originally posted on Kai Waehner’s blog: “Kafka and MQTT Part 1 of 5 — Comparison and Overview”… Stay informed about new blog posts by subscribing to my newsletter)

Gartner predicts: “Around 10% of enterprise-generated data is created…

Kai Waehner

Technology Evangelist — www.kai-waehner.de →Big Data Analytics, Machine Learning / Deep Learning, , Middleware, Microservices => www.linkedin.com/in/megachucky

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store