My Data Streaming Journey with Kafka & Flink: 7 Years at Confluent

Kai Waehner
12 min readAug 16, 2024

Time flies… I joined Confluent seven years ago when Apache Kafka was mainly used by a few tech giants and the company had ~100 employees. This blog post explores my data streaming journey, including Kafka becoming a de facto standard for over 100,000 organizations, Confluent doing an IPO on the NASDAQ stock exchange, 5000+ customers adopting a data streaming platform, and emerging new design approaches and technologies like data mesh, GenAI, and Apache Flink. I look at the past, present and future of my personal data streaming journey. Both, from the evolution of technology trends and the journey as a Confluent employee that started in a Silicon Valley startup and is now part of a global software and cloud company.

Disclaimer: Everything in this article reflects my personal opinions. This is particularly important when you talk about the outlook of a publicly listed company.

(Originally posted on Kai Waehner’s blog: “My Data Streaming Journey with Kafka & Flink: 7 Years at Confluent”… Join the data streaming community and stay informed about new blog posts by subscribing to my newsletter)

PAST: Apache Kafka is pretty much unknown outside of Silicon Valley in 2017

--

--

Kai Waehner

Technology Evangelist — www.kai-waehner.de → Big Data Analytics, Data Streaming, Apache Kafka, Middleware, Microservices => linkedin.com/in/kaiwaehner