![Reimplementing Apache Kafka with Golang and S3 image](https://media.zencastr.com/cdn-cgi/image/width=640,quality=85/image-files/619e48a9649c44004c5a44e8/b48b05c0-4f7b-45fc-a5cd-6c27c1406f87.png)
This week on Developer Voices we’re talking to Ryan Worl, whose career in big data engineering has taken him from DataDog to Co-Founding WarpStream, an Apache Kafka-compatible streaming system that uses Golang for the brains and S3 for the storage.
Ryan tells us about his time at DataDog, along with the things he learnt from doing large-scale systems migration bit-by-bit, before we discuss how and why he started WarpStream. Why re-implement Kafka? What are the practical challenges and cost benefits of moving all your storage to S3? And would he choose Go a second time around?
--
WarpStream: https://www.warpstream.com/
DataDog: https://www.datadoghq.com/
Ryan on Twitter: https://x.com/ryanworl
Kris on Mastodon: http://mastodon.social/@krisajenkins
Kris on LinkedIn: https://www.linkedin.com/in/krisjenkins/
Kris on Twitter: https://twitter.com/krisajenkins
![NATS & Jetstream: The System Communication Toolkit (with Jeremy Saenz) image](https://media.zencastr.com/cdn-cgi/image/width=90,quality=85/image-files/619e48a9649c44004c5a44e8/b48b05c0-4f7b-45fc-a5cd-6c27c1406f87.png)
![Cuis Smalltalk and the History of Computing’s Future (with Juan Vuletich) image](https://media.zencastr.com/cdn-cgi/image/width=90,quality=85/image-files/619e48a9649c44004c5a44e8/b48b05c0-4f7b-45fc-a5cd-6c27c1406f87.png)
![The Inko Programming Language, and Life as a Language Designer (with Yorick Peterse) image](https://media.zencastr.com/cdn-cgi/image/width=90,quality=85/image-files/619e48a9649c44004c5a44e8/b48b05c0-4f7b-45fc-a5cd-6c27c1406f87.png)
![Extending Postgres for High-Performance Analytics (with Philippe Noël) image](https://media.zencastr.com/cdn-cgi/image/width=90,quality=85/image-files/619e48a9649c44004c5a44e8/b48b05c0-4f7b-45fc-a5cd-6c27c1406f87.png)
![ByteWax: Rust's Research Meets Python's Practicalities (with Dan Herrera) image](https://media.zencastr.com/cdn-cgi/image/width=90,quality=85/image-files/619e48a9649c44004c5a44e8/b48b05c0-4f7b-45fc-a5cd-6c27c1406f87.png)
![Mojo Lang - Tomorrow's High Performance Python? (with Chris Lattner) image](https://media.zencastr.com/cdn-cgi/image/width=90,quality=85/image-files/619e48a9649c44004c5a44e8/b48b05c0-4f7b-45fc-a5cd-6c27c1406f87.png)
![How Apache Pinot Achieves 200,000 Queries per Second (with Tim Berglund) image](https://media.zencastr.com/cdn-cgi/image/width=90,quality=85/image-files/619e48a9649c44004c5a44e8/b48b05c0-4f7b-45fc-a5cd-6c27c1406f87.png)
![Neovim: Creating, Curating and Customising your Ideal Editor (with TJ DeVries) image](https://media.zencastr.com/cdn-cgi/image/width=90,quality=85/image-files/619e48a9649c44004c5a44e8/b48b05c0-4f7b-45fc-a5cd-6c27c1406f87.png)
![Automate Your Way to Better Code: Advanced Property Testing (with Oskar Wickström) image](https://media.zencastr.com/cdn-cgi/image/width=90,quality=85/image-files/619e48a9649c44004c5a44e8/b48b05c0-4f7b-45fc-a5cd-6c27c1406f87.png)
![If You Want Better Code, Do It For Me (with Jonathan Schneider) image](https://media.zencastr.com/cdn-cgi/image/width=90,quality=85/image-files/619e48a9649c44004c5a44e8/b48b05c0-4f7b-45fc-a5cd-6c27c1406f87.png)
![Implementing Hardware-Friendly Databases (with DuckDB co-creator, Hannes Mühleisen) image](https://media.zencastr.com/cdn-cgi/image/width=90,quality=85/image-files/619e48a9649c44004c5a44e8/b48b05c0-4f7b-45fc-a5cd-6c27c1406f87.png)