![ByteWax: Rust's Research Meets Python's Practicalities (with Dan Herrera) image](https://media.zencastr.com/cdn-cgi/image/width=640,quality=85/image-files/619e48a9649c44004c5a44e8/b48b05c0-4f7b-45fc-a5cd-6c27c1406f87.png)
Bytewax is a curious stream processing tool that blends a Python surface with a Rust core to produce something that’s in a similar vein to Kafka Streams or Apache Flink, but with a fundamentally different implementation. This week we’re going to take a look at what it does, how it works in theory, and how the marriage of Python and Rust works in practice…
–
The original Naiad Paper: https://dl.acm.org/doi/10.1145/2517349.2522738
Timely Dataflow: https://github.com/TimelyDataflow/timely-dataflow
Bytewax the Library: https://github.com/bytewax/bytewax
Bytewax the Service: https://bytewax.io/
PyO3, for calling Rust from Python: https://pyo3.rs/v0.21.2/
Kris on Mastodon: http://mastodon.social/@krisajenkins
Kris on LinkedIn: https://www.linkedin.com/in/krisjenkins/
Kris on Twitter: https://twitter.com/krisajenkins
--
#softwaredevelopment #dataengineering #apachekafka #timelydataflow
![Cuis Smalltalk and the History of Computing’s Future (with Juan Vuletich) image](https://media.zencastr.com/cdn-cgi/image/width=90,quality=85/image-files/619e48a9649c44004c5a44e8/b48b05c0-4f7b-45fc-a5cd-6c27c1406f87.png)
![The Inko Programming Language, and Life as a Language Designer (with Yorick Peterse) image](https://media.zencastr.com/cdn-cgi/image/width=90,quality=85/image-files/619e48a9649c44004c5a44e8/b48b05c0-4f7b-45fc-a5cd-6c27c1406f87.png)
![Extending Postgres for High-Performance Analytics (with Philippe Noël) image](https://media.zencastr.com/cdn-cgi/image/width=90,quality=85/image-files/619e48a9649c44004c5a44e8/b48b05c0-4f7b-45fc-a5cd-6c27c1406f87.png)
![Mojo Lang - Tomorrow's High Performance Python? (with Chris Lattner) image](https://media.zencastr.com/cdn-cgi/image/width=90,quality=85/image-files/619e48a9649c44004c5a44e8/b48b05c0-4f7b-45fc-a5cd-6c27c1406f87.png)
![How Apache Pinot Achieves 200,000 Queries per Second (with Tim Berglund) image](https://media.zencastr.com/cdn-cgi/image/width=90,quality=85/image-files/619e48a9649c44004c5a44e8/b48b05c0-4f7b-45fc-a5cd-6c27c1406f87.png)
![Neovim: Creating, Curating and Customising your Ideal Editor (with TJ DeVries) image](https://media.zencastr.com/cdn-cgi/image/width=90,quality=85/image-files/619e48a9649c44004c5a44e8/b48b05c0-4f7b-45fc-a5cd-6c27c1406f87.png)
![Automate Your Way to Better Code: Advanced Property Testing (with Oskar Wickström) image](https://media.zencastr.com/cdn-cgi/image/width=90,quality=85/image-files/619e48a9649c44004c5a44e8/b48b05c0-4f7b-45fc-a5cd-6c27c1406f87.png)
![If You Want Better Code, Do It For Me (with Jonathan Schneider) image](https://media.zencastr.com/cdn-cgi/image/width=90,quality=85/image-files/619e48a9649c44004c5a44e8/b48b05c0-4f7b-45fc-a5cd-6c27c1406f87.png)
![Implementing Hardware-Friendly Databases (with DuckDB co-creator, Hannes Mühleisen) image](https://media.zencastr.com/cdn-cgi/image/width=90,quality=85/image-files/619e48a9649c44004c5a44e8/b48b05c0-4f7b-45fc-a5cd-6c27c1406f87.png)
![Verse, Haskell & Core Language Design (with Simon Peyton Jones) image](https://media.zencastr.com/cdn-cgi/image/width=90,quality=85/image-files/619e48a9649c44004c5a44e8/b48b05c0-4f7b-45fc-a5cd-6c27c1406f87.png)