815: DataFrame Operations 100x Faster than Pandas, with Marco Gorelli

Polars, Python, Narwhals, Rust, and Pandas: Marco Gorelli talks to Jon Krohn about the many ways to use the newest data libraries available, the joys of open-source development, and the best method to win prizes in forecasting competitions.

This episode is brought to you by AWS Inferentia and AWS Trainium, by Babbel, the science-backed language-learning platform, and by Gurobi, the Decision Intelligence Leader. Interested in sponsoring a SuperDataScience Podcast episode? Email [email protected] for sponsorship information.

In this episode you will learn:

• When to use Polars vs Pandas [08:26]

• How Polars optimizes string operations and data processing [20:08]

• Where Narwhals outstrips Polars and Pandas [48:37]

• The benefits of using Altair [55:21]

• Addressing the lack of women in data science [1:09:58]

• How to win a forecasting competition [1:16:58]

Additional materials: www.superdatascience.com/815