Open-source LLMs, FlashAttention and generative AI terminology: Host Jon Krohn gives us the lift we need to explore the next big steps in generative AI. Listen to the specific way in which Stanford University’s “exact attention” algorithm, FlashAttention, could become a competitor for GPT-4’s capabilities. Additional materials: www.superdatascience.com/684 Interested in sponsoring a SuperDataScience Podcast episode? Visit JonKrohn.com/podcast for sponsorship information.

684: Get More Language Context out of your LLM

The Super Data Science podcast with Jon Krohn brings you the latest and most
important machine learning, artificial intelligence, and broader data-world
topics from across both academia and industry. As the quantity of data on our
planet doubles every couple of years and this trend is set to continue for
decades to come, there's an unprecedented opportunity for you to make an
enormous impact in your lifetime. Whether you're curious about getting started
in a data career or you're a deep technical expert, whether you'd like to
understand what A.I. is or you'd like to integrate more data-driven processes
into your business, we have inspiring guests and lighthearted conversation for
you to enjoy. We cover tools, techniques, and implementation tricks across data
collection, databases, analytics, predictive modeling, visualization, software
engineering, real-world applications, and commercialization − everything you
need to crush it with data science.