Ray: Navigating the New AI Infra Challenges
AI changed dramatically over the past few years, leading to far greater complexity in AI infrastructure. As challenging as the current state of affairs is, AI continues to evolve and AI infrastructure challenges continue to grow.
This talk highlights some of the most important trends in AI infrastructure and the challenges that are emerging around the corner, ranging from the continued importance of scaling laws, the rise of data-intensive AI, and the growth in inference-time compute and complexity. As a consequence, AI infrastructure will be on the critical path for AI adoption going forward.
Robert Nishihara
CEO & Co-Founder at Anyscale
Robert grew up in the San Francisco Bay Area, where he spent my free time skateboarding and thinking about uncountable infinities. These interests led him to study mathematics at Harvard where he was an undergraduate. When he realized that artificial intelligence can provide tools to solve a variety of problems, he joined the Harvard Intelligent Probabilistic Systems group. He is broadly interested in applied math, machine learning, and optimization. He is currently working on Ray, a high-performance distributed execution framework for AI applications.