Extending Kubernetes for AI | Lessons Learned From Platform... - Susan, Lucy, Andrea, Etienne, Tim
Susan, Lucy, Andrea, Etienne, Tim
KubeCon + CloudNativeCon Europe 2025 · Session
This KubeCon EU panel discussion, "Extending Kubernetes for AI," brought together a diverse group of experts from Google Cloud, Uber, Weaviate, Overstory, and SchedMD to explore the intricate challenges and innovative solutions in adapting Kubernetes for the demanding landscape of Artificial Intelligence and Machine Learning (AI/ML) workloads. Moderated by Susan Woo from Google Cloud, the panel delved into how organizations, ranging from hyper-scale enterprises to agile startups, are customizing and extending Kubernetes to meet the unique requirements of AI/ML, covering everything from resource allocation and stateful applications to multi-tenancy and the economics of GPU management.
AI review
This panel provided a robust and highly informative deep dive into the practical challenges and cutting-edge solutions for running AI/ML workloads on Kubernetes. Featuring highly credible speakers, including upstream Kubernetes contributors and CTOs from companies actively deploying AI at scale, the discussion goes beyond platitudes to cover critical topics like GPU economics, stateful application management, and the implications of new Kubernetes features like DRRA and in-place vertical scaling. Attendees gained actionable insights into platform engineering strategies, resource…