The Explorer's Guide To Cloud Native GenAI Platform Engineering - Max Körbächer & Alexa Griffith
Max Körbächer, Alexa Griffith
KubeCon + CloudNativeCon Europe 2025 · Session
This talk, "The Explorer's Guide To Cloud Native GenAI Platform Engineering," presented by Max Körbächer and Alexa Griffith, a Senior Software Engineer at Bloomberg, provides a comprehensive journey through the evolving landscape of Generative AI (GenAI) within the cloud-native ecosystem. The speakers highlight the explosive growth and rapid changes in the AI domain, emphasizing the critical role of platform engineering in enabling organizations to adopt and manage GenAI workloads effectively on Kubernetes. The core premise is that while individual tools and large-scale platforms exist, the journey of integrating these components into a flexible, scalable, and user-friendly GenAI platform often remains obscure.
AI review
This talk provides an exceptionally detailed and actionable guide to building cloud-native GenAI platforms on Kubernetes. It effectively navigates the complexities of GenAI deployment, introducing a new open-source Envoy AI Gateway for centralized LLM management and cost monitoring, and delving into advanced optimization techniques like token-based autoscaling, model caching, and disaggregated serving. The speakers, clearly operating from a position of deep practical experience, offer a robust blueprint for platform teams to empower data scientists with self-service capabilities while…