Name: From Hours To Milliseconds: Scaling AI Inference 10x With Serverless on Kubernetes - Anmol Krishan Sachdeva & Paras Mamgain, Google
Start: 2025-08-28T13:35:00+0200
End: 2025-08-28T14:00:00+0200

28-29, August 2025
Amsterdam, Netherlands
View More Details & Registration
Note: The schedule is subject to change.

The Sched app allows you to build your schedule but is not a substitute for your event registration. You must be registered for AI_dev Europe 2025 to participate in the sessions. If you have not registered but would like to join us, please go to the event registration page to purchase a registration.

This schedule is automatically displayed in Central European Summer Time, CEST (UTC +2). To see the schedule in your preferred timezone, please select from the drop-down menu to the right.

IMPORTANT NOTE: Timing of sessions and room locations are subject to change.

Thursday August 28, 2025 13:35 - 14:00 CEST

G001-002

Imagine deploying a complex AI model for real-time inference, but facing latency that slows down your application. We've all been there. This talk isn't just about theoretical serverless benefits; it's about real-world performance gains. We'll show you how we slashed inference latency from several seconds to under 100 milliseconds, achieving a 10x improvement in throughput, by harnessing the power of serverless on Kubernetes.

Speakers

Paras Mamgain

Software Engineer, Google

Paras has been an active speaker sharing his technical expertise at Google tech conferences, Linux Foundations Open source summit in Japan and North America. Paras is a highly skilled backend developer with a passion for information retrieval and a knack for translating complex technical... Read More →

Anmol Krishan Sachdeva

Sr. Hybrid Cloud Architect, Google

Anmol is a seasoned International Tech Speaker (delivered 75+ talks), a Distinguished Guest Lecturer, an active conference organizer, and has published several notable papers. He works at Google and focuses on Emerging Technologies.

Thursday August 28, 2025 13:35 - 14:00 CEST
G001-002

Breakout Sessions, Inferencing and GPU Acceleration

AI_dev: Open Source GenAI & ML Summit Europe 2025

Paras Mamgain

Anmol Krishan Sachdeva

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!