Name: Scalable LLM Inference on Kubernetes With NVIDIA NIMS, LangChain, Milvus and FluxCD - Riccardo Freschi, AWS
Start: 2025-08-28T16:50:00+0200
End: 2025-08-28T17:15:00+0200

28-29, August 2025
Amsterdam, Netherlands
View More Details & Registration
Note: The schedule is subject to change.

The Sched app allows you to build your schedule but is not a substitute for your event registration. You must be registered for AI_dev Europe 2025 to participate in the sessions. If you have not registered but would like to join us, please go to the event registration page to purchase a registration.

This schedule is automatically displayed in Central European Summer Time, CEST (UTC +2). To see the schedule in your preferred timezone, please select from the drop-down menu to the right.

IMPORTANT NOTE: Timing of sessions and room locations are subject to change.

Thursday August 28, 2025 16:50 - 17:15 CEST

G001-002

Join us for a deep dive into architecting and implementing a scalable LLM inference service on Amazon EKS as the foundation for workload orchestrating, while incorporating NVIDIA NIMS for optimal GPU utilization, LangChain for flexible LLM operations, Milvus for efficient vector storage, FluxCD for GitOps-driven deployments, Karpenter for horizontal scaling and Prometheus and Grafana for Observability.

Speakers

Riccardo Freschi

Sr. Solution Architect, AWS

Riccardo Freschi is a Sr. Solutions Architect at AWS, focusing on Application Modernization. He works closely with partners and customers, to help them transform their IT landscapes in their journey to the AWS Cloud, by refactoring existing applications and building new ones, cloud... Read More →

Thursday August 28, 2025 16:50 - 17:15 CEST
G001-002

Breakout Sessions, Inferencing and GPU Acceleration

AI_dev: Open Source GenAI & ML Summit Europe 2025

Riccardo Freschi

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!