Name: Fast Inference, Furious Scaling: Leveraging VLLM With KServe - Rafael Vasquez, IBM
Start: 2025-08-28T14:10:00+0200
End: 2025-08-28T14:35:00+0200

28-29, August 2025
Amsterdam, Netherlands
View More Details & Registration
Note: The schedule is subject to change.

The Sched app allows you to build your schedule but is not a substitute for your event registration. You must be registered for AI_dev Europe 2025 to participate in the sessions. If you have not registered but would like to join us, please go to the event registration page to purchase a registration.

This schedule is automatically displayed in Central European Summer Time, CEST (UTC +2). To see the schedule in your preferred timezone, please select from the drop-down menu to the right.

IMPORTANT NOTE: Timing of sessions and room locations are subject to change.

Thursday August 28, 2025 14:10 - 14:35 CEST

G001-002

In this talk, we will introduce two open-source projects vLLM and KServe and explain how they can be integrated to leverage better performance and scalability for LLMs in production. The session will include a demo showcasing their integration.

Speakers

Rafael Vasquez

Open Source Software Developer, IBM

Rafael Vasquez is a software developer on the Open Technology team at IBM. He previously completed an MASc. working on self-driving car research and transitioned from a data scientist role in the retail field to his current role where he continues to grow his passion for MLOps and... Read More →

Thursday August 28, 2025 14:10 - 14:35 CEST
G001-002

Breakout Sessions, Scalability and Cloud-Native AI

AI_dev: Open Source GenAI & ML Summit Europe 2025

Rafael Vasquez

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!