Name: Benchmarking GenAI Like a Pro: Scaling Experiments, Predicting Performance, and Keeping Your Sanity - Michael Johnston, IBM
Start: 2025-08-29T14:10:00+0200
End: 2025-08-29T14:35:00+0200

28-29, August 2025
Amsterdam, Netherlands
View More Details & Registration
Note: The schedule is subject to change.

The Sched app allows you to build your schedule but is not a substitute for your event registration. You must be registered for AI_dev Europe 2025 to participate in the sessions. If you have not registered but would like to join us, please go to the event registration page to purchase a registration.

This schedule is automatically displayed in Central European Summer Time, CEST (UTC +2). To see the schedule in your preferred timezone, please select from the drop-down menu to the right.

IMPORTANT NOTE: Timing of sessions and room locations are subject to change.

Friday August 29, 2025 14:10 - 14:35 CEST

G001-002

Generative AI is moving fast—and if you're responsible for deploying or tuning these models, you're probably feeling the heat. New LLMs, hardware, and training methods are landing constantly. How do you make sense of it all? How do you actually know what’s performant, what’s cost-effective, and what breaks the moment your stack changes?

Speakers

Michael Johnston

Research Scientist & Manager, Next Generation Systems Team, IBM Research Ireland

Michael Johnston is Research Scientist and Manager of the Next Generation Systems team at IBM Research Ireland. His background is in High Performance Computing, application design, and computational biophysics and biochemistry. He has worked closely with the Hartree Centre, IBM’s collaboration with the UK’s Science and Technology Facilities Council (STFC), on a range of projects. This included the Square Kilometre Array (SKA) Telescope, aimed at studying the universe in unprecedented detail, and Oasis — a tool for estimating the cost of catastrophes... Read More →

Friday August 29, 2025 14:10 - 14:35 CEST
G001-002

Breakout Sessions, Eval Frameworks and LLM Ops

AI_dev: Open Source GenAI & ML Summit Europe 2025

Michael Johnston

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!