AI_dev: Open Source GenAI & ML Summit Europe 2025

Unlock the insights hidden within unstructured PDF documents! Many PDFs contain multimodal elements like text, tables, and images, and relying solely on text-based processing risks overlooking critical information. This session explores two powerful approaches to address this challenge: building specialized pipelines that integrate OCR and ML models for handling diverse modalities, and leveraging cutting-edge Vision-Language Models like ColPali to represent multimodal data in a unified format. Join us to discover how both methods can be applied to build an intelligent conversational search application using open-source technology, OpenSearch by leveraging it's its powerful search and ingest pipelines. The session includes a live demonstration to showcase practical implementations, empowering you to choose the approach that best fits your needs!

In recent years, generative AI models have come to dominate the discourse around artificial intelligence and machine learning.

Running open models like LLaMA, Whisper, etc has traditionally required heavyweight runtimes, containerization, or cloud resources. However, as LLMs are increasingly deployed in edge environments, desktop apps, and dev boards, there's a growing need for lighter, more portable execution environments. 

It’s no secret that for a long time machine learning has been mostly a Python game, but the recent surge in popularity of Gen AI has brought many new developers into the field. With JavaScript being the most widely-used programming language, it’s no surprise that this has included many web developers.

OpenSearch has evolved from search to a powerful vector database solution. This talk will begin by explaining the transition from traditional lexical search to vector-based similarity search, and how OpenSearch combines both approaches in one complete package. 

Generative AI has made headlines with large models powering everything from chatbots to image synthesis—but these advancements usually rely on heavyweight cloud infrastructure. InfiniEdge AI is an open-source edge AI framework (under LF Edge) that enables those same powerful generative models to run on edge devices and distributed edge clouds. This talk will explore how InfiniEdge AI brings generative AI capabilities closer to users, enabling real-time responses, improved privacy (since data stays on device), and reduced latency even in offline or bandwidth-constrained environments. We’ll dive into the architecture of InfiniEdge AI and show how it optimizes large language models (LLMs) and other generative models through techniques like model compression and efficient inferencing on resource-constrained hardware. Attendees will see demos of edge-based AI (e.g., running a mini GPT-style assistant on a phone) and learn how open-source collaboration is accelerating GenAI innovation beyond the data center.

Okay, so Platform Engineering blew up around the same time AI did, right?