AI_dev: Open Source GenAI & ML Summit Europe 2025

Generative AI has made headlines with large models powering everything from chatbots to image synthesis—but these advancements usually rely on heavyweight cloud infrastructure. InfiniEdge AI is an open-source edge AI framework (under LF Edge) that enables those same powerful generative models to run on edge devices and distributed edge clouds. This talk will explore how InfiniEdge AI brings generative AI capabilities closer to users, enabling real-time responses, improved privacy (since data stays on device), and reduced latency even in offline or bandwidth-constrained environments. We’ll dive into the architecture of InfiniEdge AI and show how it optimizes large language models (LLMs) and other generative models through techniques like model compression and efficient inferencing on resource-constrained hardware. Attendees will see demos of edge-based AI (e.g., running a mini GPT-style assistant on a phone) and learn how open-source collaboration is accelerating GenAI innovation beyond the data center.