Event

<p>Serving AI models on a single GPU for multi tenant workload sounds challenging till you partition a GPU correctly. </p> <p>This talk is a deep technical exploration of running AI inference workloads on modern GPUs across using Multi-Instance GPU (MIG) isolation.</p> <p>We'll explore:</p> <ol> <li>The multi-tenant problem: MIG vs other GPU slicing methods.</li> <li>MIG Fundamentals: Key concepts, working and support.</li> <li>Managing MIG instances: creation, configuration, monitoring and deletion.</li> <li>Identifying right approaches based on your workload.</li> <li>Common issues and failures</li> </ol> <p>Whether you're building a multi-tenant inference platform, optimizing GPU utilization for your team, or exploring how to serve AI models cost-effectively, this talk provides practical configurations for your AI workloads.</p>