Event

Event
15:30
-
15:50
Day 1
From Infrastructure to Production: A Year of Self-Hosted LLMs
Assembly-Event
<p>Last year, I shared Paddler, an open-source LLM load balancer. A year of community feedback and building Poet (a static site generator with AI features) on top of it taught me what actually matters when self-hosting LLMs. This talk shares practical patterns the open-source community needs. What works, what doesn't, and what tooling we still need to build together.</p>