12:05
-
12:25
-
12:25
Day 1
Single-source cross-platform GPU LLM inference with Slang and Rust
<p>Leveraging Rust and Khronos' emerging Slang initiative, we introduce our efforts toward a cross-platform GPU LLM inference ecosystem. With a single-source approach we aim to minimize backend-specific code and foster community participation by writing inference kernels once and run them everywhere.</p>