Event

Event
16:00
-
16:20
Day 1
Apache Arrow, Hostage Negotiator: Revisiting the case for Client Protocol Redesign
Assembly-Event
<p>In 2017, Mark Raasveldt and Hannes Mühleisen (who went on to create <a href="https://github.com/duckdb/duckdb">DuckDB</a> presented a VLDB paper entitled <a href="https://15721.courses.cs.cmu.edu/spring2018/papers/14-networking/p1022-muehleisen.pdf">“Don’t Hold My Data Hostage – A Case For Client Protocol Redesign.”</a> Their paper proposed the use of columnar serialization to achieve order-of-magnitude improvements in query result transfer performance. Eight years later, this talk revisits Raasveldt and Mühleisen’s argument and describes the central role that the <a href="https://arrow.apache.org">Apache Arrow</a> project has played in realizing this vision—through the dissemination of Arrow IPC, Arrow Flight, Arrow Flight SQL, Arrow over HTTP, and <a href="https://arrow.apache.org/adbc">ADBC</a> across numerous open source and commercial query systems. The talk concludes with a call to action to introduce Arrow-based transport to the systems that continue to “hold data hostage.”</p>