DuckLake 1.1 Solves the Absurd Complexity of Data Lakes at AI Scale
| Podcast | The New Stack |
| Guest | Pedro Holanda (DuckLabs) |
| Article | DuckLake 1.1 solves the absurd complexity of data lakes at AI scale by Jennifer Riggins |
| YouTube | Watch |
Description
In this episode of The New Stack Podcast, Pedro Holanda, lead DuckLake developer, discusses DuckLake, the open lakehouse format that stores table metadata in a SQL database instead of manifest files on object storage. Pedro explains how this lets a single query find exactly which Parquet files to read, and walks through the DuckLake 1.1 release, which adds maintenance features such as file consolidation and data inlining to tackle the small files problem in streaming workloads.
