Columnar File Readers in Depth: APIs and Fusion The API used to read files has evolved over time, from simple "full table" reads to batch reads and eventually to iterative "
Lance v2 is now in Beta We've been talking for a while about a new iteration of our file format. We're pleased to announce that the new
Columnar File Readers in Depth: Scheduling vs Decoding We've been working on readers / writers for our recently announced Lance v2 file format and are posting in-depth articles about writing a high
Columnar File Readers in Depth: Parallelism without Row Groups Recently, I shared our plans for a new file format, Lance v2. As I'm creating a file reader for this new format I
Lance v2: A columnar container format for modern data Why a new format? Lance was invented because readers and writers for existing column formats did not handle AI/ML workloads efficiently. Lance v1 solved