November Feature Roundup Lance On November 13th, we released Lance 0.19.2. This release includes several new features and improvements, including: * Flexible handling of data for inserts
Columnar File Readers in Depth: Backpressure Streaming data applications can be tricky. When you can read data faster than you can process the data then bad things tend to happen. The
Lance v0.16.1 Feature Roundup In Lance v0.16.1 we introduced several new features, implemented by a combination of LanceDB engineers and community contributors. Lance is an OSS project
The case for random access I/O One of the reasons we started the Lance file format and have been investigating new encodings is because we wanted a format with better support
Lance v0.15.0 Lance 0.15.0 introduces several experimental features, marking major milestones on important projects in our library. It exposes the first public APIs for full-text
Streamlining Our SDKs In the fast-evolving landscape of software development, maintaining multiple SDKs in various languages can be a challenging endeavor, especially for a small startup! Each bespoke
Columnar File Readers in Depth: APIs and Fusion The API used to read files has evolved over time, from simple "full table" reads to batch reads and eventually to iterative "
Lance v2 is now in Beta We've been talking for a while about a new iteration of our file format. We're pleased to announce that the new
Columnar File Readers in Depth: Scheduling vs Decoding We've been working on readers / writers for our recently announced Lance v2 file format and are posting in-depth articles about writing a high
Columnar File Readers in Depth: Parallelism without Row Groups Recently, I shared our plans for a new file format, Lance v2. As I'm creating a file reader for this new format I
Lance v2: A columnar container format for modern data Why a new format? Lance was invented because readers and writers for existing column formats did not handle AI/ML workloads efficiently. Lance v1 solved
My SIMD is faster than Yours An untold story about how we make LanceDB vector search fast. In January, the engineering team here at Eto made the decision to rewrite the
