Modified RAG: Parent Document & Bigger chunk Retriever by Mahesh Deshwal In case you’re interested in modifying and improving retrieval accuracy of RAG pipelines, you should check Re-ranking post. What’s it
Multi-Lingual Search With Cohere and LanceDB by Kaushal Choudhary Overview Cohere provides a Multi-Lingual Embedding model which promises to cross the language barriers in language models which were predominantly based on
Multi-Modal AI made easy with LanceDB & CLIP by Kaushal Choudhary One of the most exciting areas of research in deep learning currently is multi-modality and its applications. Kick-started by open sourcing of
Simplest Method to improve RAG pipeline: Re-Ranking by Mahesh Deshwal Problem Statement: In a typical RAG pipeline, LLM Context window is limited so for a hypothetical 10000 pages document, we need to
Multitask Embedding with LanceDB By Kaushal Choudhary In this blog, we’ll cover InstructOR embedding model and how it can be used with LanceBD. LanceDB embedding API already supports
Improving LLM-based web applications with easy-to-use and free serverless vector database LanceDB by Tevin Wang I believe that there are currently two major challenges using LLMs. (1) outdated information (ChatGPT has limited knowledge of the world and
S3 Backed Full-Text Search with Tantivy (Part 1) by Rob Meng Tantivy is a highly performant full text search library written in Rust. The python version of tantivy powers the full-text search (FTS)
Maximizing Developer Workflows using Lance and Claude 2 by Leon Yee Introduction Just a few days ago, I went to Anthropic’s Hackathon, where hackers utilized their Claude 2 APIs to build some
Reduce Hallucinations from LLM-powered Agents using Long-Term Memory Introduction to Critique-Based Contexting with OpenAI, LangChain, and LanceDB
You can now delete rows in Lance and LanceDB! by Will Jones Starting in Lance 0.5.0, you can delete rows in Lance datasets. Up until now, we’ve only supported adding new
Demystifying LLM Apps with Lance There’s a lot of justifiable excitement around using LLMs as the basis for building a new generation of smart apps. While tools like LangChain