LEANN: Local Search With 97% Less Storage

The story

What the video said

This open source GitHub project turns a huge pile of files into a tiny search index. It keeps a small map and rebuilds what it needs when you search.

You want to search your own notes and mail on your laptop, but a normal search tool copies every file into a giant index that eats your disk.

LEANN is an open source library that builds a local search index for your files. It stores a small map instead of copies of every file, then rebuilds what it needs during search.

In this demo, you can see the local search tool start and answer a real question from browser history. The terminal shows the query, the scored hits, and a grounded answer.

So LEANN gives you a small local index that keeps your files on your machine. You can build it, search it, and ask questions without sending data away.

This page was generated from the Ming Dao AI publication record.