20 years ago, my first startup was all about enterprise search. Two decades later, we’re still building search engines. The technology has shifted from NLP to NN and the users from humans to agents. but searching is still the core. opensource the fastest bm25 engine:
so we built psql_bm25s.
exact BM25 retrieval. native Postgres access method. ~23x faster than pg_search on the standard benchmark.
retrieval stops being a budget item. the harness stops rationing. the agent gets to look things up like it should have the whole time.