AI - Tantivy

Empowering developers with fast, configurable full-text search capabilities through Tantivy's Rust library, featuring BM25 scoring, natural query language support, and various data types.

Logo of Tantivy
Last Audited At

About Tantivy

Tantivy is a search engine library developed in Rust. It offers full-text search capabilities with configurable tokenizers for various languages, including stemming support for 17 Latin languages and third-party offerings for Chinese, Japanese, and Korean. Tantivy boasts fast performance, with a tiny startup time under 10ms, ideal for command-line tools. The library employs BM25 scoring similar to Lucene, supports natural query language, phrase queries, and incremental indexing. Additionally, it features multithreaded indexing, an mmap directory, SIMD integer compression, fast fields (single valued and multivalued for u64, i64, f64), text fields, and various data types such as dates, ip, bool, and hierarchical facets. Tantivy offers compressed document stores with options like LZ4, Zstd, or None. It supports range queries, faceted search, and configurable indexing with optional term frequency and position indexing. Furthermore, it includes a JSON field, an aggregation collector for histograms, range buckets, averages, and stats metrics, log merge policy with deletes, and a Searcher Warmer API.

Was this page helpful?

More companies

Microsoft Azure CycleCloud

Simplifying containerized application management at scale with Streamlined installation, efficient resource utilization, seamless integration, and industry-leading compliance.

Read more

Xata

Empowering developers with an easy-to-use, AI-driven data platform for efficient data management and manipulation.

Read more

Owkin

Revolutionizing healthcare with AI for accurate diags, personalized treatments, and improved outcomes. A federated research network ensuring data privacy & collaboration.

Read more

Tell us about your project

Our Hubs

London, United Kingdom

A global AI hotspot, thrives on innovation, diverse talent, and a dynamic tech ecosystem, offering unparalleled opportunities for AI engineers.

Munich, Germany

A vibrant AI hub, merges cutting-edge technology with rich cultural experiences, creating an inspiring environment for AI engineers.