Skip to content

Rust wrappers for NGT approximate nearest neighbor search

License

Notifications You must be signed in to change notification settings

lerouxrgd/ngt-rs

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

70 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

ngt-rs

crate doc

Rust wrappers for NGT, which provides high-speed approximate nearest neighbor searches against a large volume of data in high dimensional vector data space (several ten to several thousand dimensions). The vector data can be f32, u8, or f16.

This crate provides the following indexes:

Both quantized indexes are available through the quantized Cargo feature. Note that they rely on BLAS and LAPACK which thus have to be installed locally. Furthermore, QgIndex performances can be improved by using the qg_optim Cargo feature.

The NgtIndex default implementation is an ANNG. It can be optimized3 or converted to an ONNG through the optim module.

By default ngt-rs will be built dynamically, which requires CMake to build NGT. This means that you'll have to make the build artifact libngt.so available to your final binary (see an example in the CI). However the static feature will build and link NGT statically. Note that OpenMP will also be linked statically. If the quantized feature is used, then BLAS and LAPACK libraries will also be linked statically.

NGT's shared memory and large dataset features are available through the Cargo features shared_mem and large_data respectively.

Footnotes

  1. Graph and tree based method explanation

  2. Quantized graph based method explanation

  3. NGT index optimizations in Python

About

Rust wrappers for NGT approximate nearest neighbor search

Resources

License

Stars

Watchers

Forks

Packages

 
 
 

Languages