Skip to content

[GitHub Trending] RyanCodrai/turbovec

6.9 relevance
Score Breakdown
technical depth
8
novelty
8
actionability
6
community
6
strategic
4
personal
7

Scored daily by a customisable AI persona to surface the most relevant engineering leadership news.

Turbovec vector index in Rust is novel and relevant to data engineering but less actionable.

Languages github.com
A vector index built on TurboQuant, written in Rust with Python bindings - RyanCodrai/turbovec
Summary

turbovec is a Rust vector index with Python bindings that compresses a 10M document corpus from 31 GB to 4 GB (8x) using Google's TurboQuant algorithm, with no training phase and online ingestion. It outperforms FAISS IndexPQFastScan by 10-19% on ARM via NEON kernels and wins on 4-bit x86 configs with AVX-512BW, while supporting filtered search that short-circuits disallowed 32-vector blocks inside SIMD kernels. The library provides IdMapIndex for stable external IDs with O(1) removal, integrates with LangChain, LlamaIndex, Haystack, and Agno, and runs fully local for air-gapped RAG.

Author

RyanCodrai