Open Source pg_vectorsearch Brings More Scalable Vector Search to PostgreSQL

7.2 relevance

New PostgreSQL vector search extension with PRISM index is directly actionable for data engineers.

Open Source infoq.com

Answer the board on AI readiness

Arrive with evidence, not opinion. See how your foundation benchmarks against your peers, get a clear read, and leave with a ranked place to start.

Why It Matters

For platform and data engineers running AI workloads on PostgreSQL, this offers a path to scale vector search without spinning up separate vector databases or provisioning massive memory, directly reducing infrastructure cost and complexity.

Key Takeaways

Evaluate pg_vectorsearch's PRISM index for your vector workloads if you need faster index builds and lower memory than pgvector's HNSW, but plan for index rebuilds if your data changes frequently.

Open Source pg_vectorsearch Brings More Scalable Vector Search to PostgreSQL

Summary

Tiger Data released pg_vectorsearch, an open-source PostgreSQL extension for vector similarity search that uses a PRISM index based on data partitioning and compression instead of pgvector's graph-based HNSW. In benchmarks with 100 million vectors, PRISM built an index in 1 hour 40 minutes on 128 GB RAM versus HNSW's 42 hours on 512 GB RAM, dramatically reducing memory and build time. The extension works with existing pgvector columns but lacks full incremental rebalancing, requiring index rebuilds for frequent data changes.

Author

Renato Losio