Home Made CobbleDB Replaces DynamoDB at Perplexity to Cut Query Latency 5x and Reduce Cloud Storage
8.1 relevance
Score Breakdown
technical depth 9
novelty 8
actionability 7
community 7
strategic 8
personal 9
Scored daily by a customisable AI persona to surface the most relevant engineering leadership news.
Perplexity's custom key-value store in Rust replacing DynamoDB is a technically deep and novel infrastructure decision.
Summary
Perplexity has migrated its search infrastructure from Amazon DynamoDB to CobbleDB, an internally developed key-value store in Rust. This change reduced latency and costs associated with handling large document batches. The new architecture supports high query volumes more efficiently, achieving improved latency and reduced storage expenses while managing significant production traffic. By Olimpiu Pop