Presentation: From Thousands to One: Building LLM-Powered Selection Systems
Scored daily by a customisable AI persona to surface the most relevant engineering leadership news.
Practical strategies for LLM production pipelines, directly applicable to AI/ML engineering.
Jendrik Jördening presents engineering patterns for integrating LLMs into production selection systems, addressing core challenges like non-determinism, schema enforcement, and the difficulty of mapping free-text outputs to integer database IDs. He advocates separating semantic text extraction from deterministic code and using discriminator models for validation, while warning against monolithic architectures where the LLM conflates model, view, and controller. The talk emphasizes maintaining database integrity, observability, and guardrails against prompt injections and context window limits when scaling from thousands of options.