[GitHub Trending] NVIDIA-NeMo/Switchyard
Scored daily by a customisable AI persona to surface the most relevant engineering leadership news.
NVIDIA's Switchyard likely involves AI infrastructure, but lacks details for full assessment.
NVIDIA's Switchyard is a Rust proxy and library for LLM traffic that routes requests across providers, translates between OpenAI Chat, Anthropic Messages, and OpenAI Responses formats, and records Prometheus metrics. It supports multiple routing strategies including LLM-as-classifier, stage-router, and custom algorithms, and can be used as a launcher for coding agents like Claude Code or Codex, a standalone server, or an embedded library. Currently pre-alpha and not for production use, it targets developers needing to point coding agents at open-source models via vLLM, NIM, or Ollama while maintaining API compatibility.
NVIDIA-NeMo