[GitHub Trending] NVIDIA-NeMo/Switchyard
Scored daily by a customisable AI persona to surface the most relevant engineering leadership news.
NVIDIA Switchyard likely involves AI agent or model infrastructure, relevant but lacks description for full scoring.
NVIDIA NeMo released Switchyard, a Rust proxy and library for LLM traffic that routes requests across providers, translates between OpenAI Chat, Anthropic Messages, and OpenAI Responses formats, and records Prometheus metrics. It supports multi-backend routing strategies including LLM-as-classifier, signal-driven stage routing, and custom algorithms, and can be used as a launcher for coding agents like Claude Code or Codex, a standalone server, or an embedded library. Currently pre-alpha and not for production, it enables agents to speak their native API while being served by vLLM, NVIDIA NIM, Ollama, or any OpenAI-compatible endpoint.
NVIDIA-NeMo