Skip to content

[GitHub Trending] BerriAI/litellm

8.4 relevance
Score Breakdown
technical depth
9
novelty
7
actionability
9
community
8
strategic
8
personal
9

Scored daily by a customisable AI persona to surface the most relevant engineering leadership news.

AI Gateway with Rust core, highly technical and actionable for cloud infrastructure and LLM API management.

AI/ML github.com
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthr...
Summary

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]