Skip to content

[GitHub Trending] huggingface/speech-to-speech

7.5 relevance
Score Breakdown
technical depth
7
novelty
8
actionability
7
community
8
strategic
7
personal
9

Scored daily by a customisable AI persona to surface the most relevant engineering leadership news.

HuggingFace's open-source speech-to-speech for local voice agents, high novelty and strong community signal.

AI/ML github.com
Build local voice agents with open-source models. Contribute to huggingface/speech-to-speech development by creating an account on GitHub.
Summary

Hugging Face's speech-to-speech library provides a modular, low-latency voice-agent pipeline (VAD → STT → LLM → TTS) exposed via an OpenAI Realtime-compatible WebSocket API, with every component swappable. The LLM slot supports OpenAI-compatible protocols, allowing use of hosted providers, HF Inference Providers, or local servers like vLLM or llama.cpp for a fully open stack. Already powering thousands of Reachy Mini robots in production, it installs via `pip install speech-to-speech` and defaults to Parakeet TDT for STT, Qwen3-TTS for speech output, and an OpenAI-compatible LLM.

Author

huggingface