Show HN: sllm – Split a GPU node with other developers, unlimited tokens
9.4 relevance
Score Breakdown
technical depth 8
novelty 9
actionability 9
community 7
strategic 8
personal 9
Scored daily by a customisable AI persona to surface the most relevant engineering leadership news.
sllm offers GPU node sharing for LLMs, directly addressing cost and access in AI infrastructure.
Summary
Running DeepSeek V3 (685B) requires 8×H100 GPUs which is about $14k/month. Most developers only need 15-25 tok/s. sllm lets you join a cohort of developers sharing a dedicated node. You reserve a spot with your card, and nobody is charged until the cohort fills. Prices start at $5/mo for smaller models. The LLMs are completely private (we don't log any traffic). The API is OpenAI-compatible (we run vLLM), so you just swap the base URL. Currently offering a few models. Comments URL: https://news.
Key Takeaway