Skip to content

[GitHub Trending] jingyaogong/minimind

8.4 relevance
Score Breakdown
technical depth
9
novelty
8
actionability
9
community
8
strategic
6
personal
9

Scored daily by a customisable AI persona to surface the most relevant engineering leadership news.

Enables training a 64M LLM from scratch in 2 hours, highly technical and actionable for AI/ML engineers.

AI/ML github.com
🧠 两小时从 0 训出你的 64M 大模型。Train your own 64M LLM from scratch in 2 hours. - jingyaogong/minimind
Summary

MiniMind is an open-source project that trains a 64M parameter LLM from scratch for under $3 and 2 hours, using only PyTorch, covering the full pipeline (pretraining, SFT, RLHF, agentic RL) and aligning with Qwen3/MoE architectures, with extensions for MoE, vision, and diffusion. It provides a hands-on tutorial for understanding LLM internals without high-level library abstractions.