Meta Open-Sources Muse Glimmer: A 30B Local Agentic Model Optimised for On-Device Execution
Meta open-sourced Muse Glimmer, a 30B parameter model under Apache 2.0, optimized for local agentic workflows on consumer GPUs. It uses logit distillation from the larger Muse Spark, a 1.8B perception encoder for multimodal inputs, and dynamic 4-bit quantization to fit within 24GB VRAM. DFlash speculative decoding boosts throughput up to 3.1x on Apple Silicon and RTX 5090, while the model supports failure recovery and adjustable reasoning effort.