Serverless Gemma 4: E2B on a Lambda GPU Function, with Google's QAT Weights and Drafter
AWS Lambda now supports GPU-backed functions on G-series instances (G4dn, G5, G6, G6e), enabling serverless inference for models like Gemma 4 E2B. A step-by-step guide demonstrates serving Google's 4-bit QAT checkpoint and assistant drafter via vLLM 0.33.0 on a single NVIDIA L4, with the model baked into a 32 GB container image and Lambda handling lifecycle, health checks, and request routing. Billing is at EC2 On-Demand plus a 9.75% management fee and $0.20 per million requests, with up to 48 concurrent requests sharing one model copy.