Inside SGLang: Anatomy of a High-Performance Structured LLM Inference System

From RadixAttention, zero-overhead scheduling, structured generation, to multi-GPU, multi-node dynamic serving at scale

SGLang Deep Dive: Inside SGLang

Advanced exploration of SGLang's internal architecture, optimization strategies, and performance characteristics

Context Language Models, Dissected: Letting the Model Edit Its Own Context, the Math Behind It, and Where I Disagree

A section-by-section review of Context Language Models (Shao et al., 2026): the formalism, prefix-reuse FLOPs, stepwise GRPO with a success-gated efficiency advantage, and Suffix Cache Reuse, with refreshers along the way.

Prefill, Decode, and the Quiet Third Job: Reviewing vLLM's Guide to Disaggregated Serving

Why long prompts make every stream stutter, when splitting prefill from decode pays off, and why tokenization belongs off the GPU, with a first-principles simulator that reproduces the guide's benchmark.