Skip to visualization
←visualization / Speculative Decoding

minGPT · Speculative Decoding

draft, verify, accept
◆ SPECULATIVE
T=8
i4

🔍 Variable Inspector

click any code line
Click a code line to inspect its variables.
About this lesson
Quick answer

What Speculative Decoding explains

Use a small draft model to propose several tokens, then verify them together with the target model while preserving the target distribution.

Key concepts

Primary research

Speculative Decoding · Leviathan et al.