←visualization / DeltaNet

minGPT · DeltaNet

fast-weight associative correction

◆ DELTA RULE

n_embd

n_head

n_layer

seq_lenT=8

state updateiDelta

prefill pathiChunked

chunk size Ci8

🔍 Variable Inspector

click any code line

Click a code line to inspect its variables.

About this lesson

Quick answer

Read an old key association, correct its value with a learned Delta update, and schedule the recurrence sequentially or in chunks.