←
visualization / MQA · GQA
MinGPT · GQA / MQA
Grouped-Query & Multi-Query Attentioni
i
i
i
iGQA
i
i
i
i
i
Embed
Attention
MLP
Norm
Output
Cache
Click any highlighted line of code on the left
to see the corresponding transformer operation here.
to see the corresponding transformer operation here.
🔍 Variable Inspector
click any code lineClick any line of code to inspect its variables, shapes, and meanings.