Posts tagged with "attention"

Q/K/V projections, causal masking, and why the KV-cache makes generation fast.