Tag: encoder-decoder transformers
Cross-Attention in Encoder-Decoder Transformers: How LLMs Condition on Context
Tamara Weed, Sep, 17 2026
Discover how cross-attention enables encoder-decoder transformers to condition outputs on input context. Learn the mechanics, differences from self-attention, and applications in translation and multimodal AI.
Categories:
Tags:
