AIF-C01 catalog scenario
Describing LLMs
Which mechanism enables a transformer-based LLM to relate words across a sentence when interpreting context?
Answer ready for review
Self-attention lets the model weigh relevant parts of the input rather than processing context only through a strictly sequential recurrence.