Tag: CoT
Cognitive Heads
2026-06-01 interpretation CoT attention text The heads in a multi-head attention transformer architecture tend to specialize for different functions. We can find the cognitive heads, responsible for individual steps in chains of thought, by imitating the techniques used in biology to study animal brains. Access: $$$ Pro
Chain of Thought prompting
2026-02-23 math prompting text CoT In domains like math and software engineering, it seems advantageous to have models "think" through their answers, step by step. Giving the model a few-shot prompt with examples of chain-of-thought reasoning seems useful in pushing it to generate such reasoning itself. Access: $ Basic