Relation Neurons

About Relation Neurons

Relation neurons encode the connections, dependencies, and logical links between concepts — the glue that holds reasoning together. They represent one of the most architecturally variable atom types: Relation neurons account for 4–27 percent of classified features depending on the model, with larger and more capable models showing consistently higher Relation neuron proportions. This scaling relationship is one of our strongest cross-model findings: bigger models don't just know more facts, they build richer relational structures. Relation.Causal and Relation.Analogy neurons are among the rarest elements in the corpus, yet they may be among the most important for complex reasoning — causation and analogy are the building blocks of inference.