Repetition Neurons: How Do Language Models Produce Repetitions?, Tatsuya Hiraoka, Kentaro Inui, NAACL 2025. 📄 Paper

The Geometry of Numerical Reasoning: Language Models Compare Numeric Properties in Linear Subspaces, Ahmed Oumar El-Shangiti, Tatsuya Hiraoka, Hilal AlQuabeh, Benjamin Heinzerling, Kentaro Inui, NAACL 2025.  📄 Paper

Weight-based Analysis of Detokenization in Language Models: Understanding the First Stage of Inference Without Inference, Go Kamoda, Benjamin Heinzerling, Tatsuro Inaba, Keito Kudo, Keisuke Sakaguchi, Kentaro Inui, NAACL 2025 Findings. 📄 Paper