Publications

International Conferences

MQM-Chat: Multidimensional Quality Metrics for Chat Translation, COLING 2025. πŸ“„ Paper

Yunmeng Li, Jun Suzuki, Makoto Morishita, Kaori Abe and Kentaro Inui

SubRegWeigh: Effective and Efficient Annotation Weighing with Subword Regularization, COLING 2025. πŸ“„ Paper

Kohei Tsuji, Tatsuya Hiraoka, Yuchang Cheng, Tomoya Iwakura

Monotonic Representation of Numeric Properties in Language Models, ACL 2024. πŸ“„ Paper

Benjamin Heinzerling, Kentaro InuiΒ 

Analyzing Feed-Forward Blocks in Transformers through the Lens of Attention Maps, ICLR 2024. πŸ“„ Paper

Goro Kobayashi, Tatsuki Kuribayashi, Sho Yokoi, Kentaro Inui

Low-rank Subspace for Binding in Large Language Models, EMNLP2024.

Qin Dai, Benjamin Heinzerling, Kentaro Inui

First Heuristic Then Rational: Dynamic Use of Heuristics in Language Model Reasoning, EMNLP 2024. πŸ“„ Paper

Yoichi Aoki, Keito Kudo, Tatsuki Kuribayashi, Shusaku Sone, Masaya Taniguchi, Keisuke Sakaguchi, Kentaro Inui

The Curse of Popularity: Popular Entities Have Catastrophic Side Effects when Deleting Knowledge from Language Models, NAACL 2024 SRW. πŸ“„ Paper

Ryosuke Takahashi, Go Kamoda, Benjamin Heinzerling, Keisuke Sakaguchi, Kentaro Inui

How Well Do Vision Models Encode Diagram Attributes?, ACL 2024 SRW.Β 

Haruto Yoshida, Keito Kudo, Yoichi Aoki, Ryota Tanaka, Itsumi Saito, Keisuke Sakaguchi, Kentaro Inui

Transformer Language Models Handle Word Frequency in Prediction Head, ACL 2023 Findings. πŸ“„ Paper

Goro Kobayashi, Tatsuki Kuribayashi, Sho Yokoi, Kentaro Inui

Contrastive Learning-based Sentence Encoders Implicitly Weight Informative Words, EMNLP 2023 Findings. πŸ“„ Paper

Hiroto Kurita, Goro Kobayashi, Sho Yokoi, Kentaro Inui

Non-refereed Papers

Tatsuya Hiraoka, Kentaro Inui

The Geometry of Numerical Reasoning: Language Models Compare Numeric Properties in Linear Subspaces, arxiv 2024. πŸ“„ Paper

Ahmed Oumar El-Shangiti, Tatsuya Hiraoka, Hilal AlQuabeh, Benjamin Heinzerling, Kentaro Inui