Our paper Give it Space! Explicit Disentangling of Positional and Semantic Representations in Encoders has been accepted at EMNLP 2026! see you there :)