News
I presented the paper Training Neural Networks as Recognizers of Formal Languages at FlaNN.
I presented with Brian DuSell the paper Training Neural Networks as Recognizers of Formal Languages in Michael Hanh's group at Saarland University.
The paper Training Neural Networks as Recognizers of Formal Languages, written together with Ghazal Khalighinejad, Anej Svete, Josef Valvoda, Ryan Cotterell, and Brian DuSell, was accepted at ICLR 2025.
I presented with Anej Svete the paper On the Representational Capacity of Neural Language Models with Chain-of-Thought Reasoning at ACL 2024. I also gave the tutorial Computational Expressivity of Neural Language Models, together with Robin Chan, Ryan Cotterell, William Merrill, Franz Nowak, Clemente Pasti, Lena Strobl, and Anej Svete at ACL 2024.
Publications
Training Neural Networks as Recognizers of Formal Languages
In The Thirteenth International Conference on Learning Representations, Singapore, April 2025
On the Representational Capacity of Neural Language Models with Chain-of-Thought Reasoning
In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics, Bangkok, Thailand, August 2024
Efficient Algorithms for Recognizing Weighted Tree-Adjoining Languages
In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, Singapore, December 2023
Convergence and Diversity in the Control Hierarchy
In Proceedings of the 61nd Annual Meeting of the Association for Computational Linguistics, Toronto, Canada, July 2023
Algorithms for Weighted Pushdown Automata
In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, Abu Dhabi, United Arab Emirates, December 2022
Teaching
I gave a few courses on the expressivity of neural language models at conferences and summer schools:Computational Expressivity of Neural Language Models, ACL 2024
Tutorial, Bangkok, Thailand, August 2024
Formal Language Theory and Neural Networks, ESSLLI 2023
Course, Ljubljana, Slovenia, July-August 2023
263-5352-00L Advanced Formal Language Theory, ETH Zürich
Head Teaching Assistant, Spring 2024, 2025
252-3005-00L Natural Language Processing, ETH Zürich
Teaching Assistant, Spring 2021, Autumn 2022, 2023, 2024
263-5352-00L Advanced Formal Language Theory, ETH Zürich
Teaching Assistant, Spring 2022, 2023