I recently had the opportunity to visit the Istituto Italiano di Tecnologia in Genoa, where I met the research team led by Alessandra Sciutti and the iCub robot. They are mainly working on the question of how perception changes through interaction between humans and robots and how robots can be enabled to achieve shared perception with a human partner (whisperproject.eu).
In a talk, I presented my own current experiments on using mental models with ACT-R to control an LLM for the speech output of a social robot.
It was very interesting and instructive to learn how cognitive topics in robotics are approached there, mostly by programming their own customized cognitive architectures and often also using the possibilities of current LLMs.
