Prof. Dr.-Ing. Nele Rußwinkel
- Head of Institute -
- Research Group Human-Aware AI -
Ratzeburger Allee 160
23562 Lübeck
Gebäude 64, 2. OG,
Raum 69
Email: | nele.russwinkel(at)uni-luebeck.de |
Phone: | +49 451 3101 5700 |
Office Hours
Office hours WS 24/25:
Tuesdays 11 - 12 in my office, room 69 (Building 64, 2nd floor)
Please register in advance by e-mail to IFIS secretariat
Human-Aware AI
The goal for Human-Aware AI is to develop intelligent systems that can work in synergy with human partners in complex dynamic environments.
When intelligent systems are human aware, this means that the system adapts to the task of the human partner in its variations, the situation in its dynamics and uncertainty and the cognitive state of the human partner in-the-loop.
In our research group, dynamic mental models are developed (partly with cognitive architectures) that can, for example, anticipate the human in the interaction or identify intentions of the human partner. These modeling approaches are integrated with systems (e.g. robots) or simulations to enable relevant mutual understanding and proactive support.
The goal of such systems is to leave the control – on a macro level – with the human, while the human experiences adapted support for his and her goals.
Curriculum Vitae
- Since 1.2.2024 Head of the Institute IFIS
- Since 12/2022:
Professor in the field of "Human-Aware AI" at the Institute of Information Systems
University of Lübeck - 02/2013 - 11/2022:
Junior professor at the department "Cognitive Modeling in Dynamic Human-Machine Systems"
TU Berlin https://www.tu.berlin/kmodys/ueber-uns/team-1/prof-dr-ing-nele-russwinkel-1 - 08/2012 - 01/2013:
Research assistant at the Department of Cognitive Psychology & Cognitive Ergonomics (Prof. Dr. Manfred Thüring), TU Berlin - 08/2009 - 07/2012:
Postdoc at the Research Training Group "Prometei" - Project "Digital Users & Digital Products", GRK prometei, Berlin - 06/2007 - 07/2009:
Scholarship holder at the Research Training Group "Prometei" ("Prospective Design of Human-Technology Interaction") at the Technical University of Berlin (GRK Prometei), Berlin - Dissertation: "Computable quantitative models of duration estimation" (Scientific debate: July 13, 2009)
- 06/2005 - 06/2007:
Research assistant at ZMMS in the MoDyS working groupCollaborator on various projects such as:
IBB Networked Driving: Interruptibility and resumption of operating actions while driving
Transregio 29 - Determination of requirements for multimodal interface design through the concept of hybrid service bundles (HLB) - 01/2005 - 03/2005:
Internship in the Vision & Motor System Group of the Neurological Clinic of the Charité, Berlin
Tasks: Experiments with TMS (temporal magnetic stimulation) - 10/2003 - 01/2005:
Freelancer at Eyesquare, Berlin - 07/2003 - 10/2003:
Internship at Eyesquare, Berlin - 05/2003 - 07/2003:
Internship in the field of acceptance and behavioral analysis at Daimler Chrysler, Berlin - 10/2001 - 09/2004:
Master's degree in Cognitive Science with a minor in Psychology, University of Osnabrück
Master's thesis: "Which factors influence the distribution of visual-spatial attention?" (Charité Berlin, HU Berlin) - 10/1998 - 09/2001:
Bachelor program Cognitive Science, University of Osnabrück
Bachelor thesis: "The temporal stability of explicit and inferred information"
Research Interests
- Complex cognition in applied dynamic situations
- Cognitive Modelling (Cognitive Architectures)
- Human Robot Collaboration
- Mental models for dynamic Interaction
- Models for emergent behavior
- Agency and sense of Control
- Embodied Cognition
- Integration of symbolic and subsymbolic computation
Current Projects
COMPAS II (Computational Cognitive Modeling of the Predictive Active Self in Situated Action)
The interdisciplinary project aims at modeling the role of the active self in the context of situated real-time interaction in a dynamic/spatial environment. In collaboration with Prof. Stefan Kopp (University of Bielefeld), funded by the DFG SPP 2134 "The Active Self".
Closed Projects
DPDU (Digital Product, Digital User)
An interdisciplinary project for holistic modeling of human-machine systems in collaboration with the department of Prof. Klaus Gramann (Biological Psychology and Neuroergonomics, TU Berlin) and Prof. Rainer Stark (Fraunhofer, Industrial Information Technology, TU Berlin), funded by DFG.
AVALANCHE (Adaptiver, Virtueller Assistent zur LAwinenwarnung Nach CHarakter Eigenschaften)
Project AVALANCHE together with Sabine Prezenski funded by Software Campus and BMBF (Bundesministerium für Bildung und Forschung).
COMPAS I (Computational cognitive modeling of the predictive active self in situated action)
The interdisciplinary project aims at modeling the role of the active self in the context of situated real-time interaction in a dynamic/spatial environment. in collaboration with Prof. Stefan Kopp (University of Bielefeld), funded by DFG SPP 2134 "The Active Self".
VolkswagenStiftung Kurswechsel (VW)
Changing course ("Kurswechsel") - new research territory between the life sciences and natural or technical sciences
Publications
2024
Allocation of Fixational Eye Movements in Response to Uncertainty in Dynamic Environments, in CogSci 2024 , Proceedings of the Annual Meeting of the Cognitive Science Society, 2024.
Dialect, sentiment analysis, tonality, cognitive modeling – using LLMs as a toolbox for HRI, in LLMs in the RoMan Age , Workshop at the 33nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN 2024), 2024.
Weblink: | https://sites.google.com/view/llmra/start |
Goal-directed Allocation of Gaze Reflects Situated Action Control in Dynamic Tasks, in CogSci 2024 , Proceedings of the Annual Meeting of the Cognitive Science Society, 2024.
How to Provide a Dynamic Cognitive Person Model of a Human Collaboration Partner to a Pepper Robot, in ICCM , Society for Mathematical Psychology, 2024.
Weblink: | https://mathpsych.org/presentation/1452 |
Bibtex: | @inproceedings{WeSchoSiRuICCM24, author = {Alexander Werk and Sina Scholz and Thomas Sievers and Nele Russwinkel}, title = {How to Provide a Dynamic Cognitive Person Model of a Human Collaboration Partner to a Pepper Robot}, booktitle = {ICCM}, year = {2024}, volume = {}, pages = {}, publisher = {Society for Mathematical Psychology}, } |
How to use a cognitive architecture for a dynamic person model with a social robot in human collaboration, in Workshop "Robots for Humans" , CEUR Workshop Proceedings, 2024.
Weblink: | https://r4h-workshop.github.io/ |
Interacting with a Sentimental Robot - Making Human Emotions tangible for a Social Robot via ChatGPT, in 2024 IEEE International Conference on Advanced Robotics and Its Social Impacts (ARSO) , 2024. pp. 182-187.
DOI: | 10.1109/ARSO60199.2024.10557749 |
Bibtex: | @INPROCEEDINGS{10557749, author={Sievers, Thomas and Russwinkel, Nele}, booktitle={2024 IEEE International Conference on Advanced Robotics and Its Social Impacts (ARSO)}, title={Interacting with a Sentimental Robot – Making Human Emotions tangible for a Social Robot via ChatGPT*}, year={2024}, volume={}, number={}, pages={182-187}, keywords={Emotion recognition;Sentiment analysis;Analytical models;Mood;Social robots;Oral communication;Chatbots}, doi={10.1109/ARSO60199.2024.10557749}} |
Introducing a note of levity to human-robot interaction with dialogs containing irony, sarcasm and jocularity, in IEEE International Conference on Robot and Human Interactive Communication (RO-MAN) , 2024.
Project Report: Requirements for a Social Robot as an Information Provider in the Public Sector, KI - Künstliche Intelligenz , vol. 37, no. 2-4, 2024.
DOI: | 10.1007/s13218-024-00840-1 |
Bibtex: | @JOUR{10557749, author={Sievers, Thomas and Russwinkel, Nele}, booktitle={KI - Künstliche Intelligenz}, title={Project Report: Requirements for a Social Robot as an Information Provider in the Public Sector}, year={2024}, volume={37}, number={2-4}, pages={}, keywords={Human-robot interaction;Social robotics;Public sector;ACT-R}, doi={10.1007/s13218-024-00840-1}} |
Sense of Control in Dynamic Multitasking and its Impact on Voluntary Task-Switching Behavior, in CogSci 2024 , Proceedings of the Annual Meeting of the Cognitive Science Society, 2024.
What am I? – Complementing a robot’s task-solving capabilities with a mental model using a cognitive architecture, in Behavior Adaptation and Learning for Assistive Robotics , Workshop at the 33nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN 2024), 2024.
Weblink: | https://sites.google.com/view/bailar2024/home |
Developing and Evaluating a Computational Cognitive Model of Sensorimotor Grounded Action Selection Based on Eye-movement Behavior, in Mathpsych / ICCM 2024 , The Society for Mathematical Psychology, 2024.
Weblink: | https://mathpsych.org/presentation/1584 |
2023
Towards an Approach for a Holistic Ergonomic Work Design Using Physical and Cognitive Digital Human Models, in Advances in Digital Human Modeling , Scataglini, Sofia and Harih, Gregor and Saeys, Wim and Truijen, Steven, Eds. Cham: Springer Nature Switzerland, 2023. pp. 229--237.
ISBN: | 978-3-031-37848-5 |
Towards an Approach for a Holistic Ergonomic Work Design Using Physical and Cognitive Digital Human Models, in Advances in Digital Human Modeling , Scataglini, Sofia and Harih, Gregor and Saeys, Wim and Truijen, Steven, Eds. Cham: Springer Nature Switzerland, 2023. pp. 229--237.
A Commentary on Towards autonomous artificial agents with an active self: Modeling sense of control in situated action , Cognitive Systems Research , vol. 79, pp. 1-3, 2023.
Towards A Human-Centered Digital Twin, Procedia CIRP , vol. 118, pp. 324-329, 2023.
DOI: | https://doi.org/10.1016/j.procir.2023.06.056 |
File: | S2212827123002809 |
Bibtex: | @article{PREUSS2023324, title = {Towards A Human-Centered Digital Twin}, journal = {Procedia CIRP}, volume = {118}, pages = {324-329}, year = {2023}, note = {16th CIRP Conference on Intelligent Computation in Manufacturing Engineering}, issn = {2212-8271}, doi = {https://doi.org/10.1016/j.procir.2023.06.056}, url = {https://www.sciencedirect.com/science/article/pii/S2212827123002809}, author = {Kai Preuss and Svenja Nicole Schulte and Lukas Rzazonka and Lilian Befort and Carina Fresemann and Rainer Stark and Nele Russwinkel}, keywords = {digital twin, cognitive modeling, human-centered design, user study}, abstract = {The Digital Twin paradigm incorporates the application of virtual prototypes established during product development as well as sensor data collected during the production and use phase. Another aspect concerns digital representation of the product's end users. A stronger connection between a digital product and its digital user would complement the Digital Twin. This paper investigates the concept of coupling a geometrical model of an adjustable operating table including position sensors with a cognitive digital user. Users interacted with both real and virtual instances of the table. Resulting data allow for evaluation of the usability of different interface variants and virtual product representations to develop a cognitive model of end users, showing the potential of a combined Digital Twin in human-centered design.} } |
Talking like one of us: Effects of using regional language in a Humanoid Social Robot, in Social Robotics , Springer, Singapore, 2023. pp. 71-80.
DOI: | 10.1007/978-981-99-8718-4_7 |
Bibtex: | @INPROCEEDINGS{SiRu, author ={Thomas Sievers and Nele Russwinkel}, title ={Talking like one of us: Effects of using regional language in a Humanoid Social Robot}, booktitle ={Social Robotics}, year ={2023}, pages = {71-80}, publisher = {Springer, Singapore}, url ={http://dx.doi.org/10.1007/978-981-99-8718-4_7}, keywords ={Social Robots; Human-Robot Interaction; Regional Language; Communication; Cultural Identity}, } |
Cognitive processing stages in mental rotation – How can cognitive modelling inform HsMM-EEG models?, Neuropsychologia , vol. 188, pp. 108615, 2023.
DOI: | https://doi.org/10.1016/j.neuropsychologia.2023.108615 |
File: | S0028393223001495 |
Bibtex: | @article{HEIMISCH2023108615, title = {Cognitive processing stages in mental rotation – How can cognitive modelling inform HsMM-EEG models?}, journal = {Neuropsychologia}, volume = {188}, pages = {108615}, year = {2023}, issn = {0028-3932}, doi = {https://doi.org/10.1016/j.neuropsychologia.2023.108615}, url = {https://www.sciencedirect.com/science/article/pii/S0028393223001495}, author = {Linda Heimisch and Kai Preuss and Nele Russwinkel}, keywords = {Electroencephalography, Cognitive modelling, HsMM, ACT-R, Mental rotation}, abstract = {The aspiration for insight into human cognitive processing has traditionally driven research in cognitive science. With methods such as the Hidden semi-Markov Model-Electroencephalography (HsMM-EEG) method, new approaches have been developed that help to understand the temporal structure of cognition by identifying temporally discrete processing stages. However, it remains challenging to assign concrete functional contributions by specific processing stages to the overall cognitive process. In this paper, we address this challenge by linking HsMM-EEG3 with cognitive modelling, with the aim of further validating the HsMM-EEG3 method and demonstrating the potential of cognitive models to facilitate functional interpretation of processing stages. For this purpose, we applied HsMM-EEG3 to data from a mental rotation task and developed an ACT-R cognitive model that is able to closely replicate human performance in this task. Applying HsMM-EEG3 to the mental rotation experiment data revealed a strong likelihood for 6 distinct stages of cognitive processing during trials, with an additional stage for non-rotated conditions. The cognitive model predicted intra-trial mental activity patterns that project well onto the processing stages, while explaining the additional stage as a marker of non-spatial shortcut use. Thereby, this combined methodology provided substantially more information than either method by itself and suggests conclusions for cognitive processing in general.} } |
2022
A Cognitive Model to Anticipate Variations of Situation Awareness and Attention for the Takeover in Highly Automated Driving, Inf. , vol. 13, pp. 418, 2022.
Anticipatory Human-Machine Interaction (Dagstuhl Seminar 22202), Dagstuhl Reports , vol. 12, pp. 131-169, 2022.
Cognitive Modeling of Anticipation: Unsupervised Learning and Symbolic Modeling of Pilots' Mental Representations, Topics in cognitive science , 2022.
Four considerations on interdisciplinary learning at the boundaries of human and engineering sciences, in Frontiers in Education , 2022.
Towards neuroadaptive modeling: assessing the cognitive states of pilots through passive brain-computer interfacing, Current Research in Neuroadaptive Technology , 2022.
- Team
- Umut Çalıkyılmaz
- Rebecca von Engelhardt
- Björn Filter
- Nils Fußgänger
- Jinghua Groppe
- Sven Groppe
- Tobias Groth
- Mattis Hartwig
- Nils Wendel Heinrich
- Hanieh Khorashadizadeh
- Angela König
- Malte Luttermann
- Jörg-Uwe Meyer
- Jeannette Mödlhammer
- Nitin Nayak
- Simon Paasche
- Maximilian Plitt
- Nele Rußwinkel
- Simon Schiff
- Sina Scholz
- Tim Schulz
- Thomas Sievers
- Tobias Winker