Prof. Dr.-Ing. Nele Rußwinkel

Photo of Nele  Rußwinkel

- Head of Institute -

- Research Group Human-Aware AI -


Ratzeburger Allee 160
23562 Lübeck
Gebäude 64, 2. OG, Raum 69

Email: nele.russwinkel(at)uni-luebeck.de
Phone: +49 451 3101 5700

Office Hours

Office hours WS 24/25:
Tuesdays 11 - 12 in my office, room 69 (Building 64, 2nd floor)

Please register in advance by e-mail to IFIS secretariat

Human-Aware AI

The goal for Human-Aware AI is to develop intelligent systems that can work in synergy with human partners in complex dynamic environments.

When intelligent systems are human aware, this means that the system adapts to the task of the human partner in its variations, the situation in its dynamics and uncertainty and the cognitive state of the human partner in-the-loop.

In our research group, dynamic mental models are developed (partly with cognitive architectures) that can, for example, anticipate the human in the interaction or identify intentions of the human partner. These modeling approaches are integrated with systems (e.g. robots) or simulations to enable relevant mutual understanding and proactive support.

The goal of such systems is to leave the control – on a macro level – with the human, while the human experiences adapted support for his and her goals.

Curriculum Vitae

  • Since 1.2.2024 Head of the Institute IFIS
  • Since 12/2022:
    Professor in the field of "Human-Aware AI" at the Institute of Information Systems
    University of Lübeck
  • 02/2013 - 11/2022:
    Junior professor at the department "Cognitive Modeling in Dynamic Human-Machine Systems"
    TU Berlin https://www.tu.berlin/kmodys/ueber-uns/team-1/prof-dr-ing-nele-russwinkel-1
  • 08/2012 - 01/2013:
    Research assistant at the Department of Cognitive Psychology & Cognitive Ergonomics (Prof. Dr. Manfred Thüring), TU Berlin
  • 08/2009 - 07/2012: 
    Postdoc at the Research Training Group "Prometei" - Project "Digital Users & Digital Products", GRK prometei, Berlin
  • 06/2007 - 07/2009:
    Scholarship holder at the Research Training Group "Prometei" ("Prospective Design of Human-Technology Interaction") at the Technical University of Berlin (GRK Prometei), Berlin
  • Dissertation: "Computable quantitative models of duration estimation" (Scientific debate: July 13, 2009)
  • 06/2005 - 06/2007:
    Research assistant at ZMMS in the MoDyS working groupCollaborator on various projects such as:
    IBB Networked Driving: Interruptibility and resumption of operating actions while driving
    Transregio 29 - Determination of requirements for multimodal interface design through the concept of hybrid service bundles (HLB)
  • 01/2005 - 03/2005:
    Internship in the Vision & Motor System Group of the Neurological Clinic of the Charité, Berlin
    Tasks: Experiments with TMS (temporal magnetic stimulation)
  • 10/2003 - 01/2005: 
    Freelancer at Eyesquare, Berlin
  • 07/2003 - 10/2003: 
    Internship at Eyesquare, Berlin
  • 05/2003 - 07/2003: 
    Internship in the field of acceptance and behavioral analysis at Daimler Chrysler, Berlin
  • 10/2001 - 09/2004:
    Master's degree in Cognitive Science with a minor in Psychology, University of Osnabrück
    Master's thesis: "Which factors influence the distribution of visual-spatial attention?" (Charité Berlin, HU Berlin)
  • 10/1998 - 09/2001:
    Bachelor program Cognitive Science, University of Osnabrück
    Bachelor thesis: "The temporal stability of explicit and inferred information"

Research Interests

  • Complex cognition in applied dynamic situations
  • Cognitive Modelling (Cognitive Architectures)
  • Human Robot Collaboration
  • Mental models for dynamic Interaction
  • Models for emergent behavior
  • Agency and sense of Control
  • Embodied Cognition
  • Integration of symbolic and subsymbolic computation

Current Projects

COMPAS II (Computational Cognitive Modeling of the Predictive Active Self in Situated Action)

The interdisciplinary project aims at modeling the role of the active self in the context of situated real-time interaction in a dynamic/spatial environment. In collaboration with Prof. Stefan Kopp (University of Bielefeld), funded by the DFG SPP 2134 "The Active Self".

Closed Projects

DPDU (Digital Product, Digital User)

An interdisciplinary project for holistic modeling of human-machine systems in collaboration with the department of Prof. Klaus Gramann (Biological Psychology and Neuroergonomics, TU Berlin) and Prof. Rainer Stark (Fraunhofer, Industrial Information Technology, TU Berlin), funded by DFG.

AVALANCHE (Adaptiver, Virtueller Assistent zur LAwinenwarnung Nach CHarakter Eigenschaften)

Project AVALANCHE together with Sabine Prezenski funded by Software Campus and BMBF (Bundesministerium für Bildung und Forschung).

COMPAS I (Computational cognitive modeling of the predictive active self in situated action)

The interdisciplinary project aims at modeling the role of the active self in the context of situated real-time interaction in a dynamic/spatial environment. in collaboration with Prof. Stefan Kopp (University of Bielefeld), funded by DFG SPP 2134 "The Active Self".

VolkswagenStiftung Kurswechsel (VW)

Changing course ("Kurswechsel") - new research territory between the life sciences and natural or technical sciences

Publications

2024

Nikita Abalakin, Nils Wendel Heinrich, Annika Österdiekhoff, Stefan Kopp, and Nele Russwinkel,
Allocation of Fixational Eye Movements in Response to Uncertainty in Dynamic Environments, in CogSci 2024 , Proceedings of the Annual Meeting of the Cognitive Science Society, 2024.
Thomas Sievers, and Nele Russwinkel,
Dialect, sentiment analysis, tonality, cognitive modeling – using LLMs as a toolbox for HRI, in LLMs in the RoMan Age , Workshop at the 33nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN 2024), 2024.
Weblink: https://sites.google.com/view/llmra/start
Nils Wendel Heinrich, Annika Österdiekhoff, Stefan Kopp, and Nele Russwinkel,
Goal-directed Allocation of Gaze Reflects Situated Action Control in Dynamic Tasks, in CogSci 2024 , Proceedings of the Annual Meeting of the Cognitive Science Society, 2024.
Alexander Werk, Sina Scholz, Thomas Sievers, and Nele Russwinkel,
How to Provide a Dynamic Cognitive Person Model of a Human Collaboration Partner to a Pepper Robot, in ICCM , Society for Mathematical Psychology, 2024.
Weblink: https://mathpsych.org/presentation/1452
Bibtex: BibTeX
@inproceedings{WeSchoSiRuICCM24,
  author    = {Alexander Werk and Sina Scholz and Thomas Sievers and Nele Russwinkel},
  title     = {How to Provide a Dynamic Cognitive Person Model of a Human Collaboration Partner to a Pepper Robot},
  booktitle = {ICCM},
  year      = {2024},
  volume    = {},
  pages     = {},
  publisher = {Society for Mathematical Psychology},
}
Thomas Sievers, and Nele Russwinkel,
How to use a cognitive architecture for a dynamic person model with a social robot in human collaboration, in Workshop "Robots for Humans" , CEUR Workshop Proceedings, 2024.
Weblink: https://r4h-workshop.github.io/
Thomas Sievers, and Nele Russwinkel,
Interacting with a Sentimental Robot - Making Human Emotions tangible for a Social Robot via ChatGPT, in 2024 IEEE International Conference on Advanced Robotics and Its Social Impacts (ARSO) , 2024. pp. 182-187.
DOI:10.1109/ARSO60199.2024.10557749
Bibtex: BibTeX
@INPROCEEDINGS{10557749,
  author={Sievers, Thomas and Russwinkel, Nele},
  booktitle={2024 IEEE International Conference on Advanced Robotics and Its Social Impacts (ARSO)}, 
  title={Interacting with a Sentimental Robot – Making Human Emotions tangible for a Social Robot via ChatGPT*}, 
  year={2024},
  volume={},
  number={},
  pages={182-187},
  keywords={Emotion recognition;Sentiment analysis;Analytical models;Mood;Social robots;Oral communication;Chatbots},
  doi={10.1109/ARSO60199.2024.10557749}}
Thomas Sievers, and Nele Russwinkel,
Introducing a note of levity to human-robot interaction with dialogs containing irony, sarcasm and jocularity, in IEEE International Conference on Robot and Human Interactive Communication (RO-MAN) , 2024.
Bibtex: BibTeX
@inproceedings{SiRuROMAN24,
  author    = {Thomas Sievers and Nele Russwinkel},
  title     = {Introducing a note of levity to human-robot interaction with dialogs containing irony, sarcasm and jocularity},
  booktitle = {IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)},
  year      = {2024},
  volume    = {},
  pages     = {},
  publisher = {IEEE},
}
Thomas Sievers, and Nele Russwinkel,
Project Report: Requirements for a Social Robot as an Information Provider in the Public Sector, KI - Künstliche Intelligenz , vol. 37, no. 2-4, 2024.
DOI:10.1007/s13218-024-00840-1
Bibtex: BibTeX
@JOUR{10557749,
  author={Sievers, Thomas and Russwinkel, Nele},
  booktitle={KI - Künstliche Intelligenz}, 
  title={Project Report: Requirements for a Social Robot as an Information Provider in the Public Sector}, 
  year={2024},
  volume={37},
  number={2-4},
  pages={},
  keywords={Human-robot interaction;Social robotics;Public sector;ACT-R},
  doi={10.1007/s13218-024-00840-1}}
Annika Österdiekhoff, Nils Wendel Heinrich, Nele Russwinkel, and Stefan Kopp,
Sense of Control in Dynamic Multitasking and its Impact on Voluntary Task-Switching Behavior, in CogSci 2024 , Proceedings of the Annual Meeting of the Cognitive Science Society, 2024.
Thomas Sievers, Nele Russwinkel, and Ralf Möller,
What am I? – Complementing a robot’s task-solving capabilities with a mental model using a cognitive architecture, in Behavior Adaptation and Learning for Assistive Robotics , Workshop at the 33nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN 2024), 2024.
Weblink: https://sites.google.com/view/bailar2024/home
Nils Wendel Heinrich, Annika Österdiekhoff, Stefan Kopp, and Nele Russwinkel,
Developing and Evaluating a Computational Cognitive Model of Sensorimotor Grounded Action Selection Based on Eye-movement Behavior, in Mathpsych / ICCM 2024 , The Society for Mathematical Psychology, 2024.
Weblink: https://mathpsych.org/presentation/1584

2023

Nele Russwinkel, Michael Spitzhirn, Wolfram Remlinger, and Martin Fleischer,
Towards an Approach for a Holistic Ergonomic Work Design Using Physical and Cognitive Digital Human Models, in Advances in Digital Human Modeling , Scataglini, Sofia and Harih, Gregor and Saeys, Wim and Truijen, Steven, Eds. Cham: Springer Nature Switzerland, 2023. pp. 229--237.
ISBN:978-3-031-37848-5
Nele Russwinkel, Michael Spitzhirn, Wolfram Remlinger, and Martin Fleischer,
Towards an Approach for a Holistic Ergonomic Work Design Using Physical and Cognitive Digital Human Models, in Advances in Digital Human Modeling , Scataglini, Sofia and Harih, Gregor and Saeys, Wim and Truijen, Steven, Eds. Cham: Springer Nature Switzerland, 2023. pp. 229--237.
ISBN:978-3-031-37848-5
Bibtex: BibTeX
@InProceedings{10.1007/978-3-031-37848-5_26,
author = {Russwinkel, Nele
and Spitzhirn, Michael
and Remlinger, Wolfram
and Fleischer, Martin},
editor={Scataglini, Sofia
and Harih, Gregor
and Saeys, Wim
and Truijen, Steven},
title = {Towards an Approach for a Holistic Ergonomic Work Design Using Physical and Cognitive Digital Human Models},
booktitle = {Advances in Digital Human Modeling},
year = {2023},
publisher = {Springer Nature Switzerland},
address = {Cham},
pages = {229--237},
abstract = {Digital human models enable an economic and ergonomic design of products and work processes. These models investigate different aspects of the human. Anthropometric and biomechanical human models depict the physical characteristic and are used to examined physical load regarding feasibility and tolerability and in some extent to economic efficiency. Cognitive human models can model task knowledge, expectation driven behavior, learning as well as the impact of restricted resource such as attention and working memory. Only few approaches include cognitive as well as physical aspects at the same time due to complexity of the approaches and different scientific communities. Bringing both fields together will enable a holistic ergonomic work design by including physical and cognitive skills. Based on two use cases from product and production ergonomics, it will be shown (1) how the combination of both model forms can result in ergonomic evaluation (2) what information is needed to flow between model approaches for integration purposes. That will be shown by using a cognitive (cognitive architecture ACT-R) and two anthropometric models (ema Work Designer, RAMSIS). Finally, the potentials of holistic model approaches for the future and the challenges that must be overcome will be discussed.},
isbn = {978-3-031-37848-5}
}
Chenxu Hao, Nele Russwinkel, Daniel F. B. Haeufle, and Philipp Beckerle,
A Commentary on Towards autonomous artificial agents with an active self: Modeling sense of control in situated action , Cognitive Systems Research , vol. 79, pp. 1-3, 2023.
Bibtex: BibTeX
@article{Hao2023ACO,
  title={A Commentary on Towards autonomous artificial agents with an active self: Modeling sense of control in situated action
},
  author={Chenxu Hao and Nele Russwinkel and Daniel F. B. Haeufle and Philipp Beckerle},
  journal={Cognitive Systems Research},
  year={2023},
  volume={79},
  pages={1-3}
}
Kai Preuss, Svenja Nicole Schulte, Lukas Rzazonka, Lilian Befort, Carina Fresemann, Rainer Stark, and Nele Russwinkel,
Towards A Human-Centered Digital Twin, Procedia CIRP , vol. 118, pp. 324-329, 2023.
DOI:https://doi.org/10.1016/j.procir.2023.06.056
File: S2212827123002809
Bibtex: BibTeX
@article{PREUSS2023324,
title = {Towards A Human-Centered Digital Twin},
journal = {Procedia CIRP},
volume = {118},
pages = {324-329},
year = {2023},
note = {16th CIRP Conference on Intelligent Computation in Manufacturing Engineering},
issn = {2212-8271},
doi = {https://doi.org/10.1016/j.procir.2023.06.056},
url = {https://www.sciencedirect.com/science/article/pii/S2212827123002809},
author = {Kai Preuss and Svenja Nicole Schulte and Lukas Rzazonka and Lilian Befort and Carina Fresemann and Rainer Stark and Nele Russwinkel},
keywords = {digital twin, cognitive modeling, human-centered design, user study},
abstract = {The Digital Twin paradigm incorporates the application of virtual prototypes established during product development as well as sensor data collected during the production and use phase. Another aspect concerns digital representation of the product's end users. A stronger connection between a digital product and its digital user would complement the Digital Twin. This paper investigates the concept of coupling a geometrical model of an adjustable operating table including position sensors with a cognitive digital user. Users interacted with both real and virtual instances of the table. Resulting data allow for evaluation of the usability of different interface variants and virtual product representations to develop a cognitive model of end users, showing the potential of a combined Digital Twin in human-centered design.}
}
Thomas Sievers, and Nele Russwinkel,
Talking like one of us: Effects of using regional language in a Humanoid Social Robot, in Social Robotics , Springer, Singapore, 2023. pp. 71-80.
DOI:10.1007/978-981-99-8718-4_7
Bibtex: BibTeX
@INPROCEEDINGS{SiRu,
author ={Thomas Sievers and Nele Russwinkel},
title ={Talking like one of us: Effects of using regional language in a Humanoid Social Robot},
booktitle ={Social Robotics},
year ={2023},
pages = {71-80},
publisher = {Springer, Singapore},
url ={http://dx.doi.org/10.1007/978-981-99-8718-4_7},
keywords ={Social Robots; Human-Robot Interaction; Regional Language; Communication; Cultural Identity},
}
Linda Heimisch, Kai Preuss, and Nele Russwinkel,
Cognitive processing stages in mental rotation – How can cognitive modelling inform HsMM-EEG models?, Neuropsychologia , vol. 188, pp. 108615, 2023.
DOI:https://doi.org/10.1016/j.neuropsychologia.2023.108615
File: S0028393223001495
Bibtex: BibTeX
@article{HEIMISCH2023108615,
title = {Cognitive processing stages in mental rotation – How can cognitive modelling inform HsMM-EEG models?},
journal = {Neuropsychologia},
volume = {188},
pages = {108615},
year = {2023},
issn = {0028-3932},
doi = {https://doi.org/10.1016/j.neuropsychologia.2023.108615},
url = {https://www.sciencedirect.com/science/article/pii/S0028393223001495},
author = {Linda Heimisch and Kai Preuss and Nele Russwinkel},
keywords = {Electroencephalography, Cognitive modelling, HsMM, ACT-R, Mental rotation},
abstract = {The aspiration for insight into human cognitive processing has traditionally driven research in cognitive science. With methods such as the Hidden semi-Markov Model-Electroencephalography (HsMM-EEG) method, new approaches have been developed that help to understand the temporal structure of cognition by identifying temporally discrete processing stages. However, it remains challenging to assign concrete functional contributions by specific processing stages to the overall cognitive process. In this paper, we address this challenge by linking HsMM-EEG3 with cognitive modelling, with the aim of further validating the HsMM-EEG3 method and demonstrating the potential of cognitive models to facilitate functional interpretation of processing stages. For this purpose, we applied HsMM-EEG3 to data from a mental rotation task and developed an ACT-R cognitive model that is able to closely replicate human performance in this task. Applying HsMM-EEG3 to the mental rotation experiment data revealed a strong likelihood for 6 distinct stages of cognitive processing during trials, with an additional stage for non-rotated conditions. The cognitive model predicted intra-trial mental activity patterns that project well onto the processing stages, while explaining the additional stage as a marker of non-spatial shortcut use. Thereby, this combined methodology provided substantially more information than either method by itself and suggests conclusions for cognitive processing in general.}
}

2022

Marlene Susanne Lisa Scharfe-Scherf, Sebastian Wiese, and Nele Russwinkel,
A Cognitive Model to Anticipate Variations of Situation Awareness and Attention for the Takeover in Highly Automated Driving, Inf. , vol. 13, pp. 418, 2022.
Bibtex: BibTeX
@article{ScharfeScherf2022ACM,
  title={A Cognitive Model to Anticipate Variations of Situation Awareness and Attention for the Takeover in Highly Automated Driving},
  author={Marlene Susanne Lisa Scharfe-Scherf and Sebastian Wiese and Nele Russwinkel},
  journal={Inf.},
  year={2022},
  volume={13},
  pages={418}
}
Jelmer P. Borst, Andreas Bulling, Cleotilde Gonz{\'a}lez, and Nele Russwinkel,
Anticipatory Human-Machine Interaction (Dagstuhl Seminar 22202), Dagstuhl Reports , vol. 12, pp. 131-169, 2022.
Bibtex: BibTeX
@article{Borst2022AnticipatoryHI,
  title={Anticipatory Human-Machine Interaction (Dagstuhl Seminar 22202)},
  author={Jelmer P. Borst and Andreas Bulling and Cleotilde Gonz{\'a}lez and Nele Russwinkel},
  journal={Dagstuhl Reports},
  year={2022},
  volume={12},
  pages={131-169}
}
Sebastian Blum, Oliver W. Klaproth, and Nele Russwinkel,
Cognitive Modeling of Anticipation: Unsupervised Learning and Symbolic Modeling of Pilots' Mental Representations, Topics in cognitive science , 2022.
Bibtex: BibTeX
@article{Blum2022CognitiveMO,
  title={Cognitive Modeling of Anticipation: Unsupervised Learning and Symbolic Modeling of Pilots' Mental Representations},
  author={Sebastian Blum and Oliver W. Klaproth and Nele Russwinkel},
  journal={Topics in cognitive science},
  year={2022}
}
Philipp Beckerle, Chenxu Hao, Daniel F. B. Haeufle, and Nele Russwinkel,
Four considerations on interdisciplinary learning at the boundaries of human and engineering sciences, in Frontiers in Education , 2022.
Bibtex: BibTeX
@inproceedings{Beckerle2022FourCO,
  title={Four considerations on interdisciplinary learning at the boundaries of human and engineering sciences},
  author={Philipp Beckerle and Chenxu Hao and Daniel F. B. Haeufle and Nele Russwinkel},
  booktitle={Frontiers in Education},
  year={2022}
}
Laurens R. Krol, Oliver W. Klaproth, Christoph Vernaleken, Nele Russwinkel, and Thorsten O. Zander,
Towards neuroadaptive modeling: assessing the cognitive states of pilots through passive brain-computer interfacing, Current Research in Neuroadaptive Technology , 2022.
Bibtex: BibTeX
@article{Krol2022TowardsNM,
  title={Towards neuroadaptive modeling: assessing the cognitive states of pilots through passive brain-computer interfacing},
  author={Laurens R. Krol and Oliver W. Klaproth and Christoph Vernaleken and Nele Russwinkel and Thorsten O. Zander},
  journal={Current Research in Neuroadaptive Technology},
  year={2022}
}