Human-robot interaction with the Pepper robot

The humanoid social robot Pepper was developed by Aldebaran and first released in 2015. The robot is 120 centimeters tall and optimized for human interaction. It is able to engage with people through conversation, gestures and its touch screen. Pepper is equipped with internal sensors, four directional microphones in his head and speakers for voice output. Speech recognition and dialog is available in 15 languages. The robot features an open and fully programmable platform so that developers can program their own applications to run on Pepper.

In our research group, various applications have been developed which, for example, integrate various external online services such as ChatGPT, DeepL or SUMM AI via different APIs in order to give the robot appropriate communication capabilities. Various studies investigate the interaction between humans and robots with regard to the perception and effect of the robot on the part of the human as well as the modeling of a cognitive model that the robot gains from the human.

Head

Current Members

Projects

Completed Projects

Publications

2024

Thomas Sievers, and Ralf Möller,
Get it right: Improving Comprehensibility with adaptable Speech Expression of a Humanoid Service Robot, in AMLDA 2023: Applied Machine Learning and Data Analytics , 2024. pp. 1-14.
DOI:10.1007/978-3-031-55486-5_1
Bibtex: BibTeX
@INPROCEEDINGS{SiMo,
author ={Thomas Sievers and Ralf M\"oller},
title ={Get it right: Improving Comprehensibility with adaptable Speech Expression of a Humanoid Service Robot},
booktitle ={6th International Conference on Applied Machine Learning and Data Analytics (AMLDA)},
year ={2023},
pages = {},
publisher = {},
url ={},
keywords ={Social Robot; Human-Robot Interaction; Easy Language; Comprehensibility; Translation},
}
Alexander Werk, Sina Scholz, Thomas Sievers, and Nele Russwinkel,
How to Provide a Dynamic Cognitive Person Model of a Human Collaboration Partner to a Pepper Robot, in ICCM , Society for Mathematical Psychology, 2024.
Weblink: https://mathpsych.org/presentation/1452
Bibtex: BibTeX
@inproceedings{WeSchoSiRuICCM24,
  author    = {Alexander Werk and Sina Scholz and Thomas Sievers and Nele Russwinkel},
  title     = {How to Provide a Dynamic Cognitive Person Model of a Human Collaboration Partner to a Pepper Robot},
  booktitle = {ICCM},
  year      = {2024},
  volume    = {},
  pages     = {},
  publisher = {Society for Mathematical Psychology},
}
Thomas Sievers, and Nele Russwinkel,
How to use a cognitive architecture for a dynamic person model with a social robot in human collaboration, in Workshop "Robots for Humans" , CEUR Workshop Proceedings, 2024.
Thomas Sievers, and Nele Russwinkel,
Interacting with a Sentimental Robot - Making Human Emotions tangible for a Social Robot via ChatGPT, in 2024 IEEE International Conference on Advanced Robotics and Its Social Impacts (ARSO) , 2024. pp. 182-187.
DOI:10.1109/ARSO60199.2024.10557749
Bibtex: BibTeX
@INPROCEEDINGS{10557749,
  author={Sievers, Thomas and Russwinkel, Nele},
  booktitle={2024 IEEE International Conference on Advanced Robotics and Its Social Impacts (ARSO)}, 
  title={Interacting with a Sentimental Robot – Making Human Emotions tangible for a Social Robot via ChatGPT*}, 
  year={2024},
  volume={},
  number={},
  pages={182-187},
  keywords={Emotion recognition;Sentiment analysis;Analytical models;Mood;Social robots;Oral communication;Chatbots},
  doi={10.1109/ARSO60199.2024.10557749}}
Thomas Sievers, and Nele Russwinkel,
Introducing a note of levity to human-robot interaction with dialogs containing irony, sarcasm and jocularity, in IEEE International Conference on Robot and Human Interactive Communication (RO-MAN) , 2024.
Bibtex: BibTeX
@inproceedings{SiRuROMAN24,
  author    = {Thomas Sievers and Nele Russwinkel},
  title     = {Introducing a note of levity to human-robot interaction with dialogs containing irony, sarcasm and jocularity},
  booktitle = {IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)},
  year      = {2024},
  volume    = {},
  pages     = {},
  publisher = {IEEE},
}
Thomas Sievers, and Nele Russwinkel,
Project Report: Requirements for a Social Robot as an Information Provider in the Public Sector, KI - Künstliche Intelligenz , vol. 37, no. 2-4, 2024.
DOI:10.1007/s13218-024-00840-1
Bibtex: BibTeX
@JOUR{10557749,
  author={Sievers, Thomas and Russwinkel, Nele},
  booktitle={KI - Künstliche Intelligenz}, 
  title={Project Report: Requirements for a Social Robot as an Information Provider in the Public Sector}, 
  year={2024},
  volume={37},
  number={2-4},
  pages={},
  keywords={Human-robot interaction;Social robotics;Public sector;ACT-R},
  doi={10.1007/s13218-024-00840-1}}

2023

Thomas Sievers, Magnus Bender, and Ralf Möller,
Connecting AI Technologies as Online Services to a Humanoid Service Robot, in 15th International Conference on Computer and Automation Engineering (ICCAE) , IEEE, 2023. pp. 431-435.
DOI:10.1109/ICCAE56788.2023.10111181
Bibtex: BibTeX
@INPROCEEDINGS{SiBeMo,
author ={Thomas Sievers and Magnus Bender and Ralf M\"oller},
title ={Connecting AI Technologies as Online Services to a Humanoid Service Robot},
booktitle ={15th International Conference on Computer and Automation Engineering (ICCAE)},
year ={2023},
pages = {431-435},
publisher = {{IEEE}},
url ={http://dx.doi.org/10.1109/ICCAE56788.2023.10111181},
keywords ={Humanoid Robot; Human-Robot Interaction; Application Programming Interface; AI Democratization},
}
Thomas Sievers, and Nele Russwinkel,
Talking like one of us: Effects of using regional language in a Humanoid Social Robot, in Social Robotics , Springer, Singapore, 2023. pp. 71-80.
DOI:10.1007/978-981-99-8718-4_7
Bibtex: BibTeX
@INPROCEEDINGS{SiRu,
author ={Thomas Sievers and Nele Russwinkel},
title ={Talking like one of us: Effects of using regional language in a Humanoid Social Robot},
booktitle ={Social Robotics},
year ={2023},
pages = {71-80},
publisher = {Springer, Singapore},
url ={http://dx.doi.org/10.1007/978-981-99-8718-4_7},
keywords ={Social Robots; Human-Robot Interaction; Regional Language; Communication; Cultural Identity},
}