Projects
2010 – 2012
Audiominer
Mathematical Signal Analysis and Modeling for Manipulation of Sound Objects
An important open research question in Music Information Retrieval (MIR) is the extraction of sound objects (e.g. a guitar chord, the beat of a bass drum, the bark of a dog) from polyphonic audio. Recent theoretical advances in mathematical signal processing indicate the possibility of a decisive improvement in identifying and extracting sound objects directly from the time-frequency plane. These mined sound objects can then automatically be organized into perceptually meaningful and easy to navigate sound libraries using the latest innovations in MIR based music similarity. Together this will form the core of a powerful new toolkit for audio manipulation with widespread applicability in fields like Sound Design, Computational Auditory Scene Analysis, Artefact Reduction or Audio Database Organisation.
2009 – 2012
IRIS
Integrating Research in Interactive Storytelling
IRIS (Integrating Research in Interactive Storytelling) is a European NoE (Network of Excellence) which aims at creating a virtual centre of excellence that will be able to achieve breakthroughs in the understanding of Interactive Storytelling and the development of corresponding technologies. Interactive Storytelling is a major endeavour to develop new media which could offer a radically new user experience, with a potential to revolutionise digital entertainment. The IRIS consortium involves ten partners in seven different countries in Europe.
2010-05 – 2012
OREX
Ontologiebasierte Informationsextraktion und Suche
In this project we aim at developing and implementing ontology-driven methods for domain-specific information extraction and retrieval.
2012 –
Self-awareness and User-awareness Through Theory of Mind and Empathy
In this project, we intend to go one step further and try to develop user-awareness and self-awareness through Theory of Mind (ToM) and Empathy in intelligent software agents or robots that have to take on complex interactive tasks. While context-awareness is based on "perception" of the environment, self-awareness is based in particular on registration of important "inner" states that can influence decisions. Time components, Theory of Mind and Empathy are aspects of self-awareness and user-awareness that have to be taken into account in this project.
2011 –
Investigating Requirements for Context-awareness and an Attempt to Implement it in Software Agents or Robots
In this project, we dealt with this topic in a theoretical and an applicable way with the aim of implementing aspects of context awareness in a software agent or a robot. Philosophical, psychological, and neuroscientific aspects of consciousness as well as their modeling are a central topic of interest in many disciplines of cognitive science. The approach of this issue has the aim of assessing human and animal consciousness, better understanding its underlying mechanisms and to develop and implement computational models.
2009 – 2011
L4S
Learning for Security
L4S - Learning for Security is a European STReP (Small or medium-scale focused research project) that aims to develop simulation based learning experiences and to provide guidelines and tools for the development of soft skills necessary in effective crisis management.
2009 – 2011
MAGNIFICENT
Multifaceted Analysis of News Articles for Intelligent User- and Context-Sensitive Presentation
Little is known in hard facts about why readers of online newspapers prefer some articles over others. Current news filtering systems assume that the topic of an article is the only factor that determines user satisfaction. But content accounts only for about 40% of a story's satisfaction rating. Factors that determine the remaining 60% can be as diverse as readability concerns, writing style, the type of a story, visual complexity, proper use of photographs, or, even less concretely, the appeal of a story. Contextual information, like previously read articles or the overall popularity and recentness of articles, needs to be considered as well. The goal of MAGNIFICENT is to gain deep insight into both the relevant parameters of stories and the adaptive training of user profiles along these parameters.
2009 – 2011
Sera
Social Engagement with Robots and Agents
SERA (Social Engagement with Robots and Agents) is a European Collaborative Project which aims to advance science in the field of social acceptability of verbally interactive robots and agents, with a view to their applications especially in assistive technologies (companions, virtual butlers).
2009 – 2011
C4U
Companions für Userinnen
In our project work we aim at developing a better understanding of female attitudes and requirements regarding companion technology.
2008 – 2010
Towards automatic annotation of electro-acoustic music
This project was about automation of annotation of electro-acoustic music through application of machine learning methods. Electro-acoustic music is a contemporary form of electronic composition and production of music that originated in the 1940s. It is made with electronic technology, using synthesized sounds or prerecorded sounds from nature and studio which are often extensively processed and altered. Compared to the analysis of instrumental or vocal music, annotation of electro-acoustic music is both more challenging and less developed. There exist no "pre-segmented" discrete units like notes, there is no score and no universally established system for analysis. Although musicology has developed various sets of tools for analysis of electro-acoustic music, the tediousness of manual annotation has prevented the application of these theories to a larger body of music. On the other hand, Music Information Retrieval has developed a rich repertoire of machine learning algorithms for analysis of music, including methods that can be used for automatic annotation. Our essential result is that machine learning methods can indeed be used for annotation of electro-acoustic music but only in an interactive setting. Only the integration of a human analyst into the workflow allows to sidestep the seeming impasse that the lack of ground in annotation of electro-acoustic music presents.