Chapter 12. Musical Robots: Overview and Methods for Evaluation
Author: Emma Frid
Abstract: Musical robots are complex systems that require the integration of several different functions to successfully operate. These processes range from sound analysis and music representation to mapping and modeling of musical expression. Recent advancements in Computational Creativity (CC) and Artificial Intelligence (AI) have added yet another level of complexity to these settings, with aspects of Human–AI Interaction (HAI) becoming increasingly important. The rise of intelligent music systems raises questions not only about the evaluation of Human-Robot Interaction (HRI) in robot musicianship but also about the quality of the generated musical output. The topic of evaluation has been extensively discussed and debated in the fields of Human–Computer Interaction (HCI) and New Interfaces for Musical Expression (NIME) throughout the years. However, interactions with robots often have a strong social or emotional component, and the experience of interacting with a robot is therefore somewhat different from that of interacting with other technologies. Since musical robots produce creative output, topics such as creative agency and what is meant by the term “success” when interacting with an intelligent music system should also be considered. The evaluation of musical robots thus expands beyond traditional evaluation concepts such as usability and user experience. To explore which evaluation methodologies might be appropriate for musical robots, this chapter first presents a brief introduction to the field of research dedicated to robotic musicianship, followed by an overview of evaluation methods used in the neighboring research fields of HCI, HRI, HAI, NIME, and CC. The chapter concludes with a review of evaluation methods used in robot musicianship literature and a discussion of prospects for future research.
Robots mentioned in the chapter:
- Beyoncé hologram Video
- Captured! by Robots (GTRBOT666) Website Sounds Videos Pictures
- Cog Website Publication
- Compressorhead Website Sounds Videos Publication
- Diemut Strebe's The Prayer Website Video
- Edwin Scott Votey's Pianola The Pianola Institute's Website Wikipedia
- Eazy-E (N.W.A.) hologram Video
- Expressive Machines Musical Instruments (EMMI) Videos Publication
- Fredrik Gran's Cello robot Website Videos
- Formant Brothers' "Le Tombeau de Freddie" (voice synthesis) Website Video
- Gil Weinberg's Haile (robotic percussionist) Video Publication Wikipedia
- Gil Weinberg's Shimon Website Sounds Videos (see also Shimon's and Gil Weinberg's websites)
- Gorillaz "Clint Eastwood" hologram Video
- Hatsune Miku Website Videos (see also concert video playlist here) Wikipedia
- Ismail ibn al-Razzaz al-Jazari’s mechanical boat with four musical automata Publication (see page 107)
- Jacques de Vaucanson’s Flute Player automata Wikipedia Picture Publication
- Kagamine Rin and Len Website Wikipedia
- Kurt Cobain simulation for Guitar Hero 5 Wikipedia Video
- LEMUR: League of Electronic Musical Urban Robots (TibetBot, Modbots, ShivaBot) Website Publication Wikipedia (see also Eric Singer's Website and Videos)
- Makoto Kajitani's MUBOT Publication (see also Fig. 11 a in Ajay Kapur's paper)
- Mariah Carey hologram Video
- Michael Gurevich's String Trees Video Publication
- Michael Jackson "Slave to the Rhythm" hologram Video
- MusiArm (D-knock, Eleee, TronS) Website Videos Publication
- N.A. Baginsky's Aglaopheme (The Three Sirens) Website (see also this link for a detailed description and N.A. Baginsky's Website) Sounds Pictures Video Publication
- Old Dirty Bastard (Wu-Tang Clan) hologram Video
- Paweł Zadrożniak's Floppotron Website Video Video
- Pierre Jaquet-Droz’s Musical Lady Website Video Wikipedia
- Roger Dannenberg's McBlare Website (includes sound examples) Videos Publication</li>
- Sergio Jordà's Afasia Project (guitar robot, violin robot) Publication
- Skywalker Piano Hand (Georgia Tech) Website Video Publication
- Robotic Drumming Prostethic Arm (Georgia Tech) Website Video (longer video here) </a> Publication
- Third Drumming Arm (Georgia Tech) Website Video Publication
- Saxophonist Robot No. 2 (WAS2, Waseda University) Website
- The Trons (robot garage band) Sounds Video Publication Wikipedia
- Trimpin's robotic idiophones Wikipedia Publication
- Tupac Shakur hologram with Dr. Dre and Snoop Dogg at Coachella Video
- Utatane Piko Website Wikipedia
- Waseda Flutist (No. 4, also called Refined VI, or WF-4RVI) Publication Video
- Waseda WABOT-2 Webpage Video Publication
- Zimoun's sound sculptures Website Videos Wikipedia
- Classify the robot using existing taxonomies
- Specify the context (and goal, if there is such a thing) of the musical interaction
- Identify stakeholders
- Informed by steps 1–3, identify evaluation methods from the literature and adapt them, if necessary