OFAI

Technical Reports - Query Results

Your query term was 'number = 2019-01'
1 report found
OFAI-TR-2019-01 ( 159kB PDF file)

Can We Increase Inter- and Intra-Rater Agreement in Modeling General Music Similarity?

Arthur Flexer, Taric Lallai

We present a pilot study on ways to increase inter- and intra-rater agreement in quantification of general similarity between pieces of music. By using a more controlled group of human subjects and carefully curating song material, we try to increase overall agreement between raters concerning the perceived general similarity of songs. Repeated conduction of the experiment with a two week lag shows that intra-rater agreement is higher than inter-rater agreement. Analysis of the results and interviews with test subjects suggests that the genre of songs was a major factor in judging similarity between songs. We discuss the impacts of our results on evaluation of respective machine learning models and question the validity of experiments on general music similarity.

Keywords: Music Information Retrieval, Evaluation, Validity, Rater Agreement

Citation: Flexer A., Lallai T.: Can We Increase Inter- and Intra-Rater Agreement in Modeling General Music Similarity?, 20th International Society for Music Information Retrieval Conference, Delft, The Netherlands, 2019.