Publications

Creating musical features using multi-faceted, multi-task encoders based on transformers

Abstract

Computational machine intelligence approaches have enabled a variety of music-centric technologies in support of creating, sharing and interacting with music content. A strong performance on specific downstream application tasks, such as music genre detection and music emotion recognition, is paramount to ensuring broad capabilities for computational music understanding and Music Information Retrieval. Traditional approaches have relied on supervised learning to train models to support these music-related tasks. However, such approaches require copious annotated data and still may only provide insight into one view of music—namely, that related to the specific task at hand. We present a new model for generating audio-musical features that support music understanding, leveraging self-supervision and cross-domain learning. After pre-training using masked reconstruction of musical input features using …

Date
July 3, 2023
Authors
Timothy Greer, Xuan Shi, Benjamin Ma, Shrikanth Narayanan
Journal
Scientific Reports
Volume
13
Issue
1
Pages
10713
Publisher
Nature Publishing Group UK