Towards an ‘Everything Corpus’: A Framework and Guidelines for the Curation of More Comprehensive Multimodal Music Data

Gotham, Mark; Bemman, Brian; Vatolkin, Igor

Abstract

Music information retrieval (MIR) is increasingly concerned with properly managing the complexity of musical data and the curation of high-quality multimodal datasets for use in a variety of computational tasks. This article presents (1) a conceptual framework for how practitioners interested in MIR—from musicians to scientists—can understand the multitude of modalities that constitute musical data and (2) a set of proposed guidelines for MIR researchers to consider when setting out to curate comprehensive, well-targeted, durable, and ethically sourced multimodal datasets. For (1), we identify 12 different themes of musical data divided into three, sequential phases further subdivided into five, narrow focus areas: (i) ‘before’ the music (leading to), (ii) the ‘actual’ music (itself and around it), and (iii) ‘after’ the music (uses of and responses to). For (2), we identify 17 specific quantitative, qualitative, and ethical criteria, informed by this conceptual framework and practices observed in existing multimodal datasets, for the eventual construction of an ‘Everything Corpus’ for MIR research.

Citation

Gotham, M., Bemman, B., & Vatolkin, I. (2025). Towards an ‘Everything Corpus’: A Framework and Guidelines for the Curation of More Comprehensive Multimodal Music Data. Transactions of the International Society for Music Information Retrieval, 8(1), 70-92. https://doi.org/10.5334/tismir.228

• Journal Article Type: Article
• Acceptance Date: Feb 25, 2025
• Online Publication Date: May 5, 2025
• Publication Date: 2025
• Deposit Date: Jul 17, 2025
• Publicly Available Date: Jul 17, 2025
• Journal: Transactions of the International Society for Music Information Retrieval
• Electronic ISSN: 2514-3298
• Publisher: Ubiquity Press
• Peer Reviewed: Peer Reviewed
• Volume: 8
• Issue: 1
• Pages: 70-92
• DOI: https://doi.org/10.5334/tismir.228
• Public URL: https://durham-repository.worktribe.com/output/4269670