Version DOI GitHub repo size License

This is a README file for a data repository originating from the DCML corpus initiative and serves as welcome page for both

For information on how to obtain and use the dataset, please refer to this documentation page.

Edvard Grieg - Lyric Pieces (A corpus of annotated scores)#

This corpus of annotated MuseScore files has been created within the DCML corpus initiative and employs the DCML harmony annotation standard. It is one out of nine similar corpora that have been grouped together to An Annotated Corpus of Tonal Piano Music from the Long 19th Century which comes with a data report that is currently in press at Empirical Musicology Review.

Version history#

See the GitHub releases.

Getting the data#

With full version history#

The dataset is version-controlled via git. In order to download the files with all revisions they have gone through, git needs to be installed on your machine. Then you can clone this repository using the command

git clone https://github.com/DCMLab/grieg_lyric_pieces.git

Without full version history#

If you are only interested in the current version of the corpus, you can simply download and unpack this ZIP file.

Data Formats#

Each piece in this corpus is represented by four files with identical names, each in its own folder. For example, the first movement has the following files:

  • MS3/op12n01.mscx: Uncompressed MuseScore file including the music and annotation labels.

  • notes/op12n01.tsv: A table of all note heads contained in the score and their relevant features (not each of them represents an onset, some are tied together)

  • measures/op12n01.tsv: A table with relevant information about the measures in the score.

  • harmonies/op12n01.tsv: A list of the included harmony labels (including cadences and phrases) with their positions in the score.

Opening Scores#

After navigating to your local copy, you can open the scores in the folder MS3 with the free and open source score editor MuseScore. Please note that the scores have been edited, annotated and tested with MuseScore 3.6.2. MuseScore 4 has since been released and preliminary tests suggest that it renders them correctly.

Opening TSV files in a spreadsheet#

Tab-separated value (TSV) files are like Comma-separated value (CSV) files and can be opened with most modern text editors. However, for correctly displaying the columns, you might want to use a spreadsheet or an addon for your favourite text editor. When you use a spreadsheet such as Excel, it might annoy you by interpreting fractions as dates. This can be circumvented by using Data --> From Text/CSV or the free alternative LibreOffice Calc. Other than that, TSV data can be loaded with every modern programming language.

Loading TSV files in Python#

Since the TSV files contain null values, lists, fractions, and numbers that are to be treated as strings, you may want to use this code to load any TSV files related to this repository (provided you’re doing it in Python). After a quick pip install -U ms3 (requires Python 3.10) you’ll be able to load any TSV like this:

import ms3

labels = ms3.load_tsv('harmonies/op12n01.tsv')
notes = ms3.load_tsv('notes/op12n01.tsv')

How to read metadata.tsv#

This section explains the meaning of the columns contained in metadata.tsv.

File information#

column

content

fname

name without extension (for referencing related files)

rel_path

relative file path of the score, including extension

subdirectory

folder where the score is located

last_mn

last measure number

last_mn_unfolded

number of measures when playing all repeats

length_qb

length of the piece, measured in quarter notes

length_qb_unfolded

length of the piece when playing all repeats

volta_mcs

measure counts of first and second endings

all_notes_qb

summed up duration of all notes, measured in quarter notes

n_onsets

number of note onsets

n_onset_positions

number of unique note onsets (“slices”)

Composition information#

column

content

composer

composer name

workTitle

work title

composed_start

earliest composition date

composed_end

latest composition date

workNumber

Catalogue number(s)

movementNumber

1, 2, or 3

movementTitle

title of the movement

Score information#

column

content

label_count

number of chord labels

KeySig

key signature(s) (negative = flats, positive = sharps)

TimeSig

time signature(s)

musescore

MuseScore version

source

URL to the first typesetter’s file

typesetter

first typesetter

annotators

creator(s) of the chord labels

reviewers

reviewer(s) of the chord labels

Identifiers#

These columns provide a mapping between multiple identifiers for the sonatas (not for individual movements).

column

content

wikidata

URL of the WikiData item

viaf

URL of the Virtual International Authority File (VIAF) entry

musicbrainz

MusicBrainz identifier

imslp

URL to the wiki page within the International Music Score Library Project (IMSLP)

Generating all TSV files from the scores#

When you have made changes to the scores and want to update the TSV files accordingly, you can use the following command (provided you have pip-installed ms3):

ms3 extract -M -N -X -D # for measures, notes, expanded annotations, and metadata

If, in addition, you want to generate the reviewed scores with out-of-label notes colored in red, you can do

ms3 review -M -N -X -D # for extracting measures, notes, expanded annotations, and metadata

By adding the flag -c to the review command, it will additionally compare the (potentially modified) annotations in the score with the ones currently present in the harmonies TSV files and reflect the comparison in the reviewed scores.

Questions, Suggestions, Corrections, Bug Reports#

For questions, remarks etc., please create an issue and feel free to fork and submit pull requests.

License#

Creative Commons Attribution-ShareAlike 4.0 International License (CC BY-SA 4.0).

Naming convention#

The file names listed in the Overview below refer to the opus numbers of the 10 books.

Overview#

file_name

measures

labels

standard

annotators

reviewers

op12n01

23

43

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.30)

Adrian Nagel

op12n02

79

125

2.3.0

Adrian Nagel (2.1.0), John Heilig (2.3.0)

Adrian Nagel

op12n03

52

110

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op12n04

72

97

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op12n05

40

109

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op12n06

56

126

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op12n07

56

74

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op12n08

32

78

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op38n01

86

141

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op38n02

41

46

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op38n03

48

87

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op38n04

36

66

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op38n05

41

70

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op38n06

47

104

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op38n07

53

55

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op38n08

84

130

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op43n01

42

102

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op43n02

30

98

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op43n03

35

112

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op43n04

36

52

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op43n05

36

110

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op43n06

72

127

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op47n01

184

158

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op47n02

126

183

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op47n03

106

93

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op47n04

38

21

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op47n05

41

109

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op47n06

74

83

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op47n07

97

134

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op54n01

61

110

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op54n02

159

286

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op54n03

194

267

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op54n04

63

91

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op54n05

204

118

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op54n06

90

171

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op57n01

146

313

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op57n02

125

183

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op57n03

67

186

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op57n04

92

116

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op57n05

169

202

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op57n06

95

156

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op62n01

90

72

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op62n02

81

163

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op62n03

65

95

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op62n04

81

97

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op62n05

62

45

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op62n06

150

173

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op65n01

173

203

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op65n02

26

128

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op65n03

58

87

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op65n04

71

112

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op65n05

48

128

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op65n06

179

222

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op68n01

56

156

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op68n02

88

186

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op68n03

114

134

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op68n04

90

85

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op68n05

43

95

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op68n06

202

200

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op71n01

95

180

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op71n02

54

107

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op71n03

79

72

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op71n04

77

87

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op71n05

98

155

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op71n06

32

133

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

op71n07

74

74

2.3.0

Adrian Nagel (2.1.1), John Heilig (2.3.0)

Adrian Nagel

Overview table automatically updated using ms3.

Further information: