Supplementary material

Can Music Generation Models Tap Along? Evaluating Generative Approaches to Beat Tracking

Anonymous authors

Summary

We add song-driven conditioning to a pretrained MusicGen so that it generates a percussion track that plays along with a song, and we then extract the beats from this track with a small beat tracker. This page shows examples of these generated percussion tracks and compares their beats with those of other generative and traditional beat tracking methods.

1. Target percussion tracks

Our models are trained to generate one of three percussion tracks (targets), all synthesized or created from the annotated beats. Shown: the first 8 seconds of the pop song in Example 2 below; dashed lines are annotated beats, thicker ones downbeats.

How the Groove targets are made for each genre (Appendix) ↓

2. Model-generated percussion tracks and beat tracking results

Five songs from the test set, which no model saw during training or model selection. In each song, use the Input switch to compare the two inputs: the full mix, or the song with its drums removed by source separation. Click a row name to play that row; the generated tracks are played together with the input song, and the Song / Percussion slider sets the balance between them. Drag the bar above the plot to move in time.

The beats of each generated track are extracted with a small TCN beat tracker trained for that generative model.

Annotated beats Extracted beats Wrong beats

* Ours (w/o DR aug): the same model and target as Ours, but trained without drum-removal (DR) augmentation, so it never heard drum-removed audio during training. Ours replaces the input with drum-removed audio for half of the training examples.

Appendix: the Groove targets

PatternGroove (synth) rhythmGroove (sampled) rhythm
Cha-cha-cha
Ballroom: ChaChaCha
× above the staff: Güiro
▲ top space: Cowbell
× 3rd space: Conga, slap
● middle line: Conga, open
● bottom space: Kick
Jive (shuffle)
swing feel, crash every 8 bars
Ballroom: Jive
× above the staff: Hi-hat
● 3rd space: Snare
● bottom space: Kick
Quickstep
swing feel, crash every 8 bars
Ballroom: Quickstep
× top line: Ride
● 3rd space: Brush (on snare)
● bottom space: Kick
Samba
samba feel
Ballroom: Samba
× above the staff: Shaker
▲ top line: Agogô, high
▲ 4th line: Agogô, low
● 3rd space: Tamborim
● 2nd space: Surdo, muted (+)
● 2nd space: Surdo
Rumba
two-bar pattern
Ballroom: Rumba
× above the staff: Shaker
▲ top space: Clave
× 3rd space: Conga, slap
● middle line: Conga, open
● bottom space: Kick
Tango
Ballroom: Tango
× 3rd space: Rim click
● 3rd space: Snare
● bottom space: Kick
Waltz
3/4
Ballroom: Waltz
× top line: Ride
● 3rd space: Brush (on snare)
● bottom space: Kick
Viennese waltz
3/4
Ballroom: VienneseWaltz
× above the staff: Hi-hat
● 3rd space: Snare
● bottom space: Kick
Pop/rock
crash every 8 bars
Hainsworth: rock, pop; RWC: popular, royalty-free
× above the staff: Hi-hat
● 3rd space: Snare
● bottom space: Kick
Disco
crash every 8 bars
Hainsworth: electronic dance
× above the staff: Hi-hat, open (o)
× above the staff: Hi-hat
× 4th line: Clap
● 3rd space: Snare
● bottom space: Kick
Swing
swing feel, crash every 8 bars
Hainsworth: jazz/blues, big band; RWC: jazz
× top line: Ride
● bottom space: Kick
× below the staff: Hi-hat pedal
Folk
Hainsworth: folk
× above the staff: Shaker
× top space: Tambourine
● bottom space: Kick
Bossa nova
two-bar pattern
Hainsworth: world/Latin
× above the staff: Hi-hat
× 3rd space: Rim click
● bottom space: Kick
Hand clap
Music without drums: Hainsworth classical (orchestral, choral, solo); ASAP piano
× 4th line: Clap

↑ Back to top