Supplementary material
We add song-driven conditioning to a pretrained MusicGen so that it generates a percussion track that plays along with a song, and we then extract the beats from this track with a small beat tracker. This page shows examples of these generated percussion tracks and compares their beats with those of other generative and traditional beat tracking methods.
Our models are trained to generate one of three percussion tracks (targets), all synthesized or created from the annotated beats. Shown: the first 8 seconds of the pop song in Example 2 below; dashed lines are annotated beats, thicker ones downbeats.
How the Groove targets are made for each genre (Appendix) ↓
Five songs from the test set, which no model saw during training or model selection. In each song, use the Input switch to compare the two inputs: the full mix, or the song with its drums removed by source separation. Click a row name to play that row; the generated tracks are played together with the input song, and the Song / Percussion slider sets the balance between them. Drag the bar above the plot to move in time.
The beats of each generated track are extracted with a small TCN beat tracker trained for that generative model.
* Ours (w/o DR aug): the same model and target as Ours, but trained without drum-removal (DR) augmentation, so it never heard drum-removed audio during training. Ours replaces the input with drum-removed audio for half of the training examples.
| Pattern | Groove (synth) rhythm | Groove (sampled) rhythm |
|---|---|---|
Cha-cha-cha Ballroom: ChaChaCha | × above the staff: Güiro ▲ top space: Cowbell × 3rd space: Conga, slap ● middle line: Conga, open ● bottom space: Kick | |
Jive (shuffle) swing feel, crash every 8 bars Ballroom: Jive | × above the staff: Hi-hat ● 3rd space: Snare ● bottom space: Kick | |
Quickstep swing feel, crash every 8 bars Ballroom: Quickstep | × top line: Ride ● 3rd space: Brush (on snare) ● bottom space: Kick | |
Samba samba feel Ballroom: Samba | × above the staff: Shaker ▲ top line: Agogô, high ▲ 4th line: Agogô, low ● 3rd space: Tamborim ● 2nd space: Surdo, muted (+) ● 2nd space: Surdo | |
Rumba two-bar pattern Ballroom: Rumba | × above the staff: Shaker ▲ top space: Clave × 3rd space: Conga, slap ● middle line: Conga, open ● bottom space: Kick | |
Tango Ballroom: Tango | × 3rd space: Rim click ● 3rd space: Snare ● bottom space: Kick | |
Waltz 3/4 Ballroom: Waltz | × top line: Ride ● 3rd space: Brush (on snare) ● bottom space: Kick | |
Viennese waltz 3/4 Ballroom: VienneseWaltz | × above the staff: Hi-hat ● 3rd space: Snare ● bottom space: Kick | |
Pop/rock crash every 8 bars Hainsworth: rock, pop; RWC: popular, royalty-free | × above the staff: Hi-hat ● 3rd space: Snare ● bottom space: Kick | |
Disco crash every 8 bars Hainsworth: electronic dance | × above the staff: Hi-hat, open (o) × above the staff: Hi-hat × 4th line: Clap ● 3rd space: Snare ● bottom space: Kick | |
Swing swing feel, crash every 8 bars Hainsworth: jazz/blues, big band; RWC: jazz | × top line: Ride ● bottom space: Kick × below the staff: Hi-hat pedal | |
Folk Hainsworth: folk | × above the staff: Shaker × top space: Tambourine ● bottom space: Kick | |
Bossa nova two-bar pattern Hainsworth: world/Latin | × above the staff: Hi-hat × 3rd space: Rim click ● bottom space: Kick | |
Hand clap Music without drums: Hainsworth classical (orchestral, choral, solo); ASAP piano | × 4th line: Clap |