Unwanted Metronome during playback

On the Metronome settings dialog, I have only the “Recording” box checked in the “When to use” pane, but the met plays when I playback as well (unless I mute the metronome).

Anyone else find this? What gives?