“That’s What I Get” is a fairly straightforward song about infidelity, notable for its use of steel drum synth in the bass line that begins the song. The song itself is minimal in its construction, relying on atmospheric keyboard pads for its harmony and Reznor’s singing for the lead melodies until the reappearance of the synth voice from “Down in It” in the latter half of the song. Percussion, present throughout much of the track, is used less obviously compared to the rest of the record: a prominent beat doesn’t enter the track until the second half, the first relying on the movement of the bass track and quieter percussion loops.