System audio on the recorder bar records everything your Mac plays: a video's soundtrack, notification sounds, an app's music. It is on by default; click it to switch to No system audio.
Screen Motion's own sounds are always left out.
System audio and your microphone are recorded separately, and both play in the editor. To change the overall volume or mute the recording, use the Audio settings. See Audio.