Why does my music stop playing when I open another app

When playing music, and opening the camera app, or any app that would create a sound (like a new message incoming), the music player stops. Is this normal?

Its really annoying when listening to music on headphones, and the music stops/pauses for any sound that might occur. It completely stops if you open the camera app and does not start again until you close the camera app.