This is because high-level logical instances of interactive music are not stopped when unloading banks. You stop hearing music simply because this logical instance fails to start playback of segments, tracks and audio clips that have been unloaded.
If your intent is to stop music while unloading the bank, you should do so by posting a Stop event on your interactive music.
Refer to this article for more details on the effects of bank unloading.