Muffled sound when on a phone call and listening to music/media

When on a phone call the sound for the other person is described as very crisp and clear. The moment I play a youtube video or listen to music that changes and my voice becomes highly muffled for the other person. I'm wondering if there is a fix for this. I've made sure the microphone holes are clear of debris. It only happens when playing media sounds.