Internal noise far outweighs external noise in the context of listening and absorbing the words of a speaker. I have issues with letting my moral and ethical beliefs influence how information is absorbed, or how I react to certain speakers in certain situations. To ratify this issue, I have been working on analyzing every word put into my head and draw many conclusions about something he/she has spoken to me, and also I have been working on being less like a rock with any information and more like a sponge-even if the absorption stays for a brief time.
Now that you mention it I can also find how internal noise can be more distracting, but you're still wrong.