While I don't have the physiological hearing issue, I too find it impossible to learn languages purely from audio presentation. If I learn the vocabulary visually first, then I have a hope of being able to track it aurally. But with audio immersion, I can't always even work out what sounds I'm hearing, much less how to sequence the words.
no subject