It seems that some kind of bug Premiere has (like you mentioned it happens randomly). I have experience that several times and all I do is export the audio from the video in .wav and then link the new audio with the video in Premiere. Its kind of troublesome, but it fix the problem. That happens with some video formats, not sure which ones (I haven’t have this problem with AVCHD Raw footage)
