I've been using FireWire800 for the past 6 years, and eSATA more recently.
USB 2.0 was simply never good for streaming video playback, due to the technical specs.
Are you using USB 3.0? Is it any good for HD video? I've found surprisingly little info on this topic.