If you’re on a PC, you can try Ashisoft Duplicate File Finder (free download) to remove duplicates. It kicks butt. I know from personal experience, having been in a situation similar to yours when I decided to finally get it under control about a year ago.
