Super User is a question and answer site for computer enthusiasts and power users. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

As part of an exercise to help reduce the duplication of files, management would like to get a report of all duplicate binary files including images as these seems to exceed 100,000 or more and considering the size of these, it has an impact on backup. Is there a way to locate duplicate files, spit out a report and then run through a process of deleting these or archiving them. Ideally the applications should work with Windows or Linux.

share|improve this question
Have you tried some suggestions from this SU question?. It seems that doubles will fit your needs – nixda Aug 10 '13 at 8:35
up vote 2 down vote accepted

You can use fdupes to achieve it. FDUPES is a program for identifying or deleting duplicate files residing within specified directories.

share|improve this answer

I did this under linux (for my music) by doing an md5sum on all the files, then sorting and counting the number of unique MD5 strings and where there was more then 1 matching them up with the file associated with the MD5 and printing it out. I must say that I think the FDUPES answer above is probably a better one, but my solution just uses whats available on a stock linux install.

share|improve this answer

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .