Take the 2-minute tour ×
Super User is a question and answer site for computer enthusiasts and power users. It's 100% free, no registration required.

As part of an exercise to help reduce the duplication of files, management would like to get a report of all duplicate binary files including images as these seems to exceed 100,000 or more and considering the size of these, it has an impact on backup. Is there a way to locate duplicate files, spit out a report and then run through a process of deleting these or archiving them. Ideally the applications should work with Windows or Linux.

share|improve this question
1  
Have you tried some suggestions from this SU question?. It seems that doubles will fit your needs –  nixda Aug 10 '13 at 8:35

2 Answers 2

up vote 2 down vote accepted

You can use fdupes to achieve it. FDUPES is a program for identifying or deleting duplicate files residing within specified directories.

share|improve this answer

I did this under linux (for my music) by doing an md5sum on all the files, then sorting and counting the number of unique MD5 strings and where there was more then 1 matching them up with the file associated with the MD5 and printing it out. I must say that I think the FDUPES answer above is probably a better one, but my solution just uses whats available on a stock linux install.

share|improve this answer

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.