Is there a tool to measure file difference percentage?

Question

I am looking to compare two text files. Normally, I can just use diff to compare the two files to see the differences. This is great, except that I am more concerned with the percentage difference of the two files.

For example:

File A:
    banana
    TESTING

File B:
    TESTING

In this case, the result would be a 50% difference. I've taken a look at wdiff, and it mostly works, with the exception being that it looks at elements word-by-word (in fact, I can get the result above by doing wdiff -s filea fileb).

Does a tool exist to provide file percentage difference on a by character/ by byte level?

Answer 1

Doing a character-by-character comparison of two text files is effectively a Levenshtein distance calculation. There isn't a common standalone program in Linux that will do this calculation, but there are some library functions (I know PHP has one) and tons of example code online for this calculation.

One other little caveat is that Levenshtein distance is strictly the number of changes between two strings, so if you're looking for a percentage, you'll need to normalize the calculated distance. Dividing by the mean of the lengths of the two strings (sizes of the text files) is a widely-used normalization.

Answer 2

I had a similar problem with two sets of transcribed files I used the Levenshtein distance as suggested in the most up voted answer but found using python a better option.

pip install python-Levenshtein

and the code will be that:

import sys

from Levenshtein import *

txt1 = open(sys.argv[1]).read()
txt2 = open(sys.argv[2]).read()

print("distance:", distance(txt1,txt2))

use:

python distance.py file1 file2

Answer 3

Try piping the output if diff to the wc command. There are several options but -l will likely give you a decent count of the number of changed lines. Since diff outputs before & after lines along with some other formatting you may have to divide the result by that factor and then place that over the the result of the entire file length in lines. wc -l

Answer 4

I suggest sdiff:

❯ sdiff -B -b -s ~/temp/code_old.cpp ~/temp/code_new.cpp | wc
      47     366    3685
      ^^ ~~~ number of changed lines

then:

❯ cat ~/temp/code_old.cpp | wc
     131     466    4388
     ^^^ ~~~ number of lines before change

then:

❯ bc -l <<< "47./131.*100."

35.87786259541984732800

gives the result - code was changed in 35%. (counting lines).