65

On Linux, how could I generate a diff between two XML files?

Ideally, I would like to be able configure it to some things strict, or loosen some things, like whitespace, or attribute order.

I'll often care that the files are functionally the same, but diff by itself, would be annoying to use, especially if the XML file doesn't have a lot of linebreaks.

For example, the following should really be okay to me:

<tag att1="one" att2="two">
  content
</tag>

<tag att2="two" att1="one">
  content
</tag>
75

One approach would be to first turn both XML files into Canonical XML, and compare the results using diff. For example, xmllint can be used to canonicalize XML.

$ xmllint --c14n one.xml > 1.xml
$ xmllint --c14n two.xml > 2.xml
$ diff 1.xml 2.xml

Or as a one-liner.

$ diff <(xmllint --c14n one.xml) <(xmllint --c14n two.xml)
  • 1
    Never knew about the --c14n switch in xmllint. That's handy. – qedi Dec 10 '09 at 20:21
  • 17
    You can do it in one line too vimdiff <(xmllint --c14n one.xml) <(xmllint --c14n two.xml) – Nathan Villaescusa Mar 3 '13 at 1:53
  • and xmllint ships with OS X – ClintM Sep 20 '16 at 16:17
  • 4
    In case it wasn't obvious, c14n is an abbreviation for canonicalization. – Brandin Nov 8 '16 at 17:53
  • 2
    It is better to execute an additional step before diff - formatting of both XMLs (xmllint --format). Because I've noticed that without this step diff shows more differences than necessary. – ka3ak Dec 9 '16 at 12:07
18

Jukka's answer did not work for me, but it did point to Canonical XML. Neither --c14n nor --c14n11 sorted the attributes, but i did find the --exc-c14n switch did sort the attributes. --exc-c14n is not listed in the man page, but described on the command line as "W3C exclusive canonical format".

$ xmllint --exc-c14n one.xml > 1.xml
$ xmllint --exc-c14n two.xml > 2.xml
$ diff 1.xml 2.xml

$ xmllint | grep c14
    --c14n : save in W3C canonical format v1.0 (with comments)
    --c14n11 : save in W3C canonical format v1.1 (with comments)
    --exc-c14n : save in W3C exclusive canonical format (with comments)

$ rpm -qf /usr/bin/xmllint
libxml2-2.7.6-14.el6.x86_64
libxml2-2.7.6-14.el6.i686

$ cat /etc/system-release
CentOS release 6.5 (Final)

Warning --exc-c14n strips out the xml header whereas the --c14n prepends the xml header if not there.

14

Tried to use @Jukka Matilainen's answer but had problems with white-space (one of the files was a huge one-liner). Using --format helps to skip white-space differences.

xmllint --format one.xml > 1.xml  
xmllint --format two.xml > 2.xml  
diff 1.xml 2.xml  

Note: Use vimdiff command for side-by-side comparison of the xmls.

  • In my case two.xml was generated from one.xml by a script. So I just needed to check what was added/removed by the script. – GuruM Aug 8 '12 at 10:36
  • This was the option I needed. Supposedly the most canonical version can be obtained by combining --format with --exc-c14n; will probably be still slower to process :( – ᴠɪɴᴄᴇɴᴛ Nov 27 '14 at 14:05
  • It's been quite some time since I wrote the answer, but I faintly remember using the --exc-c14n flag. However, diff-ing the output with/without the flag showed no differences so just stopped using it. Dropping unnecessary/unused flags might make the process faster. – GuruM Dec 21 '14 at 6:49
  • 5
    The --exc-c14n option specifies sorting of the attributes. In your specific files the attributes probably were already sorted, but the general advice would be to use the combination --format --exc-c14n. – ᴠɪɴᴄᴇɴᴛ Dec 22 '14 at 14:33
4

Diffxml gets the basic functionality correct, though it doesn't seem to offer many options for configuration.

Edit: Project Diffxml has been migrated to GitHub since 2013.

  • It's not quite there yet, but it looks promising at least. – qedi Dec 7 '09 at 17:02
  • not useful for large files though, died after eating 40GB (RAM + SWAP) when comparing two files ~20k lines each – meta Oct 26 '17 at 6:27
  • note that project appears to be dead, with last update in 2013 – Mateusz Konieczny Oct 9 '18 at 7:53
3

If you wish to also ignore the order of child elements, I wrote a simple python tool for this called xmldiffs:

Compare two XML files, ignoring element and attribute order.

Usage: xmldiffs [OPTION] FILE1 FILE2

Any extra options are passed to the diff command.

Get it at https://github.com/joh/xmldiffs

0

I use Beyond Compare to compare all types of text based files. They produce versions for Windows and Linux.

  • 1
    Plain text comparisons would say the two lines differed, whereas the OP wants them to be reported as the same. – ChrisF Dec 7 '09 at 16:33
  • 4
    i.e. Canonically compare the XML. – Chris W. Rea Dec 9 '09 at 20:08
  • 1
    Beyond Compare really sucks for this. It seems to just not be aware of XML elements and do mostly just text comparison. – Rob K May 23 '16 at 17:54
-1

Our SD Smart Differencer compares documents based on structure as opposed to actual layout.

There's an XML Smart Differencer. For XML, that means matching order of tags and content. It should note that the text string in the specific fragment you indicated was different. It presently doesn't understand the XML notion of tag attributes indicating whether whitespace is normalized vs. significant.

  • In your SO profile you provide full disclosure about your employer; I'd have preferred a short disclaimer inside your answer as well :) BTW, I tried to download an evaluation copy, but the request form is 'smart' (via JS) enough to disable the combination XML with Smart Differencer (also the latter in combination with Python, although possible according to the SD product page)? – ᴠɪɴᴄᴇɴᴛ Nov 27 '14 at 14:03
  • 1
    Ah. Thanks for the reminder. This is an answer from a time before there was a clear SO policy on this. I'm revising the answer to signal the relationship in SO policy compliant answer. – Ira Baxter Nov 27 '14 at 15:52
  • I'll check the download page; not all of our live products make into that list. Yes, these exist. – Ira Baxter Nov 27 '14 at 15:53
  • I checked the download page. Yes, the XML smart differencer is not there. I'll have the back-room guys work on fixing that; should be there in 1-2 weeks at most (they have a backlog, don't we all?) In meantime, if you want to try it, send email (see bio). – Ira Baxter Jan 26 '15 at 20:16
  • 1
    Linked page has no word "XML" in it. – Mateusz Konieczny Oct 9 '18 at 7:52
-1

Not sure whether (the dependence of) an online tool counts as a solution but, for what it's worth, I got good result in this online XML comparison tool. It simply works.

Your Answer

By clicking "Post Your Answer", you acknowledge that you have read our updated terms of service, privacy policy and cookie policy, and that your continued use of the website is subject to these policies.

Not the answer you're looking for? Browse other questions tagged or ask your own question.