Question

Hi,

I am looking for a good tool to perform grep-like operations on XML - for example, extract certain attributes only.

Grep itself can't handle it - any DFA-equivalent tool can handle only non recursive matches, and mine may be recursive.

I have tried xgrep, but it is quite unstable, and I want a stable and reliable tool.

Any recommendations?

EDIT: I prefer open source tools that work well under Linux.

Answer 1

xmlstarlet is a command line tool which comes close to grep. It is open source software (MIT license) and works well on linux and windows.

The xmlstarlet website http://xmlstar.sourceforge.net describes it as follows.

XMLStarlet is a set of command line utilities (tools) which can be used to transform, query, validate, and edit XML documents and files using simple set of shell commands in similar way it is done for plain text files using UNIX grep, sed, awk, diff, patch, join, etc commands.

The debian/ubuntu package is named xmlstarlet. But beware: Contrary to what the manpage says the binary is named xmlstarlet in debian/ubuntu and not xml.

There are also windows binaries on sourceforge.

For a nice little introduction see IBMs Start working with XMLStarlet.

Answer 2

The XPath syntax in various languages is best for finding things in xml. In fact one of the tools recommended by the makers of xgrep is basically a Perl XML parser that accepts XPath input.

Answer 3

A tool that works under Linux is xml_grep. It fully understands XML and is not a line-by-line tool.

xml_grep is included as a stand-alone tool in the XML::Twig package. The grepping functionality is quite powerful as it supports XPath specifications.

Sample command-line (extracting posts edited after the middle of February from the triology Data Dump):

xml_grep -p --cond="row[@LastEditDate>'2010-02-14']"  posts.xml  > lateEditedPosts.xml

---

Installation is easy. Either

• sudo cpan -i "XML::Twig", as described in the xml_grep cookbook referenced below.

or

• Download http://xmltwig.com/xmltwig/XML-Twig-3.34.tar.gz. E.g. wget http://xmltwig.com/xmltwig/XML-Twig-3.34.tar.gz

• Extract: gunzip XML-Twig-3.34.tar.gz; tar -xvf XML-Twig-3.34.tar

• Install: perl Makefile.PL and answer the questions. Then make, make test and make install.

---

More information:

The best introduction I have found for xml_grep is "xml_grep cookbook", about 2 pages.

Man page for xml_grep. Real home page for XML::Twig.

Answer 4

XMLSpy is an amazing tool, if a bit spendy.

Answer 5

I would advise NOT to use a grep-like tool on XML, but use a library to parse XML in stead.
What exactly do you need it for? Any programming language? I think the .NET built-in XML parser would fit the job easily if you're willing to write a program for it though.

Update: for Linux, a well known XML parser library is libxml2.