xpathdsv: Command line tool to extract DSV data from HTML and XML with XPATH expressions

[ bsd3, program, text ] [ Propose Tags ]

Please see README.md

[Skip to Readme]
Dependencies base (>=4.7 && <5), hxt, hxt-xpath, optparse-applicative, text [details]
License BSD-3-Clause
Copyright Daniel Choi 2016
Author Daniel Choi
Maintainer dhchoi@gmail.com
Category Text
Home page https://github.com/danchoi/xpathdsv#readme
Uploaded by DanielChoi at Wed May 25 00:21:55 UTC 2016
Distributions NixOS:
Executables xpathdsv
Downloads 361 total (7 in the last 30 days)
Rating (no votes yet) [estimated by rule of succession]
Your Rating
  • λ
  • λ
  • λ
Status Docs not available [build log]
All reported builds failed as of 2016-11-25 [all 3 reports]
Hackage Matrix CI


Maintainer's Corner

For package maintainers and hackage trustees

Readme for xpathdsv-

[back to package description]


Extract DSV text from HTML and XML using XPATH expressions.

Available on Hackage.


If you have an HTML file like this:


    <h1>Some links</h1>
      <li><a href="http://news.ycombinator.com">Hacker News</a></li>
      <li><a href="http://yahoo.com">Yahoo</a>
      <li><a href="http://duckduckgo.com">Duck Duck Go</a>
      <li><a href="http://github.com">GitHub</a>

You can extract a list of tab-separated values like this:

xpathdsv  '//a'  '/a/text()' '/a/@href' < sample.html


Hacker News http://news.ycombinator.com
Yahoo   http://yahoo.com
Duck Duck Go    http://duckduckgo.com
GitHub  http://github.com

The first XPATH expression in the command sets the base node on which all the following XPATH expressions are applied. Each of the following XPATH expressions then generate a column of the row of data.

If you don't specify a text() node at the end of an XPATH expression, you'll get a string representation of a node if the node is not an attribute, which may be useful for debugging:

 xpathdsv '//a' '/a' < sample.html


<a href="http://news.ycombinator.com">Hacker News</a>
<a href="http://yahoo.com">Yahoo</a>
<a href="http://duckduckgo.com">Duck Duck Go</a>
<a href="http://github.com">GitHub</a>



Usage: xpathdsv [--xml] [-F OUTPUT-DELIM] [-n NULL-OUTPUT] BASE-XPATH
  Extract DSV data from HTML or XML with XPath

Available options:
  -h,--help                Show this help text
  --xml                    Parse as XML, rather than HTML.
  -F OUTPUT-DELIM          Default \t
  -n NULL-OUTPUT           Null value output string. Default ""

See https://github.com/danchoi/xpathdsv for more information.


Daniel Choi https://github.com/danchoi