xpathdsv: Command line tool to extract DSV data from HTML and XML with XPATH expressions

[ bsd3, program, text ] [ Propose Tags ]

Please see README.md

[Skip to Readme]
Versions [RSS] [faq],
Dependencies base (>=4.7 && <5), hxt, hxt-xpath, optparse-applicative, text [details]
License BSD-3-Clause
Copyright Daniel Choi 2016
Author Daniel Choi
Maintainer dhchoi@gmail.com
Category Text
Home page https://github.com/danchoi/xpathdsv#readme
Uploaded by DanielChoi at 2016-05-24T18:10:36Z
Distributions NixOS:
Executables xpathdsv
Downloads 1090 total (15 in the last 30 days)
Rating (no votes yet) [estimated by Bayesian average]
Your Rating
  • λ
  • λ
  • λ
Status Hackage Matrix CI
Docs not available [build log]
Last success reported on 2016-05-24 [all 4 reports]


Maintainer's Corner

For package maintainers and hackage trustees


Readme for xpathdsv-

[back to package description]


Extract DSV text from HTML and XML using XPATH expressions.


If you have an HTML file like this:


    <h1>Some links</h1>
      <li><a href="http://news.ycombinator.com">Hacker News</a></li>
      <li><a href="http://yahoo.com">Yahoo</a>
      <li><a href="http://duckduckgo.com">Duck Duck Go</a>
      <li><a href="http://github.com">GitHub</a>

You can extract a list of tab-separated values like this:

xpathdsv  '//a'  '/a/text()' '/a/@href/text()' < sample.html


Hacker News	http://news.ycombinator.com
Yahoo	http://yahoo.com
Duck Duck Go	http://duckduckgo.com
GitHub	http://github.com

The first XPATH expression in the command sets the base node on which all the following XPATH expressions are applied. Each of the following XPATH expressions then generate a column of the row of data.

If you don't specify a text() node at the end of an XPATH expression, you'll get a string representation of a node, which may be useful for debugging:

 xpathdsv '//a' '/a' < sample.html


<a href="http://news.ycombinator.com">Hacker News</a>
<a href="http://yahoo.com">Yahoo</a>
<a href="http://duckduckgo.com">Duck Duck Go</a>
<a href="http://github.com">GitHub</a>



Usage: xpathdsv [--xml] [-F OUTPUT-DELIM] [-n NULL-OUTPUT] BASE-XPATH
  Extract DSV data from HTML or XML with XPath

Available options:
  -h,--help                Show this help text
  --xml                    Parse as XML, rather than HTML.
  -F OUTPUT-DELIM          Default \t
  -n NULL-OUTPUT           Null value output string. Default ""

See https://github.com/danchoi/xpathdsv for more information.


Daniel Choi https://github.com/danchoi