urlcheck: Parallel link checker

[ bsd3, network, program ] [ Propose Tags ]

A (SMP) parallel link checker. Checks the validity of embedded urls in the input files. Usage: urlcheck foo.html


[Skip to Readme]

Downloads

Maintainer's Corner

Package maintainers

For package maintainers and hackage trustees

Candidates

  • No Candidates
Versions [RSS] 0.1, 0.1.1
Dependencies base, mtl, network [details]
License BSD-3-Clause
Author Don Stewart
Maintainer <dons@cse.unsw.edu.au>
Category Network
Home page http://www.cse.unsw.edu.au/~dons/urlcheck.html
Uploaded by DonaldStewart at 2007-02-13T02:37:35Z
Distributions
Reverse Dependencies 1 direct, 0 indirect [details]
Executables urlcheck
Downloads 1826 total (9 in the last 30 days)
Rating (no votes yet) [estimated by Bayesian average]
Your Rating
  • λ
  • λ
  • λ
Status Docs not available [build log]
All reported builds failed as of 2017-01-04 [all 7 reports]

Readme for urlcheck-0.1

[back to package description]
            urlcheck: a multithreaded, parallel url checker

Features:

    urlcheck is lightweight, concurrent url checker. It uses minimal resources,
    and is multicore-capable.

    In contrast to popular link checkers, it uses few resources, will readily
    take advantage of multiple cores, and is easily killable.

An example:

    $ urlcheck content.wiki
    Found 0 broken links. Checked 31 links (31 unique) in 1 file.
    Search time: 30 secs

Building:
    runhaskell Setup.lhs configure --prefix=/home/dons
    runhaskell Setup.lhs build
    runhaskell Setup.lhs install

Use:

    $ urlcheck --help
    Usage: checkuri [-h] [-n n] [file ...]
      -h    --help  Show this help message
      -n N          Number of concurrent connections (default 16)

urlcheck takes a list of files to check on the command line. It uses 16
concurrent threads by default. You can configure these threads to use
multiple cores, with GHC 6.6, by setting:

    +RTS -N 16 -RTS

on the command line arguments to urlcheck.