equal-files: Shell command for finding equal files

[ console, program ] [ Propose Tags ]

Shell command that finds files with equal content in a given set of files. This is useful for finding duplicates in a set of documents where the same document might have been stored by accident with different names. Use it like

equal-files `find my_dir -type f`

or

find my_dir -type f | xargs equal-files

If the file names contain spaces, better use

find my_dir -type f -printf "'%p'\n" | xargs equal-files

The program reads all input files simultaneously, driven by sorting and grouping of their content. However be prepared that due to the simultaneous access you may exceed the admissible number of opened files.

The program can be used as a nice example of a declarative yet efficient implementation of a non-trivial algorithm, that is enabled by lazy evaluation.

Flags

Automatic Flags
NameDescriptionDefault
splitbase

Choose the new smaller, split-up base package.

Enabled

Use -f <flag> to enable a flag, or -f -<flag> to disable that flag. More info

Downloads

Maintainer's Corner

Package maintainers

For package maintainers and hackage trustees

Candidates

  • No Candidates
Versions [RSS] 0.0.1, 0.0.2, 0.0.2.1, 0.0.3, 0.0.4, 0.0.5, 0.0.5.1, 0.0.5.2, 0.0.5.3, 0.0.5.4
Dependencies base (>=1.0 && <2 || >=3), bytestring (>=0.9 && <0.10) [details]
License LicenseRef-GPL
Author Henning Thielemann <haskell@henning-thielemann.de>
Maintainer Henning Thielemann <haskell@henning-thielemann.de>
Category Console
Home page http://code.haskell.org/~thielema/equal-files
Uploaded by HenningThielemann at 2008-12-27T21:23:43Z
Distributions LTSHaskell:0.0.5.4, NixOS:0.0.5.4, Stackage:0.0.5.4
Reverse Dependencies 1 direct, 0 indirect [details]
Executables equal-files
Downloads 7868 total (31 in the last 30 days)
Rating (no votes yet) [estimated by Bayesian average]
Your Rating
  • λ
  • λ
  • λ
Status Docs not available [build log]
Last success reported on 2017-01-02 [all 7 reports]