The equal-files package

[Tags: gpl, program]

Shell command that finds files with equal content in a given set of files. This is useful for finding duplicates in a set of documents where the same document might have been stored by accident with different names. Use it like

 equal-files `find my_dir -type f`

or

 find my_dir -type f | xargs equal-files

If the file names contain spaces, better use

 find my_dir -type f -printf "'%p'\n" | xargs equal-files

or

 equal_files -r my_dir

The program reads all input files simultaneously, driven by sorting and grouping of their content. However be prepared that due to the simultaneous access you may exceed the admissible number of opened files. Thus you may prefer to run it like

 equal_files -r -p 512 my_dir

The program can be used as a nice example of a declarative yet efficient implementation of a non-trivial algorithm, that is enabled by lazy evaluation.


Properties

Versions0.0.1, 0.0.2, 0.0.2.1, 0.0.3, 0.0.4, 0.0.5, 0.0.5.1
Dependenciesbase (>=3), bytestring (==0.9.*), explicit-exception (>=0.0.2 && <0.1), FileManip (>=0.3.2 && <0.4), mtl (==1.1.*)
LicenseGPL
AuthorHenning Thielemann <haskell@henning-thielemann.de>
MaintainerHenning Thielemann <haskell@henning-thielemann.de>
CategoryConsole
Home pagehttp://code.haskell.org/~thielema/equal-files
Executablesequal-files
UploadedSat Dec 27 23:30:02 UTC 2008 by HenningThielemann
Downloads564 total (57 in last 30 days)
StatusDocs pending
Build status unknown [no reports yet]

Downloads

Maintainers' corner

For package maintainers and hackage trustees