shh: Simple shell scripting from Haskell

[ bsd3, library, program, system ] [ Propose Tags ]

Provides a shell scripting environment for Haskell. It helps you use external binaries, and allows you to perform many shell-like functions, such as piping and redirection.


[Skip to Readme]
Versions [faq] 0.1.0.0, 0.1.0.1, 0.1.1.0, 0.2.0.0, 0.2.0.1, 0.2.0.2, 0.2.0.3, 0.2.0.4, 0.2.0.5, 0.2.0.6, 0.3.0.0, 0.3.0.1, 0.3.1.0, 0.3.1.1, 0.3.1.2, 0.3.1.3, 0.4.0.0, 0.4.0.1, 0.5.0.0
Change log ChangeLog.md
Dependencies async (>=2.2.1 && <2.3), base (>=4.9 && <4.13), containers (>=0.5.11 && <0.7), deepseq (>=1.4.3 && <1.5), directory (>=1.3.1 && <1.4), filepath (>=1.4.2 && <1.5), mtl (>=2.2.2 && <2.3), process (>=1.6.3 && <1.7), shh, split (>=0.2.3 && <0.3), template-haskell (>=2.13.0 && <2.15), temporary, unix (>=2.7.2 && <2.8) [details]
License BSD-3-Clause
Copyright (c) 2018, 2019 Luke Clifton
Author Luke Clifton
Maintainer lukec@themk.net
Category System
Source repo head: git clone https://github.com/luke-clifton/shh
Uploaded by lukec at Thu May 23 04:10:30 UTC 2019
Distributions NixOS:0.5.0.0
Executables shh-example, shh
Downloads 1109 total (338 in the last 30 days)
Rating (no votes yet) [estimated by rule of succession]
Your Rating
  • λ
  • λ
  • λ
Status Hackage Matrix CI
Docs uploaded by user
Build status unknown [no reports yet]

Modules

[Index] [Quick Jump]

Downloads

Maintainer's Corner

For package maintainers and hackage trustees


Readme for shh-0.5.0.0

[back to package description]

Shh

Shh is a library to enable convinient shell-like programming in Haskell. It works well in scripts, and from GHCi, allowing you to use GHCi as a shell.

It's primary purpose is in replacing shell scripts. As such, many functions are provided to mimic the shell environment, and porting shell scripts to shh should be fairly straightforward. A simple "cargo culting" port should work in most situations, and perhaps be even more robust than the original.

It is also a wrapper tool around launching GHCi as a shell.

It supports

  • Automatically defining a function for each executable on your $PATH using template Haskell, as well as a runtime check to ensure they all exist on startup.

  • Redirction of stdout and stderr

    -- Redirect stdout
    λ echo "Hello" &> StdErr
    λ echo "Hello" &> Truncate ".tmp_file"
    
    -- Redirect stderr
    λ echo "Hello" &!> Append "/dev/null"
    λ echo "Hello" &!> StdOut
    
  • Piping stdout or stderr to the input of a chained process

    λ cat "/dev/urandom" |> xxd |> head "-n" 5
    
  • Multiple processes sequentially feeding a single process

    λ (echo 1 >> echo 2) |> cat
    
  • Use of Haskells concurrency primitives.

    λ race (sleep 1) $ curl "http://this_needs_to_timeout_after_1_second"
    
    λ d <- readTrim $ mktemp "-d"
    λ :{
    | System.Directory.withCurrentDirectory d $ do
    |   mapConcurrently_ (curl "-LOJs")
    |     [ "https://raw.githubusercontent.com/luke-clifton/shh/master/shell.nix"
    |     , "https://raw.githubusercontent.com/luke-clifton/shh/master/shh.cabal"
    |     ]
    |   ls
    | :}
    
  • Capturing of process output

    λ s <- echo "Hello" |> tr "-d" "l" |> capture
    
    λ loggedIn <- nub . words <$> readProc users
    λ putStrLn $ "Logged in users: " ++ show loggedIn
    
    λ mapM_ putStrLn =<< readSplit0 (Shh.Example.find "-maxdepth" 1 "-print0")
    
  • Capturing infinite output of a process lazily

    λ withRead (cat "/dev/urandom" |> xxd) $ mapM_ putStrLn . take 3 . lines
    00000000: 8fcb ebee 9228 a897 3bfc 1d05 491d aceb  .....(..;...I...
    00000010: 47de 3ea3 2788 44ac 9b85 0a0f a458 b949  G.>.'.D......X.I
    00000020: 5308 ddfe 5790 5a5f 39e3 bbb6 b689 2b03  S...W.Z_9.....+.
    
  • Write strings to stdin of a process.

    λ writeProc cat "Hello\n"
    Hello
    
    λ "Hello" >>> shasum
    f7ff9e8b7bb2e09b70935a5d785e0cc5d9d0abf0  -
    
    λ shasum <<< "Hello"
    f7ff9e8b7bb2e09b70935a5d785e0cc5d9d0abf0  -
    
  • Proper exceptions, when a process exits with a failure code, an exception is thrown. You can catch these normally. The exception includes the error code, the command, and all it's arguments.

    λ false "Ha, it died"
    *** Exception: Command `false "Ha, it died"` failed [exit 1]
    
    λ catchCode false
    1
    
  • "Native" processes, i.e. Haskell functions that behave like a process.

    λ echo "Hello" |> pureProc (map toUpper) |> tr "-d" "L"
    HEO
    
  • And much, much more! Look at the documentation on Hackage for a comprehensive overview of all the possibilities.

Mnemonics

Shh has many symbols that might seem intimidating at first, but there is a simple mnemonic for them.

|     Piping. Looks like a pipe, same as in POSIX shells.
&     Redirection, think of the shell `2>&1`
>,<   The direction of flow of a command
!     Operate on stderr instead of stdout

So, for example,

ls |> cat      Pipe the stdout of `ls` into stdin of `cat`
cat <| ls      Same as above
ls &> StdErr   Redirect stdout of `ls` to wherever stderr is going.
StdErr <& ls   Same as above
ls &!> StdOut  Redirect stderr of `ls` to wherever stdout is going.
StdOut <!& ls  Same as above

Globbing

Currently Shh does not have any built in globbing support. Rather, it is currently suggested to use another library to do globbing. For example, using the Glob package, it is possible to do something like

wc =<< glob "*.md"

Certainly more verbose than the Bash equivalent, however, also more explicit, which is probably a good thing. If this turns out to be too cumbersome, we might introduce a more succinct globbing feature, though it will always be explicit, and thus always more verbose than most other shells.

Usage

Enable Temlpate Haskell and load the environment

{-# LANGUAGE TemplateHaskell #-}
$(loadEnv SearchPath)

You now have all your executables available as simple to read Haskell functions.

If you want to check that all the dependenies still exist, you can use missingExecutables :: IO [String], which will tell you if anything is missing.

Usage in GHCi

If you want ^D to be recognised as a EOF marker (when running commands that read from stdin) when running in GHCi, you will need to run the initInteractive function. This sets the line buffering appropriately and ensures the terminal is in canonical mode.

Shh as a Shell

There is a tool called shh which is a fairly small wrapper around launching GHCi which automatically loads your environment and allows you to have custom config when using GHCi as a shell.

The shh binary will look in your $SHH_DIR (defaults to $HOME/.shh) for a Shell.hs, init.ghci and wrapper files. If these don't exist default ones will be created.

The Shell.hs file should contain any top level definitions that you would like to be available in your Shell. By default it loads your environment.

The init.ghci file is loaded by GHCi after your .ghci files. This lets you specify settings that you want to take effect when using GHCi as a shell. By default it sets a shell-like prompt.

The wrapper file is an executable that is called with the command that is to be executed. By default it just calls exec with the arguments passed to it. The use-case for this is to be able to set up the environment for shh. You might, for example, wrap the execution in a nix-shell. Either way, it is up to you to make sure that the compiler, and packages you require are available, either globally, or provided by the wrapper script.

Faster Startup

shh precompiles your Shell.hs file so that starting up shh is very quick on subsequent launches. Unfortunately, shh isn't quite able to detect this perfectly. If you see GHCi telling you that it is Compiling Shell, and you notice the delay when starting shh, try manually forcing a rebuild by passing in the --rebuild argument to shh.

This is particularly likely to happen if you upgrade your GHC, or installed packages, or even shh itself.

Nix Wrapper Example

The following snippet could act as a wrapper file to set up a suitable environment using nix-shell

#! /usr/bin/env nix-shell
#! nix-shell -i bash -p "(haskellPackages.ghcWithPackages (p: with p; [shh shh-extras]))"
exec "$@"

Script Usage

TODO: Fill this in once the user experience is better.