The tpar package

[ Tags: benchmark, bsd3, program, system ] [ Propose Tags ]

tpar is a simple job scheduling and dispatch service for distributing and monitoring tasks across machines. It was written to serve as a simple and easy-to-administer substitute for systems like Grid Engine.

Configuring a tpar instance is simply a matter of running tpar server on a designated server machine,

$ # We'll need to know the hostname of the server
$ hostname
my-server
$ # Start a server also running 8 local workers
$ tpar server -Hmy-server -N8

Submitting a job is then similarly easy,

$ tpar enqueue -Hhostname -- long-process arg1 arg2

One can then enqueue jobs easily

$ tpar enqueue -Hmy-server -- bash -c "primes 10000000000  | head -n1"
$ tpar status -v
0     unnamed-job                                        finished
priority:       0
queued:         1 seconds ago
command:        bash
arguments:      -c primes 10000000000  | head -n1
logging:        stdout: none
stderr: none
status:         finished with 0 (at 1 seconds ago)
started at 1 seconds ago
ran on nid://localhost:5757:0

One can add more workers to help churn through the work queue using the tpar worker command,

$ # Add 16 more workers running on another machine
$ ssh my-workers -- tpar worker -Hmy-server -N16

Finally, the output of running jobs can be monitored using the tpar watch command,

$ tpar watch id=0

Properties

Versions 0.1.0.0
Dependencies aeson (==0.11.*), ansi-wl-pprint (==0.6.*), async (>=2.0 && <2.2), base (>=4.5 && <4.10), binary (>=0.7 && <0.9), bytestring (==0.10.*), containers (==0.5.*), distributed-process (==0.6.*), errors (>=2.0 && <2.2), exceptions (==0.8.*), friendly-time (==0.4.*), ghc-prim, heaps (==0.3.*), network (>=2.4 && <2.7), network-transport-tcp (>=0.4), optparse-applicative (>=0.10 && <0.13), parsers (==0.12.*), pipes (>=4.0 && <4.3), pipes-bytestring (>=2.0 && <2.2), pipes-concurrency, pipes-safe (==2.2.*), process (>=1.1 && <1.5), stm (==2.4.*), time (==1.6.*), transformers (>=0.3 && <0.6), trifecta (>=1.5 && <1.7) [details]
License BSD3
Copyright (c) 2014-2016 Ben Gamari <bgamari@gmail.com>
Author Ben Gamari
Maintainer bgamari@gmail.com
Category System
Home page http://github.com/bgamari/tpar/
Bug tracker http://github.com/bgamari/tpar/issues
Source repository head: git clone git://github.com/bgamari/tpar
Uploaded Mon Aug 1 09:59:04 UTC 2016 by BenGamari
Distributions NixOS:0.1.0.0
Executables tpar
Downloads 88 total (7 in the last 30 days)
Rating (no votes yet) [estimated by rule of succession]
Your Rating
  • λ
  • λ
  • λ
Status Docs not available [build log]
Last success reported on 2016-11-21 [all 3 reports]
Hackage Matrix CI

Downloads

Maintainer's Corner

For package maintainers and hackage trustees