Holumbus-MapReduce-0.1.1: a distributed MapReduce framework

Portabilityportable
Stabilityexperimental
MaintainerSebastian Reese (str@holumbus.org)

Holumbus.Distribution.SimpleDMapReduceIO

Description

Version : 0.1

Synopsis

Documentation

type MapFunction a k1 v1 k2 v2 = ActionEnvironment -> a -> k1 -> v1 -> IO [(k2, v2)]Source

type ReduceFunction a k2 v2 v3 = ActionEnvironment -> a -> k2 -> [v2] -> IO (Maybe v3)Source

client :: (Show k1, Show k2, Show v1, Show v2, Show v3, Show v4, Binary v1, Binary v3, Binary v2, Binary v4, Binary a, Binary k1, Binary k2, NFData k1, NFData k2, NFData v1, NFData v4, NFData v2, NFData v3, Ord k2, Hash k1, Hash k2) => MapFunction a k1 v1 k2 v2 -> ReduceFunction a k2 v3 v4 -> a -> (Int, Int, Int) -> [[(k1, v1)]] -> IO [(k2, v4)]Source

worker :: (Show k1, Show k2, Show v1, Show v2, Hash k1, Hash k2, Binary a, NFData k1, NFData k2, Ord k2, Binary k1, Binary k2, NFData v1, NFData v4, NFData v2, NFData v3, Binary v1, Binary v3, Binary v2, Binary v4, Show v4, Show v3) => MapFunction a k1 v1 k2 v2 -> ReduceFunction a k2 v3 v4 -> [(String, Priority)] -> IO ()Source

partition' :: [a] -> [[a]] -> [[a]]Source

data Priority

Priorities are used to define how important a log messgae is. Users can filter log messages based on priorities.

These have their roots on the traditional syslog system. The standard definitions are given below, but you are free to interpret them however you like. They are listed here in ascending importance order.

Constructors

DEBUG

Debug messages

INFO

Information

NOTICE

Normal runtime conditions

WARNING

General Warnings

ERROR

General Errors

CRITICAL

Severe situations

ALERT

Take immediate action

EMERGENCY

System is unusable