Holumbus-MapReduce-0.0.1: a distributed MapReduce framework Source code Contents Index

Holumbus.Standalone.SMapReduce Portability portable Stability experimental Maintainer Stefan Schmidt (stefanschmidt@web.de)

Contents Datatypes Configurations Creation and Initialisation

Description

Version : 0.1

Synopsis

data SMapReduce class Debug mr => MapReduce mr where closeMapReduce :: mr -> IO () getMySiteId :: mr -> IO SiteId getMapReduceType :: mr -> IO MapReduceType startControlling :: mr -> IO () stopControlling :: mr -> IO () isControlling :: mr -> IO Bool doSingleStep :: mr -> IO () doMapReduceJob :: JobInfo -> mr -> IO JobResult doMapReduce :: ActionConfiguration a k1 v1 k2 v2 v3 v4 -> a -> [(k1, v1)] -> [FileId] -> Int -> Int -> Int -> Int -> TaskOutputType -> mr -> IO ([(k2, v4)], [FileId]) data SMRConf defaultStandaloneConfig :: SMRConf newSMapReduce :: FileSystem -> ActionMap -> SMRConf -> IO SMapReduce

Datatypes

data SMapReduce Source

Instances Show SMapReduce Debug SMapReduce MapReduce SMapReduce

class Debug mr => MapReduce mr where Source

Methods closeMapReduce :: mr -> IO () Source getMySiteId :: mr -> IO SiteId Source prints the siteId of the MapReduce instance getMapReduceType :: mr -> IO MapReduceType Source get the Type of the MapReduce instance startControlling :: mr -> IO () Source get the Controlling-Type (normal or singlestep) of the MapReduce instance stopControlling :: mr -> IO () Source get the Controlling-Type (normal or singlestep) of the MapReduce instance isControlling :: mr -> IO Bool Source test, if Controller is running doSingleStep :: mr -> IO () Source performs a single step of the controller (if mode is singlestep) doMapReduceJob :: JobInfo -> mr -> IO JobResult Source starts a MapReduce-Job (blocking while finished) doMapReduce Source :: => ActionConfiguration a k1 v1 k2 v2 v3 v4 -> a options -> [(k1, v1)] input (Tuples) -> [FileId] input (Files) -> Int number of splitters -> Int number of mappers -> Int number of reducers -> Int number of results -> TaskOutputType type of the result (file of raw) -> mr -> IO ([(k2, v4)], [FileId]) Instances MapReduce SMapReduce MapReduce MasterData MapReduce MasterPort MapReduce DMapReduce

Configurations

data SMRConf Source

defaultStandaloneConfig :: SMRConf Source

Creation and Initialisation

newSMapReduce :: FileSystem -> ActionMap -> SMRConf -> IO SMapReduce Source

Produced by Haddock version 2.4.2