| Safe Haskell | Safe |
|---|---|
| Language | Haskell2010 |
Data.Function.MapReduce.Internal
Description
Generic implementation of various map-reduce functions.
- type MapReduce a k v b = Ord k => (a -> (k, v)) -> (k -> [v] -> b) -> [a] -> [b]
- groupReduce :: Ord k => MapReduce a k a b -> (a -> k) -> ([a] -> b) -> [a] -> [b]
- groupReduceFlatten :: Ord k => MapReduce a k a [b] -> (a -> k) -> ([a] -> [b]) -> [a] -> [b]
- groupReduceByKey :: Ord k => MapReduce a k a b -> (a -> k) -> (k -> [a] -> b) -> [a] -> [b]
- groupReduceFlattenByKey :: Ord k => MapReduce a k a [b] -> (a -> k) -> (k -> [a] -> [b]) -> [a] -> [b]
- groupExtract :: Ord k => MapReduce a k a [b] -> (a -> k) -> (a -> b) -> [a] -> [b]
- mapReduceFlatten :: Ord k => MapReduce a k v [b] -> (a -> (k, v)) -> (k -> [v] -> [b]) -> [a] -> [b]
- mapReduceFinalize :: Ord k => MapReduce a k v b -> (a -> (k, v)) -> (k -> [v] -> v) -> (k -> v -> b) -> [a] -> [b]
- aggregate :: MapReduce a () v b -> (a -> v) -> ([v] -> b) -> [a] -> b
- aggregateByKey :: Ord k => MapReduce a k v b -> (a -> k) -> (a -> v) -> ([v] -> b) -> [a] -> [b]
- aggregateWithKey :: Ord k => MapReduce a k v b -> (a -> k) -> (a -> v) -> (k -> [v] -> b) -> [a] -> [b]
Types
type MapReduce a k v b Source #
Arguments
| = Ord k | |
| => (a -> (k, v)) | Function for mapping to keys and values. |
| -> (k -> [v] -> b) | Function for reducing values. |
| -> [a] | The values. |
| -> [b] | The reduced values. |
Functiom for mapping and then reducing.
Grouping
Arguments
| :: Ord k | |
| => MapReduce a k a b | |
| -> (a -> k) | Function for extracting keys for grouping. |
| -> ([a] -> b) | Function for reducing values. |
| -> [a] | The values. |
| -> [b] | The reduced values. |
Reduce values by group.
Arguments
| :: Ord k | |
| => MapReduce a k a [b] | |
| -> (a -> k) | Function for extracting keys for grouping. |
| -> ([a] -> [b]) | Function for reducing values. |
| -> [a] | The values. |
| -> [b] | The reduced values. |
Reduce values by group, and flatten the result.
Arguments
| :: Ord k | |
| => MapReduce a k a b | |
| -> (a -> k) | Function for extracting keys for grouping. |
| -> (k -> [a] -> b) | Function for reducing values. |
| -> [a] | The values. |
| -> [b] | The reduced values. |
Reduce values by group, where the reducer receives the key.
groupReduceFlattenByKey Source #
Arguments
| :: Ord k | |
| => MapReduce a k a [b] | |
| -> (a -> k) | Function for extracting keys for grouping. |
| -> (k -> [a] -> [b]) | Function for reducing values. |
| -> [a] | The values. |
| -> [b] | The reduced values. |
Reduce values by group, and flatten the result, where the reducer receives the key.
Arguments
| :: Ord k | |
| => MapReduce a k a [b] | |
| -> (a -> k) | Function for extracting keys for grouping. |
| -> (a -> b) | Function for extracting values. |
| -> [a] | The values. |
| -> [b] | The extract. |
Order and extract values.
Map-Reduce
Arguments
| :: Ord k | |
| => MapReduce a k v [b] | |
| -> (a -> (k, v)) | Function for mapping to keys and values. |
| -> (k -> [v] -> [b]) | Function for reducing values. |
| -> [a] | The values. |
| -> [b] | The reduced values. |
Reduce values by keying them, and flatten the result.
Arguments
| :: Ord k | |
| => MapReduce a k v b | |
| -> (a -> (k, v)) | Function for mapping to keys and values. |
| -> (k -> [v] -> v) | Function for reducing values. |
| -> (k -> v -> b) | Function for transforming the reduced values. |
| -> [a] | The values. |
| -> [b] | The reduced values. |
Reduce values by keying them, transforming the result.
Aggregation
Arguments
| :: MapReduce a () v b | |
| -> (a -> v) | Function to extract values. |
| -> ([v] -> b) | Function to aggregate a list of values. |
| -> [a] | The values. |
| -> b | The aggregate. |
Aggregate values.
Arguments
| :: Ord k | |
| => MapReduce a k v b | |
| -> (a -> k) | Function for extracting keys. |
| -> (a -> v) | Function for extracting values. |
| -> ([v] -> b) | Function to aggregate a list of values. |
| -> [a] | The values. |
| -> [b] | The aggregates. |
Aggregate values by key.