hadoop-rpc-0.1.0.0: Use the Hadoop RPC interface from Haskell.

Safe HaskellNone
LanguageHaskell2010

Data.Hadoop.Protobuf.DataTransfer

Description

This module contains protocol buffers that are used to transfer data to and from the datanode, as well as between datanodes.

Synopsis

Documentation

data BlockConstructionStage Source

Constructors

BCS_PIPELINE_SETUP_APPEND 
BCS_PIPELINE_SETUP_APPEND_RECOVERY

pipeline set up for failed PIPELINE_SETUP_APPEND recovery

BCS_DATA_STREAMING

data streaming

BCS_PIPELINE_SETUP_STREAMING_RECOVERY

pipeline setup for failed data streaming recovery

BCS_PIPELINE_CLOSE

close the block and pipeline

BCS_PIPELINE_CLOSE_RECOVERY

Recover a failed PIPELINE_CLOSE

BCS_PIPELINE_SETUP_CREATE

pipeline set up for block creation

BCS_TRANSFER_RBW

transfer RBW for adding datanodes

BCS_TRANSFER_FINALIZED

transfer Finalized for adding datanodes

data OpRequestShortCircuitAccess Source

Constructors

OpRequestShortCircuitAccess 

Fields

orscHeader :: Required 1 (Message BaseHeader)
 
orscMaxVersion :: Required 2 (Value Word32)

In order to get short-circuit access to block data, clients must set this to the highest version of the block data that they can understand. Currently 1 is the only version, but more versions may exist in the future if the on-disk format changes.

data ReadOpChecksumInfo Source

Sent as part of the BlockOpResponse for READ_BLOCK and COPY_BLOCK operations.

Constructors

ReadOpChecksumInfo 

Fields

rociChecksum :: Required 1 (Message Checksum)
 
rociChunkOffset :: Required 2 (Value Word64)

The offset into the block at which the first packet will start. This is necessary since reads will align backwards to a checksum chunk boundary.

data BlockOpResponse Source

Constructors

BlockOpResponse 

Fields

borStatus :: Required 1 (Enumeration DataTransferStatus)
 
borFirstBadLink :: Optional 2 (Value String)
 
borChecksumResponse :: Optional 3 (Message OpBlockChecksumResponse)
 
borReadOpChecksumInfo :: Optional 4 (Message ReadOpChecksumInfo)
 
borData :: Optional 5 (Value Text)

Explanatory text which may be useful to log on the client side

borShortCircuitAccessVersion :: Optional 6 (Value Word32)

If the server chooses to agree to the request of a client for short-circuit access, it will send a response data with the relevant file descriptors attached.

In the body of the data, this version number will be set to the specific version number of the block data that the client is about to read.

data ClientReadStatus Source

Message sent from the client to the DN after reading the entire read request.