Data.IDX

A package for reading and writing data in the IDX format. This data format is used for machine-learning data sets like the MINST database of handwritten digits (http://yann.lecun.com/exdb/mnist/)

Data types

data IDXData

Datatype for storing IDXData. Internally data is always stored either as Int or Double unboxed vectors. However when binary serialization is used, the data is serialized according to the IDXContentType.

Instances

Show IDXData

Binary IDXData

data IDXContentType where

A type to describe the content, according to IDX spec

Constructors

IDXUnsignedByte :: IDXContentType

IDXSignedByte :: IDXContentType

IDXShort :: IDXContentType

IDXInt :: IDXContentType

IDXFloat :: IDXContentType

IDXDouble :: IDXContentType

Instances

Show IDXContentType

Binary IDXContentType

Accessing data

idxType :: IDXData -> IDXContentType

Return the what type the data is stored in

idxDimensions :: IDXData -> Vector Int

Return an unboxed Vector of Int dimensions

isIDXReal :: IDXData -> Bool

Return wether the data in this IDXData value is stored as double values

isIDXIntegral :: IDXData -> Bool

Return wether the data in this IDXData value is stored as integral values

idxDoubleContent :: IDXData -> Vector Double

Return contained doubles, if no doubles are contained convert the content to double by using fromIntegral

idxIntContent :: IDXData -> Vector Int

Return contained ints, if no ints are contained, convert content to ints by using round

IO / Serialization

ByteString serialization

encodeIDX :: IDXData -> ByteString

decodeIDX :: ByteString -> Maybe IDXData

File IO

encodeIDXFile :: IDXData -> FilePath -> IO ()

decodeIDXFile :: FilePath -> IO (Maybe IDXData)