Copyright	(c) 2013-2023 Brendan Hay
License	Mozilla Public License, v. 2.0.
Maintainer	Brendan Hay
Stability	auto-generated
Portability	non-portable (GHC extensions)
Safe Haskell	Safe-Inferred
Language	Haskell2010

Amazonka.Firehose.Types.DataFormatConversionConfiguration

Description

Documentation

data DataFormatConversionConfiguration Source #

Specifies that you want Kinesis Data Firehose to convert data from the JSON format to the Parquet or ORC format before writing it to Amazon S3. Kinesis Data Firehose uses the serializer and deserializer that you specify, in addition to the column information from the Amazon Web Services Glue table, to deserialize your input data from JSON and then serialize it to the Parquet or ORC format. For more information, see Kinesis Data Firehose Record Format Conversion.

See: newDataFormatConversionConfiguration smart constructor.

Constructors

DataFormatConversionConfiguration'

Fields

enabled :: Maybe Bool
Defaults to true. Set it to false if you want to disable format conversion while preserving the configuration details.
inputFormatConfiguration :: Maybe InputFormatConfiguration
Specifies the deserializer that you want Kinesis Data Firehose to use to convert the format of your data from JSON. This parameter is required if Enabled is set to true.
outputFormatConfiguration :: Maybe OutputFormatConfiguration
Specifies the serializer that you want Kinesis Data Firehose to use to convert the format of your data to the Parquet or ORC format. This parameter is required if Enabled is set to true.
schemaConfiguration :: Maybe SchemaConfiguration
Specifies the Amazon Web Services Glue Data Catalog table that contains the column information. This parameter is required if Enabled is set to true.

Instances

Instances details

FromJSON DataFormatConversionConfiguration Source #
Instance details Defined in Amazonka.Firehose.Types.DataFormatConversionConfiguration Methods parseJSON :: Value -> Parser DataFormatConversionConfiguration # parseJSONList :: Value -> Parser [DataFormatConversionConfiguration] #
ToJSON DataFormatConversionConfiguration Source #
Instance details Defined in Amazonka.Firehose.Types.DataFormatConversionConfiguration Methods toJSON :: DataFormatConversionConfiguration -> Value # toEncoding :: DataFormatConversionConfiguration -> Encoding # toJSONList :: [DataFormatConversionConfiguration] -> Value # toEncodingList :: [DataFormatConversionConfiguration] -> Encoding #
Generic DataFormatConversionConfiguration Source #
Instance details Defined in Amazonka.Firehose.Types.DataFormatConversionConfiguration Associated Types type Rep DataFormatConversionConfiguration :: Type -> Type # Methods from :: DataFormatConversionConfiguration -> Rep DataFormatConversionConfiguration x # to :: Rep DataFormatConversionConfiguration x -> DataFormatConversionConfiguration #
Read DataFormatConversionConfiguration Source #
Instance details Defined in Amazonka.Firehose.Types.DataFormatConversionConfiguration Methods readsPrec :: Int -> ReadS DataFormatConversionConfiguration # readList :: ReadS [DataFormatConversionConfiguration] # readPrec :: ReadPrec DataFormatConversionConfiguration # readListPrec :: ReadPrec [DataFormatConversionConfiguration] #
Show DataFormatConversionConfiguration Source #
Instance details Defined in Amazonka.Firehose.Types.DataFormatConversionConfiguration Methods showsPrec :: Int -> DataFormatConversionConfiguration -> ShowS # show :: DataFormatConversionConfiguration -> String # showList :: [DataFormatConversionConfiguration] -> ShowS #
NFData DataFormatConversionConfiguration Source #
Instance details Defined in Amazonka.Firehose.Types.DataFormatConversionConfiguration Methods rnf :: DataFormatConversionConfiguration -> () #
Eq DataFormatConversionConfiguration Source #
Instance details Defined in Amazonka.Firehose.Types.DataFormatConversionConfiguration Methods (==) :: DataFormatConversionConfiguration -> DataFormatConversionConfiguration -> Bool # (/=) :: DataFormatConversionConfiguration -> DataFormatConversionConfiguration -> Bool #
Hashable DataFormatConversionConfiguration Source #
Instance details Defined in Amazonka.Firehose.Types.DataFormatConversionConfiguration Methods hashWithSalt :: Int -> DataFormatConversionConfiguration -> Int # hash :: DataFormatConversionConfiguration -> Int #
type Rep DataFormatConversionConfiguration Source #
Instance details Defined in Amazonka.Firehose.Types.DataFormatConversionConfiguration type Rep DataFormatConversionConfiguration = D1 ('MetaData "DataFormatConversionConfiguration" "Amazonka.Firehose.Types.DataFormatConversionConfiguration" "amazonka-kinesis-firehose-2.0-6l1hHmh2UnHBvolxuQFkWB" 'False) (C1 ('MetaCons "DataFormatConversionConfiguration'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "enabled") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool)) :: S1 ('MetaSel ('Just "inputFormatConfiguration") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe InputFormatConfiguration))) :: (S1 ('MetaSel ('Just "outputFormatConfiguration") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe OutputFormatConfiguration)) :*: S1 ('MetaSel ('Just "schemaConfiguration") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe SchemaConfiguration)))))

newDataFormatConversionConfiguration :: DataFormatConversionConfiguration Source #

Create a value of DataFormatConversionConfiguration with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:enabled:DataFormatConversionConfiguration', dataFormatConversionConfiguration_enabled - Defaults to true. Set it to false if you want to disable format conversion while preserving the configuration details.

$sel:inputFormatConfiguration:DataFormatConversionConfiguration', dataFormatConversionConfiguration_inputFormatConfiguration - Specifies the deserializer that you want Kinesis Data Firehose to use to convert the format of your data from JSON. This parameter is required if Enabled is set to true.

$sel:outputFormatConfiguration:DataFormatConversionConfiguration', dataFormatConversionConfiguration_outputFormatConfiguration - Specifies the serializer that you want Kinesis Data Firehose to use to convert the format of your data to the Parquet or ORC format. This parameter is required if Enabled is set to true.

$sel:schemaConfiguration:DataFormatConversionConfiguration', dataFormatConversionConfiguration_schemaConfiguration - Specifies the Amazon Web Services Glue Data Catalog table that contains the column information. This parameter is required if Enabled is set to true.

dataFormatConversionConfiguration_enabled :: Lens' DataFormatConversionConfiguration (Maybe Bool) Source #

Defaults to true. Set it to false if you want to disable format conversion while preserving the configuration details.

dataFormatConversionConfiguration_inputFormatConfiguration :: Lens' DataFormatConversionConfiguration (Maybe InputFormatConfiguration) Source #

Specifies the deserializer that you want Kinesis Data Firehose to use to convert the format of your data from JSON. This parameter is required if Enabled is set to true.

dataFormatConversionConfiguration_outputFormatConfiguration :: Lens' DataFormatConversionConfiguration (Maybe OutputFormatConfiguration) Source #

Specifies the serializer that you want Kinesis Data Firehose to use to convert the format of your data to the Parquet or ORC format. This parameter is required if Enabled is set to true.

dataFormatConversionConfiguration_schemaConfiguration :: Lens' DataFormatConversionConfiguration (Maybe SchemaConfiguration) Source #

Specifies the Amazon Web Services Glue Data Catalog table that contains the column information. This parameter is required if Enabled is set to true.