Amazonka.Discovery.Types.ContinuousExportDescription

Documentation

data ContinuousExportDescription

A list of continuous export descriptions.

See: newContinuousExportDescription smart constructor.

Constructors

ContinuousExportDescription'

Fields

• dataSource :: Maybe DataSource

  The type of data collector used to gather this data (currently only offered for AGENT).

• exportId :: Maybe Text

  The unique ID assigned to this export.

• s3Bucket :: Maybe Text

  The name of the s3 bucket where the export data parquet files are stored.

• schemaStorageConfig :: Maybe (HashMap Text Text)

  An object which describes how the data is stored.

  • databaseName - the name of the Glue database used to store the schema.
• startTime :: Maybe POSIX

  The timestamp representing when the continuous export was started.

• status :: Maybe ContinuousExportStatus

  Describes the status of the export. Can be one of the following values:

  • START_IN_PROGRESS - setting up resources to start continuous export.
  • START_FAILED - an error occurred setting up continuous export. To recover, call start-continuous-export again.
  • ACTIVE - data is being exported to the customer bucket.
  • ERROR - an error occurred during export. To fix the issue, call stop-continuous-export and start-continuous-export.
  • STOP_IN_PROGRESS - stopping the export.
  • STOP_FAILED - an error occurred stopping the export. To recover, call stop-continuous-export again.
  • INACTIVE - the continuous export has been stopped. Data is no longer being exported to the customer bucket.
• statusDetail :: Maybe Text

  Contains information about any errors that have occurred. This data type can have the following values:

  • ACCESS_DENIED - You don’t have permission to start Data Exploration in Amazon Athena. Contact your Amazon Web Services administrator for help. For more information, see Setting Up Amazon Web Services Application Discovery Service in the Application Discovery Service User Guide.
  • DELIVERY_STREAM_LIMIT_FAILURE - You reached the limit for Amazon Kinesis Data Firehose delivery streams. Reduce the number of streams or request a limit increase and try again. For more information, see Kinesis Data Streams Limits in the Amazon Kinesis Data Streams Developer Guide.
  • FIREHOSE_ROLE_MISSING - The Data Exploration feature is in an error state because your IAM User is missing the AWSApplicationDiscoveryServiceFirehose role. Turn on Data Exploration in Amazon Athena and try again. For more information, see Step 3: Provide Application Discovery Service Access to Non-Administrator Users by Attaching Policies in the Application Discovery Service User Guide.
  • FIREHOSE_STREAM_DOES_NOT_EXIST - The Data Exploration feature is in an error state because your IAM User is missing one or more of the Kinesis data delivery streams.
  • INTERNAL_FAILURE - The Data Exploration feature is in an error state because of an internal failure. Try again later. If this problem persists, contact Amazon Web Services Support.

  • LAKE_FORMATION_ACCESS_DENIED - You don't have sufficient lake formation permissions to start continuous export. For more information, see Upgrading Amazon Web Services Glue Data Permissions to the Amazon Web Services Lake Formation Model in the Amazon Web Services Lake Formation Developer Guide.

    You can use one of the following two ways to resolve this issue.

    1. If you don’t want to use the Lake Formation permission model, you can change the default Data Catalog settings to use only Amazon Web Services Identity and Access Management (IAM) access control for new databases. For more information, see Change Data Catalog Settings in the Lake Formation Developer Guide.

    2. You can give the service-linked IAM roles AWSServiceRoleForApplicationDiscoveryServiceContinuousExport and AWSApplicationDiscoveryServiceFirehose the required Lake Formation permissions. For more information, see Granting Database Permissions in the Lake Formation Developer Guide.

       1. AWSServiceRoleForApplicationDiscoveryServiceContinuousExport - Grant database creator permissions, which gives the role database creation ability and implicit permissions for any created tables. For more information, see Implicit Lake Formation Permissions in the Lake Formation Developer Guide.
       2. AWSApplicationDiscoveryServiceFirehose - Grant describe permissions for all tables in the database.
  • S3_BUCKET_LIMIT_FAILURE - You reached the limit for Amazon S3 buckets. Reduce the number of S3 buckets or request a limit increase and try again. For more information, see Bucket Restrictions and Limitations in the Amazon Simple Storage Service Developer Guide.
  • S3_NOT_SIGNED_UP - Your account is not signed up for the Amazon S3 service. You must sign up before you can use Amazon S3. You can sign up at the following URL: https://aws.amazon.com/s3.
• stopTime :: Maybe POSIX

  The timestamp that represents when this continuous export was stopped.

Instances

FromJSON ContinuousExportDescription

Defined in Amazonka.Discovery.Types.ContinuousExportDescription

Methods

parseJSON :: Value -> Parser ContinuousExportDescription

parseJSONList :: Value -> Parser [ContinuousExportDescription]

Generic ContinuousExportDescription

Defined in Amazonka.Discovery.Types.ContinuousExportDescription

Associated Types

type Rep ContinuousExportDescription :: Type -> Type

Methods

from :: ContinuousExportDescription -> Rep ContinuousExportDescription x

to :: Rep ContinuousExportDescription x -> ContinuousExportDescription

Read ContinuousExportDescription

Defined in Amazonka.Discovery.Types.ContinuousExportDescription

Methods

readsPrec :: Int -> ReadS ContinuousExportDescription

readList :: ReadS [ContinuousExportDescription]

readPrec :: ReadPrec ContinuousExportDescription

readListPrec :: ReadPrec [ContinuousExportDescription]

Show ContinuousExportDescription

Defined in Amazonka.Discovery.Types.ContinuousExportDescription

Methods

showsPrec :: Int -> ContinuousExportDescription -> ShowS

show :: ContinuousExportDescription -> String

showList :: [ContinuousExportDescription] -> ShowS

NFData ContinuousExportDescription

Defined in Amazonka.Discovery.Types.ContinuousExportDescription

Methods

rnf :: ContinuousExportDescription -> ()

Eq ContinuousExportDescription

Defined in Amazonka.Discovery.Types.ContinuousExportDescription

Methods

(==) :: ContinuousExportDescription -> ContinuousExportDescription -> Bool

(/=) :: ContinuousExportDescription -> ContinuousExportDescription -> Bool

Hashable ContinuousExportDescription

Defined in Amazonka.Discovery.Types.ContinuousExportDescription

Methods

hashWithSalt :: Int -> ContinuousExportDescription -> Int

hash :: ContinuousExportDescription -> Int

type Rep ContinuousExportDescription

Defined in Amazonka.Discovery.Types.ContinuousExportDescription

type Rep ContinuousExportDescription = D1 ('MetaData "ContinuousExportDescription" "Amazonka.Discovery.Types.ContinuousExportDescription" "amazonka-discovery-2.0-FHPaShbhCtL10K1sBxZHs" 'False) (C1 ('MetaCons "ContinuousExportDescription'" 'PrefixI 'True) (((S1 ('MetaSel ('Just "dataSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe DataSource)) :*: S1 ('MetaSel ('Just "exportId") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))) :*: (S1 ('MetaSel ('Just "s3Bucket") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "schemaStorageConfig") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe (HashMap Text Text))))) :*: ((S1 ('MetaSel ('Just "startTime") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)) :*: S1 ('MetaSel ('Just "status") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe ContinuousExportStatus))) :*: (S1 ('MetaSel ('Just "statusDetail") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "stopTime") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX))))))

newContinuousExportDescription :: ContinuousExportDescription

Create a value of ContinuousExportDescription with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:dataSource:ContinuousExportDescription', continuousExportDescription_dataSource - The type of data collector used to gather this data (currently only offered for AGENT).

$sel:exportId:ContinuousExportDescription', continuousExportDescription_exportId - The unique ID assigned to this export.

$sel:s3Bucket:ContinuousExportDescription', continuousExportDescription_s3Bucket - The name of the s3 bucket where the export data parquet files are stored.

$sel:schemaStorageConfig:ContinuousExportDescription', continuousExportDescription_schemaStorageConfig - An object which describes how the data is stored.

• databaseName - the name of the Glue database used to store the schema.

$sel:startTime:ContinuousExportDescription', continuousExportDescription_startTime - The timestamp representing when the continuous export was started.

$sel:status:ContinuousExportDescription', continuousExportDescription_status - Describes the status of the export. Can be one of the following values:

• START_IN_PROGRESS - setting up resources to start continuous export.
• START_FAILED - an error occurred setting up continuous export. To recover, call start-continuous-export again.
• ACTIVE - data is being exported to the customer bucket.
• ERROR - an error occurred during export. To fix the issue, call stop-continuous-export and start-continuous-export.
• STOP_IN_PROGRESS - stopping the export.
• STOP_FAILED - an error occurred stopping the export. To recover, call stop-continuous-export again.
• INACTIVE - the continuous export has been stopped. Data is no longer being exported to the customer bucket.

$sel:statusDetail:ContinuousExportDescription', continuousExportDescription_statusDetail - Contains information about any errors that have occurred. This data type can have the following values:

• ACCESS_DENIED - You don’t have permission to start Data Exploration in Amazon Athena. Contact your Amazon Web Services administrator for help. For more information, see Setting Up Amazon Web Services Application Discovery Service in the Application Discovery Service User Guide.
• DELIVERY_STREAM_LIMIT_FAILURE - You reached the limit for Amazon Kinesis Data Firehose delivery streams. Reduce the number of streams or request a limit increase and try again. For more information, see Kinesis Data Streams Limits in the Amazon Kinesis Data Streams Developer Guide.
• FIREHOSE_ROLE_MISSING - The Data Exploration feature is in an error state because your IAM User is missing the AWSApplicationDiscoveryServiceFirehose role. Turn on Data Exploration in Amazon Athena and try again. For more information, see Step 3: Provide Application Discovery Service Access to Non-Administrator Users by Attaching Policies in the Application Discovery Service User Guide.
• FIREHOSE_STREAM_DOES_NOT_EXIST - The Data Exploration feature is in an error state because your IAM User is missing one or more of the Kinesis data delivery streams.
• INTERNAL_FAILURE - The Data Exploration feature is in an error state because of an internal failure. Try again later. If this problem persists, contact Amazon Web Services Support.

• LAKE_FORMATION_ACCESS_DENIED - You don't have sufficient lake formation permissions to start continuous export. For more information, see Upgrading Amazon Web Services Glue Data Permissions to the Amazon Web Services Lake Formation Model in the Amazon Web Services Lake Formation Developer Guide.

  You can use one of the following two ways to resolve this issue.

  1. If you don’t want to use the Lake Formation permission model, you can change the default Data Catalog settings to use only Amazon Web Services Identity and Access Management (IAM) access control for new databases. For more information, see Change Data Catalog Settings in the Lake Formation Developer Guide.

  2. You can give the service-linked IAM roles AWSServiceRoleForApplicationDiscoveryServiceContinuousExport and AWSApplicationDiscoveryServiceFirehose the required Lake Formation permissions. For more information, see Granting Database Permissions in the Lake Formation Developer Guide.

     1. AWSServiceRoleForApplicationDiscoveryServiceContinuousExport - Grant database creator permissions, which gives the role database creation ability and implicit permissions for any created tables. For more information, see Implicit Lake Formation Permissions in the Lake Formation Developer Guide.
     2. AWSApplicationDiscoveryServiceFirehose - Grant describe permissions for all tables in the database.
• S3_BUCKET_LIMIT_FAILURE - You reached the limit for Amazon S3 buckets. Reduce the number of S3 buckets or request a limit increase and try again. For more information, see Bucket Restrictions and Limitations in the Amazon Simple Storage Service Developer Guide.
• S3_NOT_SIGNED_UP - Your account is not signed up for the Amazon S3 service. You must sign up before you can use Amazon S3. You can sign up at the following URL: https://aws.amazon.com/s3.

$sel:stopTime:ContinuousExportDescription', continuousExportDescription_stopTime - The timestamp that represents when this continuous export was stopped.

continuousExportDescription_dataSource :: Lens' ContinuousExportDescription (Maybe DataSource)

The type of data collector used to gather this data (currently only offered for AGENT).

continuousExportDescription_exportId :: Lens' ContinuousExportDescription (Maybe Text)

The unique ID assigned to this export.

continuousExportDescription_s3Bucket :: Lens' ContinuousExportDescription (Maybe Text)

The name of the s3 bucket where the export data parquet files are stored.

continuousExportDescription_schemaStorageConfig :: Lens' ContinuousExportDescription (Maybe (HashMap Text Text))

An object which describes how the data is stored.

• databaseName - the name of the Glue database used to store the schema.

continuousExportDescription_startTime :: Lens' ContinuousExportDescription (Maybe UTCTime)

The timestamp representing when the continuous export was started.

continuousExportDescription_status :: Lens' ContinuousExportDescription (Maybe ContinuousExportStatus)

Describes the status of the export. Can be one of the following values:

• START_IN_PROGRESS - setting up resources to start continuous export.
• START_FAILED - an error occurred setting up continuous export. To recover, call start-continuous-export again.
• ACTIVE - data is being exported to the customer bucket.
• ERROR - an error occurred during export. To fix the issue, call stop-continuous-export and start-continuous-export.
• STOP_IN_PROGRESS - stopping the export.
• STOP_FAILED - an error occurred stopping the export. To recover, call stop-continuous-export again.
• INACTIVE - the continuous export has been stopped. Data is no longer being exported to the customer bucket.

continuousExportDescription_statusDetail :: Lens' ContinuousExportDescription (Maybe Text)

Contains information about any errors that have occurred. This data type can have the following values:

• ACCESS_DENIED - You don’t have permission to start Data Exploration in Amazon Athena. Contact your Amazon Web Services administrator for help. For more information, see Setting Up Amazon Web Services Application Discovery Service in the Application Discovery Service User Guide.
• DELIVERY_STREAM_LIMIT_FAILURE - You reached the limit for Amazon Kinesis Data Firehose delivery streams. Reduce the number of streams or request a limit increase and try again. For more information, see Kinesis Data Streams Limits in the Amazon Kinesis Data Streams Developer Guide.
• FIREHOSE_ROLE_MISSING - The Data Exploration feature is in an error state because your IAM User is missing the AWSApplicationDiscoveryServiceFirehose role. Turn on Data Exploration in Amazon Athena and try again. For more information, see Step 3: Provide Application Discovery Service Access to Non-Administrator Users by Attaching Policies in the Application Discovery Service User Guide.
• FIREHOSE_STREAM_DOES_NOT_EXIST - The Data Exploration feature is in an error state because your IAM User is missing one or more of the Kinesis data delivery streams.
• INTERNAL_FAILURE - The Data Exploration feature is in an error state because of an internal failure. Try again later. If this problem persists, contact Amazon Web Services Support.

• LAKE_FORMATION_ACCESS_DENIED - You don't have sufficient lake formation permissions to start continuous export. For more information, see Upgrading Amazon Web Services Glue Data Permissions to the Amazon Web Services Lake Formation Model in the Amazon Web Services Lake Formation Developer Guide.

  You can use one of the following two ways to resolve this issue.

  1. If you don’t want to use the Lake Formation permission model, you can change the default Data Catalog settings to use only Amazon Web Services Identity and Access Management (IAM) access control for new databases. For more information, see Change Data Catalog Settings in the Lake Formation Developer Guide.

  2. You can give the service-linked IAM roles AWSServiceRoleForApplicationDiscoveryServiceContinuousExport and AWSApplicationDiscoveryServiceFirehose the required Lake Formation permissions. For more information, see Granting Database Permissions in the Lake Formation Developer Guide.

     1. AWSServiceRoleForApplicationDiscoveryServiceContinuousExport - Grant database creator permissions, which gives the role database creation ability and implicit permissions for any created tables. For more information, see Implicit Lake Formation Permissions in the Lake Formation Developer Guide.
     2. AWSApplicationDiscoveryServiceFirehose - Grant describe permissions for all tables in the database.
• S3_BUCKET_LIMIT_FAILURE - You reached the limit for Amazon S3 buckets. Reduce the number of S3 buckets or request a limit increase and try again. For more information, see Bucket Restrictions and Limitations in the Amazon Simple Storage Service Developer Guide.
• S3_NOT_SIGNED_UP - Your account is not signed up for the Amazon S3 service. You must sign up before you can use Amazon S3. You can sign up at the following URL: https://aws.amazon.com/s3.

continuousExportDescription_stopTime :: Lens' ContinuousExportDescription (Maybe UTCTime)

The timestamp that represents when this continuous export was stopped.